Introducing SID-2, a new search model built on compute-scaling swarms.
Our swarms find better results than Opus and Astra, while being 8x faster and 20x lower cost.
By 2030, AI will write an internet's worth of text every 24 hours. Current search pipelines were built on hand-designed rules, adding more won't scale to meet this incoming volume of data.
SID-2 is available on our API today. Try it on your most demanding searches.
the future of search is swarms that have no human structure
other labs train swarms controlled by a central agent, but the data pointed us in the opposite direction
agents must define their own connections in order to scale coordination to arbitrarily complex search spaces:
the future of search is swarms that have no human structure
other labs train swarms controlled by a central agent, but the data pointed us in the opposite direction
agents must define their own connections in order to scale coordination to arbitrarily complex search spaces:
Introducing SID-2, a new search model built on compute-scaling swarms.
Our swarms find better results than Opus and Astra, while being 8x faster and 20x lower cost.
By 2030, AI will write an internet's worth of text every 24 hours. Current search pipelines were built on hand-designed rules, adding more won't scale to meet this incoming volume of data.
SID-2 is available on our API today. Try it on your most demanding searches.
Introducing SID-2, a new search model built on compute-scaling swarms.
Our swarms find better results than Opus and Astra, while being 8x faster and 20x lower cost.
By 2030, AI will write an internet's worth of text every 24 hours. Current search pipelines were built on hand-designed rules, adding more won't scale to meet this incoming volume of data.
SID-2 is available on our API today. Try it on your most demanding searches.
Introducing SID-2, a new search model built on compute-scaling swarms.
Our swarms find better results than Opus and Astra, while being 8x faster and 20x lower cost.
By 2030, AI will write an internet's worth of text every 24 hours. Current search pipelines were built on hand-designed rules, adding more won't scale to meet this incoming volume of data.
SID-2 is available on our API today. Try it on your most demanding searches.
Introducing SID-2, a new search model built on compute-scaling swarms.
Our swarms find better results than Opus and Astra, while being 8x faster and 20x lower cost.
By 2030, AI will write an internet's worth of text every 24 hours. Current search pipelines were built on hand-designed rules, adding more won't scale to meet this incoming volume of data.
SID-2 is available on our API today. Try it on your most demanding searches.
The Multi-Model Future is Here.
That's why we're partnering with Baseten to bring agentic search to every dataset.
People often misinterpret The Bitter Lesson, which is about using general methods, not about creating general models. One of Sutton's examples of a Bitter-Lesson model is AlphaGo, which is the opposite of general (it only plays Go) but was trained using general methods. That the most general method to pretrain a text transformer happened to create a very general model is less a law of nature than a property of the data: the biggest dataset (the internet) also happens to be the most general.
But even the most general language models aren't very good at playing Go. There is value to general models, but this generality comes at the cost of outright performance. What you really want to maximize is leverage on computation: capability per FLOP, whether spent in training or at inference. A better training objective gives you more leverage. A way to use less human data gives you leverage (albeit indirectly). For Go, AlphaZero training has orders of magnitude more leverage than retrofitting a language model.
At SID, we have found ways to get much more leverage for the task of search; incidentally, one of the two tasks Sutton believes scales arbitrarily (yes, he meant search as in MCTS, but we'll take it). We don't know the full extent of our leverage, but SID-1 gives a lower bound: it matches frontier models on retrieval accuracy at roughly 1/500th the inference compute, more than 2 OOMs.
Unlike Go, search is very useful. We’re thrilled to partner with Baseten to bring this utility to everyone. Together we offer agentic search at 20x lower latency and 100x lower cost than a general frontier model, at equal or better accuracy.
We expect many other tasks to go this way. The future will be multi-model not as a compromise to save money, but because specialized models are simply better: faster, cheaper, and more accurate at the thing you actually need.
Today, we're announcing Baseten for Model Labs.
We believe the AI landscape will be made up of a diverse ecosystem of specialized, closed-weight models running alongside open-weight ones.
Baseten for Model Labs is the platform built to enable labs to monetize, distribute, and scale their closed models on Baseten infrastructure.
Today, we're announcing Baseten for Model Labs.
We believe the AI landscape will be made up of a diverse ecosystem of specialized, closed-weight models running alongside open-weight ones.
Baseten for Model Labs is the platform built to enable labs to monetize, distribute, and scale their closed models on Baseten infrastructure.
turbopuffer x SID
An easy way to tell a good from a great AI researcher: how much do they think about infrastructure.
Infra extends beyond what’s running on the GPUs: Slow environments will bottleneck your training steps. More parallel and powerful models make this problem worse.
RL environment specifics are usually secret, but we shared some details in a recent post with our friends at @turbopuffer
Training great models requires great infrastructure and we’re excited to be working with the best.