Vector databases are no longer a cloud product. They're becoming a pip install.
A new open-source project called turbovec just crossed 10K stars on GitHub. And once you understand what it does, you understand why.
It's a Rust vector index with Python bindings, built on Google Research's TurboQuant algorithm, a quantizer accepted at ICLR 2026 that compresses embeddings to within a hair of the theoretical Shannon limit.
No codebook training. No train phase. No rebuilds as your corpus grows. You add vectors, they're indexed. Done.
The headline number: A 10 million document corpus takes 31 GB of RAM as float32. turbovec fits it in 4 GB and searches it faster than FAISS.
Read that again. Faster than FAISS. The library Meta has tuned for a decade. Hand-written NEON and AVX-512 kernels beat FAISS FastScan by 12โ20% on ARM and match-or-beat it on x86.
(And the recall benchmarks are published openly against FAISS as the baseline including the configs where it loses. That honesty alone is rare in this space.)
But the speed isn't even the strategic part. The strategic part is what this enables:
Fully local, air-gapped RAG.
10M documents in 4 GB means your entire company knowledge base fits in the RAM of a MacBook. Pair it with an open-source embedding model and nothing not a query, not a vector, not a document ever leaves your machine.
It also ships drop-in replacements for the vector stores inside LangChain, LlamaIndex, and Haystack. Swap one import, keep your pipeline. The switching cost is approximately zero.
The obvious comparison is SQLite.
Databases used to be servers you provisioned and paid for. Then SQLite made the database a file inside your app, and an entire category of managed infrastructure became optional for most use cases. The same compression-driven collapse is now coming for vector search.
Every startup selling "managed vector search" as a line item should be paying attention. When the index fits in laptop RAM, runs faster than the industry standard, and installs in one line the moat was never the database.
The vector database is becoming an embedded library, not a cloud service. And the frontier of RAG just moved on-device.
Really cool to see.
โก๏ธ Easier way, no need to disable SIP:
sudo defaults write "/Library/Preferences/FeatureFlags/Domain/GenerativeModels.plist" "EnhancedSiriWaitlist" -dict-add Enabled -bool NO
HOW TO SPEED UP SIRI AI WAITLIST
Simple. Ensure your language is set to US English, not UK. Close settings and navigate to Siri again. Update should start instantly
@ParthJadhav8 Pretty useless.
If the trailer were to drop right now, you would know within the next hour without any alerts. Thatโs how big the GTA franchise is.
Checking daily does not help when it comes to this level of anticipation.
@first_mccoy@ArjunSubr The beta version itself exceeds the Siri model by almost double. Iโm certain the amount of traffic during the update itself surpasses the Siri Ai by a mile.
PSA: If you have multiple macbooks that support RDMA, you can cluster them using @exolabs and run 30B+ models at 70 tok/s over thunderbolt5. tensor parallelism on consumer hardware is a solved problem. you are renting GPUs that are worse than the laptop on your couch. 2X M4 Max(64GB each) running mlx-community/Qwen3-30B-A3B-4bit @ 70 TPS
If you've adopted AI at your company but haven't seen any tangible results, read this 1990 article: "The Dynamo and the Computer" by Paul David.
When electricity first arrived, factories that "adopted" it barely got faster. They just swapped the steam engine for an electric one and ran everything else exactly as before: same machine layout, same workflow, same management. Electricity in, no real gains out.
The most common mistake with any new technology is to drop it into the old organization and then declare the transformation done.
The real leap came decades later, when each machine got its own small motor. Suddenly machines no longer had to be lined up around one central drive shaft. They could be rearranged around the actual flow of work.
The productivity gains didn't come from electricity. They came from REDESIGNING THE ENTIRE FACTORY around it.
AI is the same. Bolting it onto your existing process gets you a faster steam engine. The payoff comes when you redesign the work itself.
(link to paper in comments)
So basically, we will never have Siri AI in Europe.
I have been waiting for the iPhone mirroring feature for over two years now, and we still don't have it. So why would the new Siri be introduced?
#wwdc
@thsottiaux Told my agent to run nested loops. It complained, but I told it โjust do itโ. Not sure what itโs been doing the last 24hrs exactly but Iโm sure Peter Steinberger is happy.