Todayโs meetup at the @MuxHQ location on Market Street with @Cursor, @Mintlify, @Vercel, @Mastra, @Sanity, @Inkeep and MUX - packed house and keen to hear what new thing everyone built in just a week
If you've ever wondered how vector search engines make similarity search fast, it comes down to smart indexing strategies.
Milvus, created by Zilliz offers a variety of indexing methods for you to choose from:
๐ ๐ฅ๐๐ญ (๐๐ซ๐ฎ๐ญ๐-๐๐จ๐ซ๐๐): Brute-force scan without index structure โ compares your query against every single vector, the most accurate.
๐๐๐ (๐๐ง๐ฏ๐๐ซ๐ญ๐๐ ๐ ๐ข๐ฅ๐ ๐๐ง๐๐๐ฑ): First cluster vectors, then search only the relevant clusters โ like organizing your closet by category.
๐๐๐๐ (๐๐ข๐๐ซ๐๐ซ๐๐ก๐ข๐๐๐ฅ ๐๐๐ฏ๐ข๐ ๐๐๐ฅ๐ ๐๐ฆ๐๐ฅ๐ฅ ๐๐จ๐ซ๐ฅ๐): Think of it as a multi-layered graph โ fast navigation from coarse to fine levels.
๐๐ข๐ฌ๐ค๐๐๐: Graph-based index optimized for SSD storage โ keeps quantized vectors in memory to calculate approximate distance and a full-precision version on disk to calculate accurate distance.
A guide for you to select the right index for your use case based on accuracy, speed, and memory usage.
-----
Want to learn more about vector databases, RAG, or LLM infra? Follow @milvusio for more hands-on tutorials and industrial insights.
๐ฆ Which Milvus are you today?
Feeling positive? ๐
Spreading the love? ๐ซถ
Orโฆ just a little annoyed? ๐ค
At Milvus, we understand vectors โ and vibes. Let Milvus lighten your mood and save a dry tech chat!
These cute stickers were created by our amazing ๐๐ข๐ฅ๐ฏ๐ฎ๐ฌ ๐๐ฆ๐๐๐ฌ๐ฌ๐๐๐จ๐ซ๐ฌ.
๐Apply to be a Milvus Ambassador: https://t.co/AeyDcZVQSG
Want the original image? Follow @milvusio and we'll send you the original pics!
#MilvusAmbassador
๐ฐ ๐๐จ๐ฎ๐ซ ๐ฏ๐๐๐ญ๐จ๐ซ ๐ฌ๐๐๐ซ๐๐ก ๐๐ข๐ฅ๐ฅ ๐ข๐ฌ ๐ฉ๐ซ๐จ๐๐๐๐ฅ๐ฒ ๐ฐ๐๐ฒ ๐ก๐ข๐ ๐ก๐๐ซ ๐ญ๐ก๐๐ง ๐ข๐ญ ๐ง๐๐๐๐ฌ ๐ญ๐จ ๐๐.
The problem: In multi-tenant apps, you're keeping inactive tenant data in expensive hot storage "just in case" they need it. Most of the time, they don't.
๐๐ก๐ ๐๐ง๐ ๐ข๐ง๐๐๐ซ๐ข๐ง๐ ๐๐ก๐๐ฅ๐ฅ๐๐ง๐ ๐:
Push cold data to cheap object storage โ
While keeping query latency at a reasonable level โ (this is the hard part)
Queries hitting cold storage can take 2-3 seconds. That's a non-starter for most real-time applications.
The solution requires rethinking your entire storage architectureโnot just "moving old data to S3" but ๐จ๐ฉ๐ญ๐ข๐ฆ๐ข๐ณ๐ข๐ง๐ ๐๐๐ซ๐จ๐ฌ๐ฌ ๐ฆ๐๐ฆ๐จ๐ซ๐ฒ, ๐๐ข๐ฌ๐ค, ๐๐ง๐ ๐จ๐๐ฃ๐๐๐ญ ๐ฌ๐ญ๐จ๐ซ๐๐ ๐ ๐ฅ๐๐ฒ๐๐ซ๐ฌ ๐ญ๐จ ๐ฆ๐๐ค๐ ๐๐จ๐ฅ๐ ๐๐๐ญ๐ ๐ซ๐๐ญ๐ซ๐ข๐๐ฏ๐๐ฅ ๐๐๐ญ๐ฎ๐๐ฅ๐ฅ๐ฒ ๐ฎ๐ฌ๐๐๐ฅ๐.
This is the kind of optimization work that doesn't make headlines but saves thousands in infrastructure costs.
๐ฅ Full podcast: https://t.co/ESY8ttKTHe
๐ง Listen on Spotify: https://t.co/uRzJSYPc1Z
๐ Struggling to squeeze more accuracy from your #RAG pipeline? The bottleneck might lie in how you compress knowledge.
Single vector retrieval flattens entire passages into a single embeddingโlike judging a book solely by its cover while losing every critical line inside.
๐ฅ While ๐ฌ๐ข๐ง๐ ๐ฅ๐ ๐ฏ๐๐๐ญ๐จ๐ซ (dense) embeddings compress entire documents into one representation, ๐ฆ๐ฎ๐ฅ๐ญ๐ข-๐ฏ๐๐๐ญ๐จ๐ซ ๐ฆ๐จ๐๐๐ฅ๐ฌ models with late interaction are revolutionizing information retrieval by maintaining token-level semantics.
Why multi-vector models outperform traditional approaches:
๐ They preserve granular meaning rather than averaging it
๐Enable precise token-to-token matching between queries and documents
๐Perfect balance between speed and accuracy
Three cutting-edge implementations to know:
๐ ๐๐จ๐ฅ๐๐๐๐: Text-specialized, ideal for high-precision RAG
๐ ๐๐จ๐ฅ๐๐๐ฅ๐ข: Multimodal processing with PaliGemma Vision LLM
๐๐๐จ๐ฅ๐๐ฐ๐๐ง: Apache 2.0 licensed alternative using Qwen2
Want to future-proof your vector search infrastructure? Start now.
Multi Vector retrieval needs a vector database that scalesโand #Milvus delivers: billions of vectors, low-latency search, and seamless integration with your RAG pipeline.
Day 2 of Milvus Week: Slashing costs with ๐๐๐๐ข๐ญ๐ quantization ๐ฐ
As engineers, we want it allโhigher performance, lower cost, and competitive quality.
What if you could compress a vector down to just ๐ ๐๐ข๐ญ ๐ฉ๐๐ซ ๐๐ข๐ฆ๐๐ง๐ฌ๐ข๐จ๐ง and still achieve over ๐๐% ๐ซ๐๐๐๐ฅ๐ฅ? At first, this sounds almost reckless. But RaBitQ leverages the geometry properties of high-dimensional space and uses a theoretically grounded, unbiased distance estimator to preserve the information for accurate ANN search.
To implement RaBitQ, we embedded several low-level optimizations into both open-source Milvus and the fully managed Zilliz Cloud.
The result: ๐ร ๐๐๐ฌ๐ญ๐๐ซ ๐ฏ๐๐๐ญ๐จ๐ซ ๐ฌ๐๐๐ซ๐๐ก ๐ฐ๐ข๐ญ๐ก ๐ง๐จ ๐ฅ๐จ๐ฌ๐ฌ ๐ข๐ง ๐ซ๐๐๐๐ฅ๐ฅ, and dramatically lower infrastructure cost.
โก From ๐๐๐ โ ๐๐๐ ๐๐๐ with quantized queries
๐ฏ 94.7% recall with lightweight refinement
๐ฐ Cutting costs by using only a fraction of the memory
๐ Learn how it's possible: https://t.co/dLXVLCXLrw
Thanks, @franciscojarceo, for the excellent presentation! Great observation on how the original RAG paper proposed a different method to what's commonly known as RAG these days, and the value of fine-tuning the document encoder and retriever. Feast makes it super simple to do this and more, like ingesting unstructured data from PDFs
"How do I start with Milvus?" We hear you! ๐
Proud to team up with @linuxfoundation on this tutorial! Check out Milvus's Bootcamp with notebooks for building image search, RAG, AI agents & more. @stefan_webb
๐ฅ Full video: https://t.co/EU9xyigBH1
๐ New Video: Deploying Milvus Distributed with Kubernetes โ Step-by-Step ๐ ๏ธ
Milvus is a highly scalable vector database with distributed architecture. It has 3 "T-shirt" sizes: Small (Milvus Lite, runs in python), Medium (Standalone, everything compacted in Docker image) and Large (Distributed, the flagship version on K8s). Milvus Distributed can serve billions of vectors in a single cluster.
Want to learn how to deploy Milvus on K8s in a distributed setup? In this video, we'll walk you through the entire process:
๐น Deploying Milvus using the default Helm chart
๐น Customizing the configuration by updating the Helm chart
๐น Testing the deployed Milvus with a quickstart example
๐น Accessing Milvus WebUI for easy observation and interaction with the system
Whether you're new to Milvus or K8s, this step-by-step guide will help you set up and interact with your Milvus instance with ease.
๐ฅ Check it out now to scale your vector search with Milvus! https://t.co/7Ud2SkPbnf
#Kubernetes #Helm #VectorSearch #AI #DataEngineering #CloudNative #Deployment
We're thrilled that Milvus is a key component of the exciting Smart Health Agent demo being showcased at @Google Cloud Next 2025! Visit the @nvidia booth on April 10th (5 PM PT) or April 11th (11 AM PT) to see the demo
Transform your workflows with @minishlab's product: ๐๐จ๐๐๐ฅ2๐๐๐, a lightweight, high-performance embedding technique that converts ๐๐๐ง๐ญ๐๐ง๐๐ ๐๐ซ๐๐ง๐ฌ๐๐จ๐ซ๐ฆ๐๐ซ ๐ฆ๐จ๐๐๐ฅ๐ฌ ๐๐จ๐ฆ๐ฉ๐๐๐ญ, ๐ฌ๐ญ๐๐ญ๐ข๐ ๐ฆ๐จ๐๐๐ฅ๐ฌ. It reduces model size by up to 50x and speeds up inference by up to 500x, with minimal performance loss. Model2Vec is ideal when you have resource-constrained devices. It seamlessly integrates with ๐๐ข๐ฅ๐ฏ๐ฎ๐ฌ via the Model2VecEmbeddingFunction class, enabling effortless encoding of documents and queries into Milvus-compatible dense vectors while offering deployment flexibilityโload models directly from Hugging Face Hub or use local models for diverse environments.
Try it here: https://t.co/zHh1R4uCWx
Still confused about ๐ ๐ฎ๐ฅ๐ฅ-๐ญ๐๐ฑ๐ญ ๐ฌ๐๐๐ซ๐๐ก ๐๐ง๐ ๐๐๐ฆ๐๐ง๐ญ๐ข๐ ๐ฌ๐๐๐ซ๐๐ก? Let's see how @OpenAI's GPT-4o explains it through comics.
๐น Full-text search: The classic retrieval method that finds documents containing exact terms/phrases through direct keyword matching.
๐น Semantic search: Excels at understanding intent and context.
๐ Hybrid search: Strategic combination of both approaches to maximize recall precision.
See detail: https://t.co/ZiN7yJy2Ks
DeepSearcher by @Zilliz_Official - a fully open-source research agent that generates detailed reports locally using open-source models. No API keys needed!
https://t.co/cJoHsIb9jn
#OpenSource#AI
@SambaNovaAI@milvusio@langchain If you're into AI research or just want better search results than traditional engines provide, check it out! Their GitHub: https://t.co/cJoHsIb9jn