Lei Xu

gpu poor and import mlx as np at @lancedb

[LanceDB @lancedb]

Just merged into Lance: a completely new FTS index layout

🚀 9.35x faster index builds (34s → 3.6s)
🚀 8.87x smaller index size (955MB → 107MB)
🚀 3.41x faster phrase queries (21ms → 6ms)

Block bitpacking + delta encoding + new phrase query algo.

Opt in today with LANCE_FTS_FORMAT_VERSION=2

https://t.co/CQ8F4aacph

[Lei Xu @eddyxu]

@OnlyXuanwo Rebuild Rust in Rust (RRR)

[Lei Xu @eddyxu]

@OnlyXuanwo Rebuild rust right in rust (RRRR)

[Xuanwo @OnlyXuanwo]

We can just build.

I build this as a toy project but now it’s available to all duckdb users over the world. So amazing!

Let me what we should build next 🙌

[Lei Xu @eddyxu]

Lance format is officially in DuckDB now . Check it out

[DuckDB @duckdb]

📈 Today, we are releasing DuckDB version 1.5.1, a patch release with bug fixes, performance improvements and support for the Lance lakehouse format.

➡️ https://t.co/tkZWYxs4EN

[LanceDB @lancedb]

Did you spot Lance & LanceDB in Jensen Huang's keynote at @nvidia GTC today? 👀

Jensen highlighted one of the biggest shifts in AI infrastructure: unlocking unstructured data.

[Quentin Lhoest 🤗 @lhoestq]

@lancedb @huggingface vector search on a 10TB dataset on HF without any separate serving system is crazy !

[LanceDB @lancedb]

𝗨𝘀𝗲 𝗟𝗮𝗻𝗰𝗲𝗗𝗕 𝗮𝘀 𝗮 𝗺𝗲𝗺𝗼𝗿𝘆 𝘀𝘁𝗼𝗿𝗲 𝗳𝗼𝗿 𝘆𝗼𝘂𝗿 𝗔𝗜 𝗮𝗴𝗲𝗻𝘁𝘀 𝗶𝗻 𝗢𝗽𝗲𝗻𝗖𝗹𝗮𝘄 🦞

Simply set `plugins.slots.memory = "memory-lancedb”` in your @openclaw config, and you’re ready to go.

[LanceDB @lancedb]

1/5 Large multimodal blobs don’t have to break dataset workflows.

Images and videos are often treated as external files, separate from metadata and indexes. Once datasets get large, that split makes exploration, curation, and training painful.

Lance changes that on the 🤗 @huggingface Hub. 🧵👇

[Lei Xu @eddyxu]

It feels the end this time

[Prashanth Rao @tech_optimist]

Capping off a cold, wintry, locked-in day ☕️ with this AWESOME PR on a graph benchmark, it totally made my day.

The #Lance format is something to hold close to the heart 🤗, and there's LOTS more to do on the lance-graph front, stay tuned!

See: https://t.co/T3qk2VuuNA

[Nitya @nityasnotes]

exa-d uses
@raydistributed pipeline execution for incremental recomputation
@lancedb for surgical column patching per fragment

[Lei Xu @eddyxu]

Exa team is amazing early adopter of the @lancedb Lance format. Proudly collaborating with them along the way.

[Exa @ExaAILabs]

What does it take to store the web as a database?

exa-d is our internal data framework that orchestrates declarative typed dependencies, sparse updates with precise granularity, efficient and parallel execution across scaling compute, and more.

https://t.co/w2QhhgEhrj

[Lei Xu @eddyxu]

This was the most exciting development during last Christmas.

[LanceDB @lancedb]

1/5 @lancedb 🫶🏻 @duckdb

We’re happy to announce a new Lance extension for DuckDB! You can simply install this extension in DuckDB and point at your Lance datasets from within a DuckDB CLI or a Python script, while getting 𝗳𝘂𝗹𝗹 𝗦𝗤𝗟 𝗰𝗮𝗽𝗮𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀 𝗼𝗻 𝘁𝗼𝗽 𝗼𝗳 𝗟𝗮𝗻𝗰𝗲 without copying your data!

[LanceDB @lancedb]

1/5 In this blog post, we discuss what we mean by “multimodal” and the different lenses through which it can be viewed. Rather than thinking of “multimodal” as just a content label (text, images or video/audio), it makes sense to think of it at a *system* level.

[Xuanwo @OnlyXuanwo]

Alright, let's go! Once the @duckdb team approves my extension bump PR, we'll be able to use all those fancy features!

[Lei Xu @eddyxu]

囤了一个128gb RAM的M4 max Mac Studio, 打算勒紧裤腰带熬过这几年

[Xuanwo @OnlyXuanwo]

lance-duckdb v0.2.0 is coming!

This version will have:

- vector/fts/hybird search in @lancedb
- native support of @duckdb 's secret system
- filter & project pushdown to @lancedb
- native support of @huggingface fs
- explain diagnostics support

[Lei Xu @eddyxu]

@OnlyXuanwo has been in @lancedb Santa mode for a whole week!

[Xuanwo @OnlyXuanwo]

Happy Christmas Eve!

EXPLAIN now works on @lancedb over @duckdb

[Xuanwo @OnlyXuanwo]

Happy Christmas Eve!

EXPLAIN now works on @lancedb over @duckdb