Matthias

[AI-Driven Research for Systems @ai4research_ucb]

🎯 Bespoke OLAP makes workload-specific database engines faster

[ADRS Blog #21] We feature Bespoke OLAP, a fully autonomous synthesis pipeline that outperforms general-purpose engines like DuckDB while being ~11.78× faster on the main benchmark comparison. Bespoke OLAP uses LLM-guided code generation to build a complete, custom C++ engine for OLAP workloads for just ~$120.

✍️ Read the blog: https://t.co/aOIkicnmEt

📖 ADRS Blog Series: https://t.co/UxujLFWX8b

📄 Bespoke OLAP Paper: https://t.co/tAWsMbLy8N

👩‍💻 Bespoke OLAP Code: https://t.co/6vL6VHbEW3

[Matthias @m4ttze]

@isDineshHere Thanks for the shout-out!

[Matthias @m4ttze]

@isDineshHere We database people already worked on this. What came out is the bespoke olap paper, which is from my lab! Btw, we achieve even greater speedups with our approach! https://t.co/sIcNapXaOu

[Dinesh @isDineshHere]

"Rare examples such as @TigerBeetle demonstrate that extreme specialization can pay off when the target workload is narrow yet widely shared"

Bespoke OLAP: DBMS on-demand, for your specific workload.

Also the fact @DuckDB has pretty much become a standard to benchmark against

[Jens Axboe @axboe]

This code now landed upstream and will be part of the 7.0 kernel when released. The liburing helpers, man page, and test cases have been merged into the master branch.

[Viacheslav Biriukov @brk0v]

💿 io_uring is everywhere right now

But for DBMSs it isn’t magic dust:
• drop-in swap epoll/libaio → io_uring: ~+6–10%
• redesign for async + batching + io_uring features: ~2× end-to-end
• Postgres case study: +14% when “done right”

https://t.co/OEhIu9275o
#io_uring #linux

[Ben Dicken @BenjDicken]

I'm excited about the database performance io_uring will unlock.

Last year I benchmarked Postgres 17 vs 18 to test the initial io_uring upgrades. I was surprised to see they weren't always a clear win for TPC-C.

This paper studies the potential, and the future looks good.

[Jens Axboe @axboe]

Yes

[Tobias Ziegler @Tobias__Ziegler]

Our paper is currently on Hacker News, feel free to join in if you have questions or comments. @melhindiCS @m4ttze and I are happy to take them.

[Tobias Ziegler @Tobias__Ziegler]

Paper too long? We compiled a high-level and concise overview when io_uring is beneficial: https://t.co/qAQIzFuOex

[Matthias @m4ttze]

@_devott @TigerBeetleDB @melhindiCS @Tobias__Ziegler @viktor_leis @cbinnig Latency-wise we can go down as low as ~9.3 microseconds for UDP and ~10.3 microseconds for TCP. DPDK for reference is ~7 microseconds on our system. However, DPDK lacks all the nice TCP/IP features. (more Details in the paper)

[TigerBeetle @TigerBeetleDB]

How modern database systems can leverage the Linux io_uring interface for efficient, low-overhead I/O

https://t.co/gONgy5YBfS

@m4ttze @melhindiCS @Tobias__Ziegler @viktor_leis @cbinnig

[Matthias @m4ttze]

@AhamPiyush Paper: https://t.co/FHJ6zU5Kwc

[Tobias Ziegler @Tobias__Ziegler]

Interested in io_uring? Check out our new paper, joint work with my former colleagues from TU Darmstadt (@cbinnig and @m4ttze) and from TU Munich (@melhindiCS and @viktor_leis). https://t.co/3QUrSuXbY3

[Matthias @m4ttze]

@__vishwanath__ @Tobias__Ziegler @cbinnig @melhindiCS @viktor_leis @axboe Yes! We evaluated them in this paper, including zero-copy receive on 400Gbit/s NiCs!

[Tobias Ziegler @Tobias__Ziegler]

Interested in io_uring? Check out our new paper, joint work with my former colleagues from TU Darmstadt (@cbinnig and @m4ttze) and from TU Munich (@melhindiCS and @viktor_leis). https://t.co/3QUrSuXbY3

[John Kraus @johnkrausphotos]

Starship goes interdimensional during Flight 10. One of the most insane vapor cones I've ever seen.

[Elon Musk @elonmusk]

Good morning

[SpaceX @SpaceX]

Mechazilla has caught the Super Heavy booster!

[Polaris @PolarisProgram]

HARMONY OF RESILIENCE: Recorded in space and sent to Earth via @SpaceX’s @Starlink constellation, Polaris Dawn crewmember and violinist @Gillis_SarahE invites you to enjoy this music moment in support of @StJude & @ElSistemaUSA → https://t.co/My8cUwAWzg

[SpaceX @SpaceX]

Stage separation!