Materialized View

Software infrastructure hot takes, project and paper highlights, developer interviews, and stack deep dives. Brought to you by @criccomini.

[Materialized View @getmaterialized]

⚒️ sqlancer: Automated testing to find logic and performance bugs in database systems

"SQLancer (Synthesized Query Lancer) is a tool to automatically test Database Management Systems (DBMS) in order to find logic bugs in their implementation."

https://t.co/tdb7S7AcNx

[Materialized View @getmaterialized]

🏗️ sqrl

"Build GenAI applications, data products, and data-driven features quickly at scale without a PhD in data systems."

https://t.co/Fzhfz4JcOc

[Materialized View @getmaterialized]

🏗️ fizbee

"A Formal specification language and model checker to specify distributed systems."

https://t.co/pHjM8Tg7Hc

[Materialized View @getmaterialized]

🏗️ cr-sqlite - Convergent, Replicated, SQLite

"CR-SQLite is a run-time loadable extension for SQLite and libSQL. It allows merging different SQLite databases together that have taken independent writes."

https://t.co/N5u8JdYc4e

[Materialized View @getmaterialized]

📄Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging

"...we introduce Lazy Leveling, a new design that removes merge operations from all levels of LSM-tree but the largest."

https://t.co/r1KDKwm3ck

[Materialized View @getmaterialized]

✍️ Incremental Compaction 2.0: A Revolutionary Space and Write Optimized Compaction Strategy

"Space Amplification Goal (SAG) will allow you to maximize your disk utilization without killing the write performance of Incremental Compaction Strategy (ICS)"

https://t.co/z75dHuEFWH

[Materialized View @getmaterialized]

📺 Mojo🔥: a deep dive on ownership with Chris Lattner

“Mojo wants to learn from Rust. Mojo doesn’t want to be Rust.”

https://t.co/rjpaH5vZw7

[Materialized View @getmaterialized]

📄Deep Lake: a Lakehouse for Deep Learning

"Deep Lake maintains the benefits of a vanilla data lake with one key difference: it stores complex data, such as images, videos, annotations, as well as tabular data, in the form of tensors..."

https://t.co/tvsmBp7vxw

[Materialized View @getmaterialized]

🏗️ Bend: A massively parallel, high-level programming language

“Unlike low-level alternatives like CUDA and Metal, Bend has the feeling and features of expressive languages like Python…”

https://t.co/SCdz8xZ2OR

[Materialized View @getmaterialized]

✍️ The loser tree data structure: How to optimize merges and make your programs run faster

"Bryan explored the loser tree data structure (yes, that’s its real name) as a way to optimize sorting and merging operations so your applications run faster."

https://t.co/KkW0Ogxcrk

[Materialized View @getmaterialized]

📄 Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores

"Delta Lake uses a tx log that is compacted into Apache Parquet format to provide ACID properties, time travel, and ..."

https://t.co/PnwPwGxu8V

[Materialized View @getmaterialized]

🏗️ Blessed: An unofficial guide to the Rust ecosystem

"The STL in Rust is much smaller than in Python or Go, for example. Those languages come with "batteries included" support for things like HTTP(S), JSON, timezones, random numbers, and async IO."

https://t.co/E1XSw9CI6n

[Materialized View @getmaterialized]

✍️ The State of Async Rust: Runtimes

"While 2016 evokes nostalgic memories of excitement and fervor surrounding async Rust, my sentiments regarding the current state of its ecosystem are now somewhat ambivalent."

https://t.co/NTyASo0sqw

[Materialized View @getmaterialized]

✍️ How Rockset Separates Compute and Storage Using RocksDB

“In this blog, we’ll walk through how Rockset provides compute-storage separation while making real-time data available to queries.”

https://t.co/jOJROWy7lZ

[Materialized View @getmaterialized]

📄 Improving Performance in LSM-Tree based Key-Value Stores using NVMe

"Motivated by SpanDB, we propose a method which splits hot data1 to NVMe SSD and SATA SSD and provides the sum performance of both devices."

https://t.co/H7cYmw4mdO

[Materialized View @getmaterialized]

🏗️ quokka

"Quokka is a tool for you to run custom stateful and windowed computation over terabytes of historical time series data."

https://t.co/40akwIE6fQ

[Materialized View @getmaterialized]

✍️ So Many New Systems Programming Languages II

"Twelve new systems languages, and one that dates to the Carter administration"

https://t.co/6hlbS7bPqe

[Materialized View @getmaterialized]

🏗️ datamodel-code-generator

"This code generator creates pydantic v1 and v2 model, dataclasses.dataclass, typing.TypedDict and msgspec.Struct from an openapi file and others."

https://t.co/XPkCA3CvJG

[Materialized View @getmaterialized]

📄 Positional Delta Trees to reconcile updates with read-optimized data storage

https://t.co/HuzR9upVtM

[Materialized View @getmaterialized]

✍️ Zig And Rust

"I now find myself writing Zig full-time, after more than seven years of Rust. This post is a hand-wavy answer to the “why?” question."

https://t.co/mRuPGnh5vh