😊 💙 ☕

Software Engineer, OSS contributor/enthusiast

[😊 💙 ☕ @edward_ribeiro]

@MansiCodez Oops, I wrote a blog post about this! 🙈

https://t.co/hL6uvWQgqh

[😊 💙 ☕ @edward_ribeiro]

Sharding vs. Partitioning: When Definitions Got Sliced and Fractured https://t.co/hL6uvWQgqh

[😊 💙 ☕ @edward_ribeiro]

@bauglir32 @ProfLeoOficial Esqueceu do Toffoli? Impediu Lula de ir ao velório do irmão!

[😊 💙 ☕ @edward_ribeiro]

@MansiCodez Sharding is a subset of partitioning, i.e., horizontal partitioning spread across nodes. You can partition without sharding, but not shard without partitioning.

But the classic DDB textbook by Özsu & Valduriez never says sharding, only fragmentation. Term came later w/ NoSQL.

[Gwen (Chen) Shapira @gwenshap]

I've been following a lot of the wal-on-s3 and database-on-s3 debates... and I think everyone is wrong 🤣

First. All the hand-wringing about whether it counts as database-on-s3 if there are cache layers above it. Guys, DBs for the last 40 years had cache layers above an extremely slow storage layer.

You think S3 is slow? Try a Netapp device with RAID-5 when the DB has a completely over-subscribed top-of-rack switch. Try a high performance Symmetrix, with a dedicated storage network, with a massively undersized Barracuda switch that basically tips over whenever someone takes a backup. Databases were designed for slow storage, and caches are the way to go. Even with NVMes, caches rock the world. I don't understand why suddenly this is a topic for debate.

Second. Getting this to work reliably is not trivial.
You can vibe-code it... If you have 20 years experience building distributed data systems, and you know every algorithm and how well they worked in production and how to comprehensively test them. Then you can guide your LLM toward a great outcome.

But if it is your first time building a distributed system (or any kind of data store), you should see this as a learning experience - and embrace the lessons that are facing you. As many people discovered in the last week - learning in public is a great way to learn, but is not for the faint of heart.

But learning *is* the important bit. Which is why I'm sharing my 2 bits - so everyone can yell at me and I can learn too!

[😊 💙 ☕ @edward_ribeiro]

@kellabyte How heartwarming to read this the week I came back to X/Twitter! 😊

[😊 💙 ☕ @edward_ribeiro]

"Clustered Index" Doesn't Mean What You Think It Means (And That's Alright!) https://t.co/flUSTQQgh6

[😊 💙 ☕ @edward_ribeiro]

@DemocraciaBR_Ja

[😊 💙 ☕ @edward_ribeiro]

@gwenshap Very nice recommendation! I would recommend the use of partial indexes on non deleted rows and table partitioning to help with performance.

[😊 💙 ☕ @edward_ribeiro]

@radiohaedd Com certeza!

[😊 💙 ☕ @edward_ribeiro]

@WSJ Modern conservatism is a paradox.

[😊 💙 ☕ @edward_ribeiro]

@jnascim O cara vive fora da realidade. As empresas americanas foram pra China!

[😊 💙 ☕ @edward_ribeiro]

@fwbrasil Congratulations 👏👏👏🎉

[😊 💙 ☕ @edward_ribeiro]

@brunavvaz É o tipo de confusão que eu cometeria, hahahaha

[😊 💙 ☕ @edward_ribeiro]

@porcelli Best of luck 🍀!

[😊 💙 ☕ @edward_ribeiro]

@iavins This paper cites a couple more implementations.

https://t.co/QSkNjVeEZl

[Debasish (দেবাশিস্) Ghosh 🇮🇳 @debasishg]

LSM trees are traditionally known to offer high throughput for writes and good utilization of storage space.

Here's a relatively new paper (2023) that discusses some of the optimization techniques adopted by LSM engines to accelerate reads.

The LSM Design Space and its Read Optimizations -
https://t.co/Lz5HCok6jz

[😊 💙 ☕ @edward_ribeiro]

@iavins Cassandra, ScyllaDB, LevelDB from the top of my head.

[😊 💙 ☕ @edward_ribeiro]

@brunavvaz E mesmo nessa plataforma ela é parte de uma porcentagem mínima de pessoas que têm esse ganho. Muita gente vai se iludindo por achar que vai lucrar igual. As consequências serão dramáticas.

[😊 💙 ☕ @edward_ribeiro]

@AlexMillerDB Really cool post, congratulations!

By the way, are you aware of Alberto Lerner's work in this area?

https://t.co/w8RzBapz5y

[😊 💙 ☕ @edward_ribeiro]

@glaucia_lemos86 Que ela possa usufruir de uma boa qualidade de vida, cercada de muito carinho e amor. 🙏