I tweet/retweet interesting stuff about #DistributedSystems and #compsci. Suggest links/papers/conversations via DM! Tag for retweets. Run by @federico_ponzi
Big List of 20 Common Bottlenecks
https://t.co/jaOm2QoCDK
In Zen And The Art Of Scaling, Sullivan offered an interesting conjecture: there are 20 classic bottlenecks. In practice we all know bottlenecks come in infinite flavors, all tasting of sour and ash.
Life Beyond Distributed Transactions
https://t.co/6ARs9Galih
Practical approaches used in the implementation of large-scale mission-critical applications in a world that rejects distributed transactions.
Did you know that Aurora DSQL now supports foreign key constraints?
The team's done a great job here: FKCs that scale well, especially for your read-heavy workloads.
Check it out here: https://t.co/LkGszVsKFu
Quick thread on how FKCs in DSQL work...
The trend of using S3 for databases is continuing, if not gaining momentum. I've seen three or four new examples in the past week with Cursor Origin being the headline yesterday. I wrote about why I thought this would happen a couple of year ago:
https://t.co/qwEYZ2SMkd
Git at any scale
https://t.co/lrhKaTWNTA
Twenty years after Linus Torvalds created it, Git has become an industry standard. The average company rely on a centralized host. And hosting a Git repository, it turns out, is an incredibly hard thing to do.
On building scalable control planes
https://t.co/3fGXgoTZqm
On the surface, the control plane looks quite boring: it records what should exist and reconciles that with what actually does.
Making 768 servers look like 1
https://t.co/mWfbZhCLYh
A single database server cannot handle such demand, so we must spread the queries and data out across many servers with database sharding.
Queues Don't Fix Overload
https://t.co/1w18O9ls42
To oversimplify things, most of the projects I end up working on can be visualized as a very large bathroom sink. User and data input are flowing from the faucet, down 'till the output of the system[..]
Remy's blog post is good, but I think it severely overstates the simplicity of WSI when compared to traditional SI.
What we would agree on: SSI is a little weird, and I see it mostly as a pragmatic historical artifact that the 'right solution'.
Simple and Correct Snapshot Isolation
https://t.co/wAuobHRzEy
Snapshot isolation (SI) is a popular approach to concurrency control in databases systems. It avoids many forms of anomalies, yet provides a high degree of concurrency, especially for read-heavy workloads.
Hypothesis, Antithesis, synthesis
https://t.co/LIw2KH32gv
Hegel is an attempt to bring the quality of property-based testing found in Hypothesis to every language.
Testing for DR Failover Testing
https://t.co/31OeNcToUp
A simplified scenario is recovery from a full data centre failure. The Zendesk Chat backend infrastructure operates in a single data centre. The way to be sure that DR works is to perform a real failover.