There’s more hiding inside open lakehouse architectures than most teams realize.
Catch @vishnuv9248's talk on June 18 at 11:30 AM PDT, then drop by booth 548 to meet the e6data team.
Cost, governance, portability, and the freedom to run anywhere.
Reminder!
Samyak and Aayush are running a hands-on “Building a SQL engine from scratch” workshop this Friday, 1:30–5:30 PM, at Sahaj Software office, Koramangala.
Things I really dislike about Fable:
1. Anthropic collects my prompt history, stores it, and does whatever they want with it for 30 days. No opt-out
2. They can nerf their most expensive model without telling me, billing me the same amount, wasting my time. Whenever they want
Would you let AI play your fav video game while you just stare at the screen? No! You play because you get joy, because it challenges you, because you love it.
Same applies to AI + Enginnering. What an amazing take by @hnasr. Watch this, folks!!
And yes, do not let AI rob you of the journey.
I've got an agent in a loop optimizing a renderer with the goal to minimize frame times (and tests to measure). It got times down from 88ms to 2ms and allocations down from ~150K to 500. Sounds good, right? Wrong. This is exactly why agent psychosis is a big fucking problem.
As an experiment, I rewrote the Ghostty core render state in Go, with access to identically laid out data structures as Ghostty and the exact same validation tests. I made a purposely naive renderer (simple, correct, but slow). 88ms per frame with 150,000 allocations (horrendous, lol)!
I then kickstarted a Ralph loop to bring the frame times down. I told it it can't modify input data structures or the public API or tests (they're correct), but it can do anything else it wants. It got to work.
It has worked for about 4 hours. I've spent around $350 on this experiment so far. The results?
88ms => 1.5ms
150K allocs => ~500 allocs
Incredible right? Nope.
My hand-written renderer I ported has frame times (same benchmark) of ~20us (0.020ms) and 0 allocations in the update path.
This is the problem with psychosis and lacking systems understanding. If you don't understand the system, you're going to accept that this is an incredible result. If you understand the system, you'll see better solutions immediately and can do roughly 75x better on throughput.
The people who blindly trust agent output are in the former camp. They're sheeple, overdrinking from a fountain of mediocrity.
Standard disclaimer: I use AI all the time. I like AI. The point I'm making is to not blindly accept results. Think. Analyze. Learn.
Alerts tell you what changed. But they rarely tell you why.
This blog breaks down how we built a causal attribution engine that separates WHERE the delta came from, WHY it happened, and THE STORY an AI agent can verify with SQL.
Read here: https://t.co/ouWIdjRhP7
I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out.
I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really).
It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely.
The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture.
We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying.
I worry.
Where others use AI to “create”, at TigerBeetle we’re more excited about how to use the machines to “destroy”.
Some see AI as a way to “type faster” or “increase productivity”, but at TigerBeetle I tell the team we’re already “too productive” (through TigerStyle), we want calm focused work not burnout… and we know that all the huge gains come from understanding anyway.
So “destruction” aka testing, i.e. as a foil or sparring training partner, is where we see it’s at with AI.
Not to create. That stays with the humans so we don’t atrophy our understanding, which is more valuable than “LOC”.
But to increase quality through defense in depth in testing. But even there, the gains with AI are marginal, a few percent, compared to the 90% power of our DST, which again, came from systems thinking.
So I encourage our team to “keep playing the violin yourself”, to keep practicing, keep training, keep investing in understanding.
I asked the TigerBeetle team yesterday:
“What are the things that accelerate us existentially, by orders of magnitude?”
Everyone said:
“Exponential quality”
“First principles understanding”
“Systems thinking”
“A methodology that’s 2nd order remarkable”
Guess what nobody said?
What we are losing with AI is syntax -- and good riddance. The less our brains are occupied by semicolons and braces the better. There are much more important things for us to consider and manage.