Lucas Bradstreet @ghaz.bsky.social

Working on the Kafka Storage team at @confluentinc. Lately I've been working on Confluent Freight. Ex-Distributed Masonry.

{he/him}

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@ALEXEIMARTOV A little bit. But maybe it's safer than doing the typing thing for many people. The main reason is that 1PW can actually check that the website is the correct one when it auto enters it (tho you can override it). This is one big benefit of passkeys or U2F keys.

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@ALEXEIMARTOV If you don't want to enter the 2FA in the first place you can store them in 1PW. I don't do that because I don't want them in the same place as my passwords, but it is pretty convenient.

You should be using passkeys (I put them in 1pw) where available. Those are even safer.

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@ALEXEIMARTOV I ripped a touchid sensor out of a magic keyboard that I bought on ebay and 3D printed a case for it. It's currently attached to the top of my streamdeck.

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@ALEXEIMARTOV The impression that I got is that they're trying to describe the code to you inline, but doesn't expect you to retain most of them in the code you merge. Most of the comments it leaves for me aren't quite to that degree though.

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@petespetes @acpandy It's pretty surreal that they're that high

[Confluent @confluentinc]

Apache Kafka 4.0 is here!
This release marks a major milestone–Kafka now runs entirely without ZooKeeper! By running in KRaft mode, Kafka simplifies deployments, improves scalability, and reduces operational overhead.
Plus, get ready for:
✅ Faster consumer rebalances with KIP-848
✅ Early access to Queues for Kafka (KIP-932) for point-to-point messaging
Explore what’s new in @davidjacot's blog ➡️ https://t.co/2PJCar77bo

[Gwen (Chen) Shapira @gwenshap]

🔒 Simplify your multi-tenant app authentication with our step-by-step guide using Next.js and Postgres!

Join me in today's video for 3 simple steps to multi-tenant authentication.

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@kozlovski If you're not saving anything, what's the purpose of the multi-part object?

[Jack Vanlightly @vanlightly]

A new log replication disaggregation survey post is out!
The Kafka Replication Protocol:
🔹Separation of control plane from data plane.
🔹Role separation with minimal coupling.
🔹Kafka’s alignment with Paxos roles.
https://t.co/noV1kRzaAU

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@KevinEspiritu My childhood home has a bath which routes its water via a pipe to a hose - then the grey water could be pointed wherever you want.

[Jack Vanlightly @vanlightly]

New distributed systems protocol write-up!

Virtual Consensus (Delos) heavily inspired the new architecture in Confluent’s Kora engine, powering Freight Clusters. This write-up dives into Virtual Consensus in Delos paper and why it makes sense as the default log replication protocol in the era of object storage and hybrid environments.

https://t.co/PL7AHPKDrY

[Mahesh Balakrishnan @maheshb]

[new blog post] Three Laws of Software Complexity (or: why software engineers are always grumpy)

https://t.co/th96Wf2VY4

[Martin Bradstreet @ALEXEIMARTOV]

he was a good one.

[Jack Vanlightly @vanlightly]

With the announcement of S3-native-streams (Freight clusters), here is a commentary on Confluent strategy regarding object storage, streaming and an open data architecture.

https://t.co/aS7uWrqqB7

[Mahesh Balakrishnan @maheshb]

https://t.co/HB02f5xn6F

In Feb 2022, @ghaz and I wrote an internal proposal at Confluent arguing for a "cost-saving design (e.g., writing to S3 directly) that can eliminate cross-AZ traffic costs for high-rate elephant workloads". I was hoping to apply my research on Corfu and Delos on Kafka. This turned into a classical systems research project with Lucas and @garmanrnar (it felt like I was back at MSR SVC -- new types of futures! fast simulation testing! quorum protocols and atomic registers!). Luckily we anticipated an important industry trend around object storage; an immensely talented engineering team formed around the project; and today Confluent announced Freight clusters based on their hard work. Turns out systems research is important, who knew! Look forward to writing a paper about this some day, but for now it's back to building.

[zach @ztellman]

For the past few years, my younger brother has been designing a new kind of acoustic piano: smaller, lighter, quieter. He just gave his first talk about it; if you’re at all curious about the design space for stringed instruments, check it out: https://t.co/KbiV8xtWAv

[Lucas Bradstreet @ghaz.bsky.social @ghaz]

@apenwarr @lawrjones Snowflake also got to pick up S3 (battle tested, scalable, etc) and focus on the metadata side.

[kroxylicious @kroxylicious]

The kroxylicious project is pleased to release version 0.7.0 of our Junit5 Extension to simplify using Apache Kafka in tests

Release: https://t.co/RfMl163y75
Download: https://t.co/7kvJyEvNAI
#junit #apacheKafka

[Michael Drogalis @MichaelDrogalis]

🔥 It's finally here! I'm excited to announce that @ShadowTrafficIO is now available. Head to the home page to get started for free.

For my entire career, I've been baffled by how long it takes to build demos, load tests, and proof-of-concept projects. Everyone's built little internal data generator tools, but none of them are good.

ShadowTraffic is a tasteful, complete product that rapidly simulates production traffic to your backend—@apachekafka, @PostgreSQL, and webhooks.

Help me get the word out:
👨‍💻 Hacker News: I'm on the /newest page
🛠️ Product Hunt: I'm listed under Developer Tools
📰 Reshare this post

ShadowTraffic was built completely in public in just 90 days, 100% bootstrapped on my own dime.

Thank you *so* much for following along guys!