@apurva1618@camuelg With OpenData Buffer you get a notification when your data is durable. That means, you have the option to track your progress and retry if necessary achieving at-least-once guarantee.
(1/4) A big trend in the Kafka world in the last few years has been dropping disks and moving to object storage, which has led to a big drop in prices.
But IMO the trend hasn't gone far enough. Most of the largest volume use cases of Kafka don't need a majority of its protocol.
Hello Apache Kafka 3.9.0!
- last release using ZooKeeper
- tiered storage is production-ready
Plus many more KIPs, improvements, and bug-fixes. For details, check out the release blog post: https://t.co/Yv7d1pDZvC
Thanks to 133 contributors and our RM @cmccabe314!
I am quite excited about the future of Kafka Streams. KIPs 892, 1035, and 1071, along with ongoing progress with the State Updater, will continue to make it easier to manage.
I am soon interviewing @apurva1618 from @responsive_apps and @YingjunWu from @RisingWaveLabs, on all things stream processing.
This is going to be an amazing episode. Feel free to ask any questions related to Stream processing and I will add the most interesting ones. Shoot!
Want to help us improve #KafkaStreams on @confluentcloud? Share your thoughts in this short survey (under 5 minutes): https://t.co/wpVPAyhQET
Thanks Daniel (Kafka Streams PM @confluentinc) for setting this up!
🚨New Video Alert!🚨
Giving back to #openSource can be intimidating. You may think your code needs to be perfect or your idea be fully fleshed out. But the ideal contributor might surprise you...
@gharris1727 offers insights from the perspective of the #apacheKafka project. 👇
New on the blog: Harnessing Interactive Queries V2 in #KafkaStreams ! Dive into our practical guide and discover the power of queries and state stores for real-time insights and scalable analytics. #ApacheKafka#DataStreaming https://t.co/zvsqN8rQaV
This is huge! — And I immediately see a long list of follow up KIPs to build on this in the years to come.
Kudos to @lucasbrut and @BrunoCadonna for putting this together!
BOOM Baby! Come watch @MatthiasJSax and I chat about sliding windows, sanitation trucks and sleep apnea masks! Remember to leave questions in the comments so we can answer them in future episodes!
In the last 3 months, these meetings have covered KIP-892 which dramatically improves availability with EOS in KStreams by not wiping state on an unclean shutdown, and KIP-924 which enables a pluggable task assignor.
Designs are discussed, progress is made, the community grows!
Our monthly "#KafkaStreams Fan Club Hangout" is getting more professional. We have an official agenda document now.
https://t.co/duvivfmVwX
Thanks @BleeGoldman for taking the lead!
Sounds interesting? Drop a DM to Sophie or myself, and we can add you to the event.