๐ฆ Wildlife monitoring with @apachekafka!๐ As part of Confluent #Hackathon โ22, @SimonAubury built a project using a Raspberry Pi, camera, Kafka, & @KafkaConnect to identify animals and understand population trends over time. Read about his project ๐ https://t.co/Gjk4SPsMnV
"More importantly though, data streaming is about connectivity", well-written and insightful thread overall. Highlighting this quote because I'm a bit biased too ๐
1. Thoughtworks notes that "Kafka continues toward its status as a de facto standard." noting that Kubernetes, Kafka, and the CSPs are becoming stable layers in the next gen stack and churn around alternative platforms seems to have waned. https://t.co/ax39zAxBnz
Apache Kafka 3.0 is released! ๐
Another step closer to remove ZooKeeper dependency. And of course many other improvements, bug fixes, and new features.
Thanks to 141 contributors and our RM @karantasis!
For more details check out the release blog post: https://t.co/LWVsVewVrP
Confluent and @elastic are excited to work together to make it easier than ever to integrate @apachekafka and Elasticsearch with the fully managed Elasticsearch Sink Connector. Read more from Confluent CEO @jaykreps on our expanded partnership: https://t.co/dBxw8ClppL
@DanielOsvath wrote about his recent experience with Kerberos and this tutorial can save some of us a lot time during troubleshooting. Good security is an integral part of every decent data integration solution and lots of Kafka connectors support Kerberos authentication already.
Kerberos authentication is widely used in todayโs client/server applications; but getting started without experience can be a challenge! @DanielOsvath provides a simple setup for a Kerberos test environment with SSH in todayโs blog. Check it out: https://t.co/Nijtow5m7f
@criccomini Side-effect of autogenerated configs. `null` is mentioned in the source connector overrides but in the worker configs the default is correct https://t.co/kWdCwKNHF9
Created https://t.co/AfoGmf0dnG to fix
@criccomini I totally agree with you on that. It's a general default but with surprising side-effects. I've suggested documentation notes/additions at a minimum and we should reconsider it as a default, indeed.
@criccomini The converter might be crashing or spending too much time on non-UTF encodings. I've noticed abnormalities with other (less popular) encodings in strings.
@criccomini My benchmarks have revealed that ByteArrayConverter is 4x-5x faster and StringConverter 2x-3x (with lower CPU), so if you can use these ๐. But if none of these converters fits your needs maybe a custom implementation (this class is configurable) could offer peace of mind.
@criccomini SimpleHeaderConverter is meant to be general, but as its name reveals it's also simple. In high volume it's general approach of inferring types comes with a higher CPU cost.
@apachekafka I'm thrilled. Thank you all! It's an honor and a great responsibility. I'm really looking forward to serving the Apache Kafka community and its innovative technology on this new role!
Join us tomorrow for a technical deep dive on Kafkaโs load balancing feature. Weโll discuss the proposition of Incremental Cooperative Rebalancing as a way to alleviate stop-the-world and optimize rebalancing in Kafka APIs. Register here: https://t.co/6Gi8RGD0hv
@ewencp @sderosiaux@sderosiaux we are having an online talk on the subject again tomorrow. Feel free to join and ask questions if you have time: https://t.co/fou59t98QE
Parquet support for @confluentinc S3 sink connector got merged. Highly anticipated, it was accomplished in one of my favorite ways: as a top quality community contribution! Thanks Tony Wei and Ryan Eakman! Available from source on github now, will ship with Confluent Platform 5.4