Top 5 Kafka use cases
Kafka was originally built for massive log processing. It retains messages until expiration and lets consumers pull messages at their own pace.
Let’s review the popular Kafka use cases.
- Log processing and analysis
- Data streaming in recommendations
- System monitoring and alerting
- CDC (Change data capture)
- System migration
Over to you: Do you have any other Kafka use cases to share?
--
Subscribe to our weekly newsletter to get a Free System Design PDF (158 pages): https://t.co/uc5M7CdXXC
How do companies ship code to production?
The following describes a typical software delivery workflow. Companies have diverse environments using different tools. This is one representative workflow that demonstrates some common practices. Details will differ across organizations. With that context established, the general steps are as follows:
Step 1: The product owner creates requirements and stories.
Step 2: The development team prioritizes stories and organizes sprints.
Step 3: Developers commit code to the version control system.
Step 4: An automation server builds the code and runs tests. Code coverage and quality checks are performed.
Step 5: If the build succeeds, artifacts are stored in the artifact repository. The build is deployed to the developer environment.
Step 6: Features are tested independently in multiple isolated environments.
Step 7: The QA team tests the features in QA environments. Various forms of testing are performed.
Step 8: Once verified, the build is deployed to a user acceptance testing environment for final validation.
Step 9: Release candidates that pass testing can be deployed to production based on the release schedule. Feature flags and incremental rollout techniques manage risk.
Step 10: The site reliability team monitors production and reports issues. Teams prioritize and fix issues according to defined policies.
How does your organization's software delivery workflow differ from the process outlined here? What tools and techniques have you found most effective? I'm interested to hear about the various approaches across the industry.
–
Subscribe to our weekly newsletter to get a Free System Design PDF (158 pages): https://t.co/kNfv0DVDdf
Airbnb has a blueprint of their entire customer journey on their office walls.
They then map all product, policy, and service updates to it.
More companies should do this to avoid shipping the org chart.
@SNY_Mets@Mets@StevenACohen2#mets
Please let Lindor lead off next year.
Lindor
Nimmo
Alonso
We need to see some first inning action at Citi this year!!
@StevenACohen2 the lineup is all wrong. These kids can play!
1.surprise lindor
2.wearemdown canha
3.pop alonso
4.workem nimmo
5.ribby alvarez
6.solid McNeil marte pham guillermo navarez
7.sameasabove
8.sames
9.youthsurprise baty