Recorded a fantastic episode with Ankit Sultana, PMC at @ApachePinot and SWE at Uber.
We discussed Pinot’s architecture, integration with Kafka, Replication, Segment structures, query engines and much more.
Good news: we also captured on excalidraw.
Stay tuned! Releasing next week.
Subscribe here and support deep technical systems discussions: https://t.co/hny8J6eqvl
Excited to share a key Grocery use-case we had onboarded to @ApachePinot. It powers internal and external user facing tools while handling 100k+ updates per second across billions of rows.
Outside of the usual analytics workload (aggregations, etc.), with the Lucene powered Text Index, we were also able to enable user-facing search use-cases.
Did you know there is an @ApachePinot 🍷 connector?
It takes about 5 minutes to connect to, then you can start building dashboards and exploring your data however you want.
https://t.co/oHcUKRqa59
10 more minutes to go !
GPT‑5 drops at 10 a.m. PST today - Stop of the world event !
Meanwhile, Pinot engineers are clinking glasses.
Exciting days for the Apache Pinot community !
@sama
One of the key highlights from the recent meetup was hearing the team from @porterit_ talk about their journey with @ApachePinot
I was so impressed with how they evaluated their options: they looked at all the different architectural patterns to find the right way to solve for real-time analytics.
In the end, they chose the winning combo: me + Kafka. You love to see it.
Huge kudos to them for sharing their insights with the community. The entire Apache Pinot community is wishing you the best as you evolve your platform to deliver an amazing experience for your users!
Do not forget ! We are getting together today @ @meeshotech@Meesho_Official HQ , 10:30 AM Saturday IST.
Cant wait to hear what folks have built using Apache Pinot.
There’s no better place to talk about scale than sitting inside Meesho’s office with folks from @Meesho_Official , @porterit_ , @AngelOne , and @startreedata all in the room, breaking down how they do real-time analytics with Apache Pinot.
If you care about speed, scale, and systems that hold up under load, this is where you want to be.
These are the folks who quietly keep petabyte-scale systems running, where every decision maps to real business impact.
🗓️ RSVP closes soon, don’t miss it.
https://t.co/omFdhuhZfm
@defNotArgs Built to keep your costs in check,
Fresh data, no old tape deck.
Flexible, fast, and open wide,
No black box secrets left to hide.
Pinot flows where others stall.
Yeah that’s me :)
There’s no better place to talk about scale than sitting inside Meesho’s office with folks from @Meesho_Official , @porterit_ , @AngelOne , and @startreedata all in the room, breaking down how they do real-time analytics with Apache Pinot.
If you care about speed, scale, and systems that hold up under load, this is where you want to be.
These are the folks who quietly keep petabyte-scale systems running, where every decision maps to real business impact.
🗓️ RSVP closes soon, don’t miss it.
https://t.co/omFdhuhZfm
Got a question about a specific PR or want to become a Apache Pinot committer ?
Join us for Apache Pinot Contributor Call #3 - Hosted by @xiangfu0 & Robert Zych
Agenda:
8:30 AM PT – Graceful Node Replacement
In cloud-native environments, infrastructure changes are constant. For a stateful, distributed system like Pinot, node replacement is a critical challenge.
Xin Gao will walk through the mechanisms that enable seamless, zero-downtime node replacement—covering recent contributions and production-grade automation strategies.
9:00 AM PT – Timeseries Engine GA: Features & Roadmap
Shaurya Chaturvedi will share progress toward General Availability for Pinot’s new Timeseries Engine. This includes:
A brand-new query builder UI in the Controller
A redesigned Broker-compatible API
Native support for standard authentication
Join the #pinot-contributor-calls channel on the Apache Pinot Slack to RSVP - https://t.co/MX9hUJMMP8
Cant wait to see you all there !
@kozlovski Data freshness SLA is critical for every organization, especially in the age of AI agents.
Data freshness is easy to promise at small scale.
But at high scale, with massive concurrency and strict Freshness SLAs? That’s where I thrive.
I’m not just real-time
I’m the real real-time.
How did LinkedIn use a sketch algorithm in Apache Pinot to achieve:
• an 88% reduction of data (1TB → 120GB) 🔥
• improve data freshness 50%?
• 5x lower p95 latency?
🧵 In this thread, you'll:
• learn how to compute audience intersection sizes
• see some good memes 😁
How did LinkedIn use a sketch algorithm in Apache Pinot to achieve:
• an 88% reduction of data (1TB → 120GB) 🔥
• improve data freshness 50%?
• 5x lower p95 latency?
🧵 In this thread, you'll:
• learn how to compute audience intersection sizes
• see some good memes 😁
@avoguru@apachekafka@Alluxio@uvallamsetty Life is real-time, my friend
Streams don’t wait, and queries must end.
From Kafka’s flow to Pinot’s pace,
We power each moment, frame by frame.
Open source has shown the way,
Connecting minds every day.
Across the world, we build and write
Real-time systems, in plain sight.
Very excited for another meetup tonight, the community is excited to talk about Iceberg, Tiered Storage, Real-time & obviously myself (Apache Pinot)
And I started the week by adding a brand new @metabase driver to my repo.
Monday blues
Click to query
Pinot on call
Metabase listens
Curiosity wins
Thank you for the contribution @xiangfu0
https://t.co/ffREdjhKRA
@inaveen1745@metabase@xiangfu0 This is a good start for you ? or too detailed ?
https://t.co/o76mVgoQzt
You can also post your questions here in my Slack community: https://t.co/p1noSUHgwI
Did you know?
You don’t have to read docs to understand me.
You can read my code , easily - on DeepWiki.
Just be careful: You might end up admiring my creators more than me.
Am an engineering marvel !
https://t.co/o76mVgoQzt
#apachepinot