Chatting with @gwenshap on her podcast, about tiered storage for Apache Pinot and other interesting questions 🎙️🎤🍷
Thanks for having me Gwen, this was real fun 💃💃
New on SaaS Community: @nehapawar18 from @startreedata on the benefits of Tiered Storage for @ApachePinot. Which abstractions helped build it and how they made cost/latency tradeoffs. We also discussed her benchmarks and why they prototyped on the weekend. https://t.co/o3sRgtuQAE
Are you Looking forward to tonight’s #ApachePinot engineering meetup at @uber HQ ?
• Distributed tracing (Xin Gao & Chen Xu)
• Pauseless ingestion (Xiaotian Jiang)
• Tail-latency hardening (Praveen C)
All in one evening !
#ApachePinot#RealTimeAnalytics#Observability
New Paper Summary: "Exploiting Cloud Object Storage for High Performance Analytics" by @DominikDurner et al. Another great paper from TUM with a ton of really cool insights around Object Store performance characteristics.
Exciting News: @ApachePinot 1.0 is here! 🍷🚀🎉
What started 11 years ago as an internal project @LinkedIn has reached its 1.0 major release!
To celebrate, let’s introduce you to Pinot and past milestones in this thread 🧵
Release Blog: https://t.co/FG3hLEGRzY
I interviewed @ChinmaySoman from @startreedata about his paper on Uber's real-time data architecture and lessons that apply for slightly smaller companies.
It will be up at 8am PST tomorrow on https://t.co/vKi72OmWw0
Meanwhile, enjoy this funny incident:
Got asked how stream processing platforms (e.g. Apache Flink, Kafka Streams, Spark Structured Streaming) compare to streaming databases (e.g. RisingWave, Materialize, PranaDB). There's some overlap and similarities, but also differences. Here's some aspects which may help 1/10
Epic talk from @nehapawar18 and @ChinmaySoman at #rtasummit comparing ClickHouse, Druid, and Pinot. I didn't get pictures of all the key slides, but here are most of them. You'll want to watch the whole video when it comes out...
I think I was so stoked to meet @gwenshap in person, didn't realize I took the picture at a 45 degree angle 😅
So looking forward to your keynote tomorrow at the #RTASummit !
This post is fascinating on a couple levels.
It’s packed with info, not the usual marketing fluff.
They link to third parties for perf instead of running their own tests. Very smart and feels more trustworthy.
Well done @ChinmaySoman & @KishoreBytes.
https://t.co/m3k2fbJ2vn
Excited for our talk on comparing @ApachePinot , @druidio and @ClickHouseDB based on our recently published blog: https://t.co/epCvxS5k1R
Join @nehapawar18 and me as we unpack the lessons learned: https://t.co/RNu7iC5JMs (reach out for a promo code)
3/ And the intriguing usecases! From finTech, IOT, logistics all the way to signal processing, journalism, Michelin star guides.
This event really had submissions from the who's who of data.
Thanks @TheDanicaFine for making me a part of this e̶v̶a̶l̶u̶a̶t̶i̶o̶n̶ learning process!
💡@nehapawar18, Founding Engineer @startreedata, sharing the various ways you can configure and customize which portion of your #data resides locally as tightly-coupled and which moves to the #cloud, giving the best of both worlds: https://t.co/4RNCxJ4WOm
#QConLondon#Apache
Join us tomorrow at 9am PST to hear what @ApachePinot will be up to in 2023! 🗓️
We'll have a show-and-tell style meeting, where you'll get to hear from the contributors leading the awesome features 🍷🍷
https://t.co/CuCur2uU8z