Ahmet Altay

Software Engineer @googlecloud Dataflow | PMC Member @ApacheBeam | Member @TheASF | Formerly at Microsoft, Stanford | 💛 BigData, open spaces, minimalism, scifi

[Ahmet Altay @iridium77]

We are wrapping up the #BeamSummit with the 3rd #RAG talk today (I guess it is a popular thing😉) and CI/CD & cost optimizations for #Dataflow.

Lots of insights on running @ApacheBeam and #Dataflow was shared. If you missed it, all talks will be on YouTube in a few weeks.

[Ahmet Altay @iridium77]

@janl_apache @ml6team @ApacheBeam I "shorten" things to reduce into a tweet format but otherwise the talk addressed the why. All talk videos will be available on YouTube in a few weeks.

[Ahmet Altay @iridium77]

Quote from @ml6team at the #BeamSummit "@ApacheBeam is super useful, good for ML, super flexible, a prime candidate for building these things". These = {RAG, multi-modal, embedding, vector DBS}

[Ahmet Altay @iridium77]

Simultaneously at the #BeamSummit Namita Sharma and Pablo Rodriguez Defino are showing a ready to use RAG architecture complete with a GitHub repo.
https://t.co/kLRQeZTbrM

[Ahmet Altay @iridium77]

Processing 6 million events per minute

[Ahmet Altay @iridium77]

"How @ApacheBeam has helped us significantly to build our realtime forecasting platform at @lyfteng" -- Ravi Magham at the #BeamSummit

[Ahmet Altay @iridium77]

Why Beam? Data scientists at Lyft prefer Beam python over Flink python API.

[Ahmet Altay @iridium77]

From the speakers: "Beam YAML made our life a lot easier!" 🤗

[Ahmet Altay @iridium77]

@cadetiloye from @mavencode shared how BeamStack (built in top of Beam YAML) could be quickly deployed on any public cloud or on prem and makes LLM, embedding, vector DB workloads easy and observable. #BeamSummit

[Ahmet Altay @iridium77]

Nate Salawe followed up with a live demo, showing the deployment happening in less than 2 minutes! ⚡

[Ahmet Altay @iridium77]

Debugging #Dataflow and @ApacheBeam ML? Easy. Rajkumar Gupta is covering the common issues at #BeamSummit.

[Ahmet Altay @iridium77]

#BeamSummit is starting the second day with Uday Kalra's keynote on how Google DeepMind is using @ApacheBeam for large scale & accelerated ML inference.

[Apache Beam @ApacheBeam]

💫 Beam Summit is wrapping up! Keep learning and networking throughout the day, and take advantage of all the opportunities that this event is bringing up to you. #ApacheBeam

[Talat UYARER @talatuyarer]

Day 1 of #BeamSummit 2024 sounds incredible! Loved hearing about all the innovation in AI and data platforms, especially the cool use cases from @Cruise, @Uber, and Project Shield. Excited to see where #BeamML goes next! Can’t wait for more tomorrow! #BeamSummit2024 #Innovation @ApacheBeam

[Ahmet Altay @iridium77]

Lydian Lee from @Affirm wrapped up the first day of #BeamSunmit with how they built a robust internal platform using @ApacheBeam .

See you all at the networking hour today and tomorrow at the day 2 of the summit!

[Ahmet Altay @iridium77]

Olu Akinlaja from @doitint long time @ApacheBeam and #Dataflow is talking about using dynamic destinations with cloud #pubsub at the #BeamSummit.

[Ahmet Altay @iridium77]

ML experts from @ml6team showing multi-modal LLM use cases with real-world examples using @ApacheBeam at the #BeamSummit.

[Ahmet Altay @iridium77]

We are continuing the #BeamSummit in the afternoon with how @ApacheBeam efficiently serves large ML models & how this is all made easy to use with YAML and #Dataflow job builder (UI only streaming ML and analytics)

[Ahmet Altay @iridium77]

"We migrated ~5 TB (~2 billion rows) of production NoSQL DB to a Postgres DB without application downtime."

@ApacheBeam is used at Recursion (a Biotech company) to continue operations and drug discovery pipeline with ease and without interruption.

#BeamSummit

[Ahmet Altay @iridium77]

We are welcoming @UberEng for the first time at the @ApacheBeam #BeamSummit covering the Michelangelo platforms batch prediction capabilities!

[Ahmet Altay @iridium77]

"@ApacheBeam reduced our costs by 90%"

[Ahmet Altay @iridium77]

#BeamSummit continues with a keynote from Marc Howard on how Project Shield defends journalists, civil organizations, human rights organizations at most critical times powered by @ApacheBeam.