Building real-time trading dashboards on petabyte-scale data forces hard trade offs.
This post breaks down how we used @databricks Apps, Dash and Spark Structured Streaming to cut latency and scale live market insights as Spark continues to evolve.
https://t.co/8EhffsQELv
Sydney data engineers 👋
Special meetup with @VeloDB_IO — Thu 11 June, 5:30pm @ Stone & Chalk, Tech Central
Two talks on real-time analytics for AI systems + live demo
Free. Food provided. Great people.
RSVP 👇
DataEngBytes is going global 🌏 We've got attendees flying in from Indonesia, Singapore, Malaysia, Bangladesh — and all the way from Brazil.
If you need a letter of invitation for your visa application, email [email protected] and we'll sort you out.
#DataEngBytes#DataEng
Peter Flook's last recorded talk is now live.
Filmed at our Sydney Data Eng meetup on April 15 — days before he passed away.
"Data Contracts That Actually Work" — ODCS, breaking change detection, CI/CD, and why schemas alone aren't enough.
Devastated to share that Peter Flook passed away suddenly this weekend.
Open-source builder, ODCS TSC member, and one of the most genuine practitioners in the Sydney data engineering community.
He presented at our meetup last Tuesday.
We'll miss you, Peter. 💜
Welcoming @VeloDB_IO to DataEngBytes 2026 Sydney 🎉
Built by the original Apache Doris team — one engine for real-time analytics, search, observability, and AI workloads.
They'll be at Sydney (Jul 28–29). Come talk to the engineers who wrote the code.
🎟 https://t.co/tstqeej72I
Brisbane ✅ Auckland ✅
Talk recordings landing soon — but the best bit wasn't recorded: the Town Hall. No slides, no pitches, just real talk.
Melbourne + Sydney, we're bringing it to you too ��
Tickets + sponsorships still open → https://t.co/yKaWPmNnbc
https://t.co/6h3NadQCmo
Early bird tickets are closing at the end of March. If you'd like to save $100 off a full priced ticket, then book in yours today:
https://t.co/8qoEXxE6F4
@ApacheIceberg and Python don't have to be fragmented.
Tomorrow, March 20th, at @DataEngBytes Brisbane, @AMdatalakehouse will break down how PyIceberg, iceframe, and iceberg-cli fit together, so you know when to use what and how to build cleaner lakehouse workflows.
9:50am AEST: https://t.co/8zycmjk4eV
Or go deeper with his book, Architecting an Apache Iceberg Lakehouse (get 45% off with code 3merced26): https://t.co/ISxZ054rpl
Jimmy Fallon style: points to desk THE TIME IS NOW to grab your DataEngBytes tickets! Brisbane March 20th & Auckland March 26th – epic data eng talks await!
🎟️ https://t.co/2c848ouBCH
#DataEngBytes#DataEngineering
Excited to announce our Town Hall at the Brisbane Data Engineering conference will be led by Gargi Ahluwalia.
If you're looking for a reason to attend the conference, this is it - this may well be a career changing discussion for you. Get your ticket today. Don't miss out!
We're excited to have Alex Merced deliver Modern Python Tooling for Apache Iceberg at DataEngBytes Brisbane 2026 on March 20th.
If this sounds like an awesome talk, why not get yourself a ticket today to the conference - it's only $175 AUD.
The Native Lakehouse Is Here and Mimoune Djouallah is here to tell you all about it.
Catch Mimoune Djouallah at DataEngBytes Brisbane on Friday, 20th of March 2026. Tickets only $175 AUD.
#lakehouse#iceberg#duckdb#datafusion
Tickets are selling fast for DataEngBytes 2026 in Brisbane and Auckland. With both venues having hard limits on attendance, we are monitoring the ticket situation. Be sure not to miss out by booking yours now!