Rob Meyer

All things data and APIs

[Rob Meyer @rdmeyersf]

I'm done with @avis after decades. A reservation I made in July for a vacation suddenly gets canceled days before after getting confirmed weekly up to 3 days ago. Why? They said I booked after they'd sold old ... in July!? I can't trust them anymore. Anyone else experience this?

[Estuary @EstuaryDev]

You can stream data from Estuary Flow into any system that can ingest data from Kafka. For example, you can combine our battle-hardened CDC connectors with Tinybird's user-facing analytics engine.

Check out the full guide here: https://t.co/CLIjkFVBHK

[Estuary @EstuaryDev]

Real-time analytics for @salesforce just got easy.
Stream data to @ClickHouseDB from Salesforce using Estuary Flow and never worry about your infra again.

https://t.co/GUOfgt0xC8

[bytewax @bytewax]

🚀 𝐄𝐱𝐜𝐢𝐭𝐢𝐧𝐠 𝐍𝐞𝐰𝐬! We’re thrilled to announce the official launch of 𝐁𝐲𝐭𝐞𝐰𝐚𝐱’𝐬 𝐢𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧 with @EstuaryDev Flow’s Dekaf!

With this integration, you can process 𝐫𝐞𝐚𝐥-𝐭𝐢𝐦𝐞 𝐬𝐭𝐫𝐞𝐚𝐦𝐬 from databases like @MongoDB into Bytewax for 𝐢𝐦𝐦𝐞𝐝𝐢𝐚𝐭𝐞 𝐚𝐧𝐚𝐥𝐲𝐬𝐢𝐬—all with 𝐬𝐮𝐛-𝟏𝟎𝟎𝐦𝐬 𝐥𝐚𝐭𝐞𝐧𝐜𝐲. Powered by Dekaf, Estuary Flow’s 𝐊𝐚𝐟𝐤𝐚-𝐀𝐏𝐈 𝐜𝐨𝐦𝐩𝐚𝐭𝐢𝐛𝐢𝐥𝐢𝐭𝐲 𝐥𝐚𝐲𝐞𝐫 lets you implement 𝐂𝐡𝐚𝐧𝐠𝐞 𝐃𝐚𝐭𝐚 𝐂𝐚𝐩𝐭𝐮𝐫𝐞 (𝐂𝐃𝐂) without complex Kafka infrastructure.

✨ 𝐖𝐡𝐚𝐭 𝐓𝐡𝐢𝐬 𝐈𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧 𝐁𝐫𝐢𝐧𝐠𝐬 𝐭𝐨 𝐎𝐮𝐫 𝐔𝐬𝐞𝐫𝐬:

· 𝐒𝐞𝐚𝐦𝐥𝐞𝐬𝐬 𝐝𝐚𝐭𝐚 𝐬𝐭𝐫𝐞𝐚𝐦𝐢𝐧𝐠: Connect to sources like MongoDB, PostgreSQL, and MySQL effortlessly for real-time insights.
· 𝐍𝐨-𝐜𝐨𝐝𝐞 𝐜𝐨𝐧𝐧𝐞𝐜𝐭𝐨𝐫𝐬: Estuary Flow’s pre-built connectors simplify setting up pipelines with minimal configuration.
· 𝐒𝐜𝐚𝐥𝐚𝐛𝐢𝐥𝐢𝐭𝐲: Bytewax’s Python framework efficiently handles real-time and batch workloads, ensuring accurate processing without duplication.
· 𝐒𝐢𝐦𝐩𝐥𝐢𝐟𝐢𝐞𝐝 𝐚𝐧𝐚𝐥𝐲𝐭𝐢𝐜𝐬: Estuary Flow provides secure and reliable data delivery, enabling quick and precise metric calculations as data flows in.

💡 𝐖𝐡𝐲 𝐈𝐭 𝐌𝐚𝐭𝐭𝐞𝐫𝐬:

This integration allows businesses to build 𝐞𝐧𝐝-𝐭𝐨-𝐞𝐧𝐝 𝐂𝐃𝐂 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞𝐬 more efficiently. Stream live booking data from MongoDB and use Bytewax to generate key metrics like bookings and revenue in minutes.

A big thanks to the @EstuaryDev team for their collaboration. We can’t wait to see what our users build with this integration! 💛

For more details, check out Daniel Palma's blog.

https://t.co/H0fA2YmrLB

[Materialize @MaterializeInc]

Is your data locked in Oracle and not keeping pace with modern demands?
Our new integration with Materialize and @EstuaryDev empowers teams to easily ingest data from Oracle and many other previously unavailable sources.
This makes it easier than ever to ingest fresh data into Materialize without taxing your primary database!

🔗 Dive into the details here: https://t.co/OehGd7FNqZ
#DataIntegration #DataStreaming #Oracle #Materialize #EstuaryFlow

[StarTree @startreedata]

Easily capture change data to build real-time analytics applications with StarTree + @EstuaryDev ✨

We're excited to share that developers using StarTree can seamlessly ingest data from Amazon DynamoDB and 150+ other data sources using Estuary Flow.

https://t.co/OM5PHbidiO

[Peter Corless 🇺🇲 🇮🇪 🇺🇦 @PeterCorless]

@EstuaryDev provides Change Data Capture (CDC) for many different databases, including Amazon's @dynamodb, @MongoDB, @PostgreSQL, @Oracle and more. Now you can integrate Estuary Flow directly with @startreedata for real-time analytics:

https://t.co/lbViOQvCtv

[Tinybird @tinybird]

Our friends @EstuaryDev just released Dekaf, a #Kafka protocol-compatible interface to Estuary Flow.

This is big news for Tinybird users.

With Dekaf, you can use Tinybird’s Kafka Connector to consume CDC streams from 100s of sources.

Check it out -> https://t.co/LCcMGZcvcl

[Tinybird @tinybird]

.@EstuaryDev has just launched Dekaf, and we're pretty excited about what it can do.

With Dekaf, Tinybird users can connect to any of Estuary's hundreds of sources using the Tinybird Kafka Connector.

More from us on this in a bit... :)

[Estuary @EstuaryDev]

You have the need to feed @ClickHouseDB with @salesforce data? With @EstuaryDev it only takes a few minutes to set up real-time streams. Stream 10GB/month for free on us.

https://t.co/GUOfgt0xC8

[Rob Meyer @rdmeyersf]

@EstuaryDev @ClickHouseDB @MaterializeInc @SingleStoreDB @startree @bytewax @tinybird Dekaf is definitely better for your data pipelines. Choose between 100% Dekaf or Kaf-Dekaf (streaming @apachekafka into Flow) to manage streaming into destinations.

[Estuary @EstuaryDev]

📷️ Got Dekaf? No caffeine, just pure power! 📷 We're thrilled to announce Dekaf – 100% Kafka consumer API compatible. Connect any destination from your own Kafka, without the headaches.

Partners @ClickHouseDB, @MaterializeInc, @SingleStoreDB, @Startree, @Bytewax, & @tinybird

[Estuary @EstuaryDev]

Watch @_DaniPalma_ get real-time CDC with Postgres up and running in 60 seconds!

Dani can't respond because he's in Brazil :-) But we'll let him know what you think!

https://t.co/c1qXhpSsXj

@EstuaryDev @PostgreSQL #changedatacapture #StreamingETL

[Adi Polak @AdiPolak]

@YOEL_B The team will continue maintaining Bento as a dependency of the product. Not to be confused with Benthos or others.

[Estuary @EstuaryDev]

Use @EstuaryDev to create a real-time Iceberg #datalake in minutes with the catalog REST API! Here's how to set it up for Amazon S3. The doc's behind the support so ask about other catalogs or cloud storage!

https://t.co/ryp4RbMWBj

#dataengineering #streamingETL @ApacheIceberg

[Estuary @EstuaryDev]

Someone asked to compare @stitch_data , @fivetran and @EstuaryDev . We’ll dive into that and more live! What are your burning questions about #advertisinganalytics #realtimeanalytics #ETL #BigQuery or #RedShift? Ask now and sign up for the podcast!

https://t.co/hgI2QzWi7c

[Estuary @EstuaryDev]

Check out the latest @DWildcatters Energy Bytes podcast! @BNeelon and @jakalfayan talk to @dyaffe about everything multi cloud, real-time #dataintegration and databases, @apachekafka compatibility, and much much more!

@EstuaryDev #DataEngineering
https://t.co/6GbkgmZ5YV

[Estuary @EstuaryDev]

Working on #customerfacinganalytics ? #Advertisinganalytics ? Any burning questions?
Ask two experts who’ve supported 1.5 million users! Ask now. Then join us for the podcast Sept 19 2 pm ET!
https://t.co/gq87xispf6

@EstuaryDev #realtimeanalytics #streamingETL #dataengineering

[Estuary @EstuaryDev]

💥 Pricing Update Alert! 💥

Starting Sept 1st, 2024, Estuary Flow's connector pricing drops for most users! Same great service, lower costs. Reach out if you’d like to leverage the new pricing 🚀

Check out our official announcement here: https://t.co/OA7Aofx6Kg

[Estuary @EstuaryDev]

#AISecurity is the ultimate nightmare for any CISO. Read the official @owasp top 10 for LLMs.

It’s like #CyberSecurity, #DataGovernance, and Shift Left on Steroids. It doesn't even cover hallucinations or data bias.
https://t.co/wrFCKhfmw6
#LLMSecurity @EstuaryDev #StreamingETL