🏎️ SQLMesh now supports @ClickHouse, bringing precise, error-free data transformation to one of the world’s fastest analytical databases.
Build, test & deploy with zero disruption + real-time analytics at unmatched scale. Read more about our integration: https://t.co/Dhc02dW1S9
dlt-SQLMesh generator: A case of metadata handover
With this integration, incremental models can be automatically generated in SQLMesh based on dlt metadata
https://t.co/DE0tnElPJh
Tired of messy data pipelines? 🥹🫣
Check out the @SQLMesh + @dltHub integration for seamless metadata handovers, faster scaffolding, and incremental processing. 💻
Simplify your data workflows! 🔗
https://t.co/F1B1qSTRlp
#DataEngineering#DataPipelines
Featuring SQLMesh on this week's episode of Open-Source Spotlight, our series where we're discovering open-source tools.
@TobikoData's Toby Mao, @Captaintobs, joined us in demonstrating how this tool can help data team workflows.
Watch the demo here: https://t.co/3hRx56uZgT
Join @Captaintobs and @Al_Grigor from @DataTalksClub on their Open-Source Spotlight series, where they talk through the benefits of @SQLMesh like:
♦ Column-level lineage
♦ Environment Management
♦ Instant Prod deployments
and much more!
https://t.co/SvUDjvygel
Want to learn about running your #dbt project with @SQLMesh?
Check out our latest YouTube video to run through a workflow using the classic Jaffle Shop example project!
https://t.co/JIZ2sGywn4
📷Calling all #AI and #ML developers: #DataCloudDevDay is coming June 6 to San Francisco!
@Captaintobs, @TysonMao and Afzal Jasani are featured attendees at the Data Engineering, Startups, and Open Source meetups – RSVP for free to hang out with us 📷https://t.co/TksdCqpcIZ
Some exciting new features just dropped for @SQLMesh v0.100!
Snowpark's DataFrame api is now available to use in Python models! Now you can leverage the power of Python and Snowpark to run advanced transformations that run directly on Snowflake! Python models are super easy to write and debug with SQLMesh because they run wherever you run SQLMesh. The driver code runs on your laptop while the distributed code (dataframe api) runs in the warehouse. It's the best of both worlds!
Another really cool feature we've added is the new Incremental by Partition model kind / materialization. These are special models that will incrementally replace partitions while keeping existing partitions intact. For example, if you have a dataset that is partitioned by country, and every day, you want to only refresh a set of countries.
https://t.co/ivwKGpV4FJ
https://t.co/BeulB7AKOt