The Next Evolution of Delta Lake: Catalog-Managed Tables 🚀
We are excited to share that 𝗗𝗲𝗹𝘁𝗮 𝗟𝗮𝗸𝗲 𝟰.𝟭.𝟬 introduces 𝗰𝗮𝘁𝗮𝗹𝗼𝗴-𝗺𝗮𝗻𝗮𝗴𝗲𝗱 𝘁𝗮𝗯𝗹𝗲𝘀, which establish the catalog as the coordinator of table access and source of truth for table state! This evolution simplifies discovery and governance while unlocking significant performance gains.
🔹 𝗦𝘁𝗮𝗻𝗱𝗮𝗿𝗱𝗶𝘇𝗲𝗱 𝘁𝗮𝗯𝗹𝗲 𝗱𝗶𝘀𝗰𝗼𝘃𝗲𝗿𝘆 𝗮𝗻𝗱 𝘂𝗻𝗶𝗳𝗶𝗲𝗱 𝗴𝗼𝘃𝗲𝗿𝗻𝗮𝗻𝗰𝗲: The catalog facilitates access through logical table identifiers and grants clients appropriate permissions to data, dramatically simplifying how engines discover and use tables in a governed manner.
🔹 𝗘𝗻𝗳𝗼𝗿𝗰𝗲𝗮𝗯𝗹𝗲 𝗰𝗼𝗻𝘀𝘁𝗿𝗮𝗶𝗻𝘁𝘀: The catalog can authoritatively validate or reject schema and constraint changes, preventing incompatible updates that could compromise data integrity or break downstream workloads.
🔹 𝗢𝗽𝗲𝗻 𝗳𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻: This design aligns Delta with the catalog-managed model pioneered by Apache Iceberg, making it simpler for practitioners to discover and govern data consistently regardless of format.
Check out the blog to learn more 👉 https://t.co/anadAMh9nj
#deltalake #catalogs #unitycatalog #opensource #oss
📣 Engineering Dynamic Lineage: Column-level lineage using @OpenLineage, @ApacheSpark , and Delta Lake
Traditional static lineage tools fail to track real-time data flow in complex enterprise environments. Join us as we explore 𝗱𝘆𝗻𝗮𝗺𝗶𝗰, 𝗱𝗲𝘁𝗲𝗿𝗺𝗶𝗻𝗶𝘀𝘁𝗶𝗰 𝗹𝗶𝗻𝗲𝗮𝗴𝗲 ��𝘀 𝘁𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆—treating query execution as parseable events that reveal current data state.
𝗪𝗲'𝗹𝗹 𝗰𝗼𝘃𝗲𝗿:
🔹 Dynamic, deterministic lineage vs. static maps
🔹 OpenLineage as the open source alternative to proprietary solutions
🔹 Stitching flows across 1000s of jobs via Spark listeners
🔹 Integrating lineage alongside tables in the Lakehouse
🔗 Register: https://t.co/9WnbYbC2Ra
🗓️ Feb 24 | 9AM PT
📺 Live on LinkedIn, YouTube & X
#opensource #oss #deltalake #telemetry #openlineage #apachespark
#OneLake interoperability with @Snowflake is now GA. Built on open standards like Apache Iceberg, this offers less duplication and more flexibility across #MicrosoftFabric + Snowflake.
I also sat down with Christian Kleinerman, EVP Product, Snowflake to talk through what this enables and where the industry is headed.
🔗Check out our blog and video: https://t.co/6sGvEXKzfA
Loved joining @KratosBi on his podcast.
Unified data is not optional for AI. Trusted semantics turn insight into action. Platforms must reduce friction so teams can move faster with confidence. #MicrosoftFabric#OneLake#PowerBI
https://t.co/VPfrqCQrUy
AI success starts with data—but building reliable pipelines shouldn't feel like rocket science. 🚀
It is time to cut through the complexity. Join Andrew Sitz to learn how to build production-grade pipelines using the first principles of software and data engineering.
Discover how to bridge the gap between traditional SQL thinking and modern Delta Lake and PySpark patterns. 🙌 Walk away with a clear framework for writing cleaner, more maintainable pipelines.
🕓 9AM PT
🗓️ February 11
🔗 RSVP: https://t.co/cmlooesHI8
#opensource #deltalake #oss #ai
Unify your graph and lakehouse worlds in one stack. 🙌✅
🗓️ January 21
🕓 9:00AM PT
🔗 RSVP: https://t.co/osg8HMJIjb
See how Delta Lake + @puppyquery let you run Cypher and Gremlin queries, multi-hop analytics, and graph visualizations directly on your existing tables—without moving data off your lakehouse or maintaining duplicate systems.
From attack-path analysis in security to transaction flows in finance and complex supply chains, learn how relationship-native analytics can unlock insights your standard SQL queries miss.
#opensource #oss #deltalake #puppygraph #openlakehouse #lakehouse
🚨 STOP moving & duplicating data for graph analytics!
Graph workloads (security, finance, supply chain) often require a separate graph DB, leading to constant data movement & pipeline headaches. 🤯
What if you could run powerful, relationship-driven analytics directly on your Delta Lake data? 🤔
Introducing the 𝗚𝗿𝗮𝗽𝗵 𝗟𝗮𝗸𝗲𝗵𝗼𝘂𝘀𝗲, built with Delta Lake and @puppyquery.
In this webinar, we'll demonstrate:
🔹 Querying Delta Lake tables as graphs.
🔹 Performing complex multi-hop analytics using Cypher and Gremlin.
🔹 Visualizing your tabular data as interconnected graph structures.
🗓️ January 21, 2026
⏰ 9:00 AM PT
➡️ Register: https://t.co/osg8HMJIjb
#puppygraph #deltalake #opensource #oss #lakehouse
🎉 It’s been one year since the release of 𝗗𝗲𝗹𝘁𝗮 𝗟𝗮𝗸𝗲: 𝗧𝗵𝗲 𝗗𝗲𝗳���𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲, and we’re throwing a virtual party to celebrate the milestone!
🔗 Register: https://t.co/bniDLCx7ZP
�� 𝗖𝗲𝗹𝗲𝗯𝗿𝗮𝘁𝗲 𝘁𝗵𝗲 𝗗𝗲𝗳𝗶𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲: Let's toast to a year of community growth and adoption.
🔹 𝗔𝘀𝗸 𝗨𝘀 𝗔𝗻𝘆𝘁𝗵𝗶𝗻𝗴 (𝗔𝗨𝗔): Whether you're a beginner or an advanced user, bring your toughest Delta Lake questions!
🔹 𝗦𝘄𝗮𝗴 𝗔𝗹𝗲𝗿𝘁: We'll be giving away exclusive Delta Lake swag!
📅 December 17
⏰ 9:00AM PT / 12:00PM ET
#deltalake #opensource #oss #lakehouse @dennylee @newfront
✨Pinpoint Outliers in Power BI
Show exactly where your data goes above or below target - with native visuals only.
Step 1: Build your base line chart
Add Value and Target measures.
Step 2: Add visual calculations for markers
Create two: one for values above target, one for below. These will show the deviation points.
Step 3: Add labels and style
Label the two marker series (Above / Below target). Hide markers on the main line and make outlier markers larger.
Step 4: Connect to target
Use error bars to draw a subtle line from each outlier to its target value.
#powerbi #outliers #visualization #report #design
Want to design outstanding reports?
Join my next Power BI Transformation Program