Apache XTable (Incubating)

Apache XTable is a cross-table interop of table formats Apache Hudi, Apache Iceberg, and Delta Lake. (prev OneTable)

[Apache XTable (Incubating) @apachextable]

@Onehousehq Great example of "community over code" efforts!

[Onehouse @Onehousehq]

New work on Generic Table APIs from Snowflake and Onehouse in Polaris uses XTable for non-iceberg tables. Running XTable via REST API =

POST
/v1/conversion/table/
{"source-format": "HUDI | DELTA"
...}

Decoupling catalog spec from formats future proofs innovations in storage

[Apache XTable (Incubating) @apachextable]

Apache XTable in Production! 🎉 Azure OneLake now virtualizes #ApacheIceberg tables as #DeltaLake for broad compatibility across Fabric.

This shows the robust capabilities of XTable in production at scale.

Blog: https://t.co/3i0Hz6a4xF

#dataengineering #lakehouse

[Kyle Weller @KyleJWeller]

Unity Catalog repo went public this morning. I had a talk scheduled in the afternoon on @apachextable. I was able to integrate my live demo across #ApacheHudi + #DeltaLake tables into #UnityCatalog in time for my talk. I used EMR Spark + DuckDB for read/write.

#dataaisummit

[Dipankar Mazumdar @Dipankartnt]

Off to #DataAISummit by @databricks 🙌🏻

Looking forward to meeting folks in person & tuning into some of the amazing sessions!

I will be talking about Lakehouse table formats (Apache Hudi, Apache Iceberg & Delta Lake) & most importantly interoperability with @apachextable

[Kyle Weller @KyleJWeller]

Delta Lake, Apache Iceberg, and Apache Hudi users on their way to the Data + AI Summit next week...

@DeltaLakeOSS @apachehudi @ApacheIceberg

#DAIS2024 #dataaisummit2024 #apacheiceberg #deltalake #apachehudi

[Apache XTable (Incubating) @apachextable]

Looking forward to the collaboration on interoperability across #ApacheIceberg #DeltaLake and #ApacheHudi

Check out the blog: https://t.co/BYXbzFzibW

[Delta Lake @DeltaLakeOSS]

Delta Lake Universal Format (UniForm) and @apachextable are actively collaborating to help organizations build architectures that are not constrained to any single ecosystem!

Learn how Uniform & Xtable are unifying the open table formats. 🔗
https://t.co/4NypVJ9KvG

#opensource

[Dipankar Mazumdar @Dipankartnt]

I presented about @apachextable & how it brings interoperability to lakehouse table formats at Dremio's Subsurface.

Check out the recording of the talk: https://t.co/YsRxCNuAuq

[Apache XTable (Incubating) @apachextable]

Excited to see @Microsoft and @SnowflakeDB leveraging #ApacheXtable to build a stronger partnership together w/ interop between #ApacheIceberg and #DeltaLake 🎉

❄️ Quote: "Fabric will be able to store data in Iceberg format in OneLake via Apache XTable translation in OneLake."

[Snowflake @Snowflake]

.@Microsoft 🤝 Apache Iceberg 🤝 Snowflake

We’re expanding our partnership to make interoperability more efficient and cost-effective between Snowflake and Fabric OneLake. This is made possible with Apache Iceberg support in OneLake.

[Dipankar Mazumdar @Dipankartnt]

Super excited to be back speaking at Databricks's @Data_AI_Summit for the 2nd consecutive time 🎉

This year we are going beyond table formats to talk about interoperability among @apachehudi, @DeltaLakeOSS & #ApacheIceberg with @apachextable.

Joined by the amazing @KyleJWeller!

[Dipankar Mazumdar @Dipankartnt]

Fun evening @LinkedIn HQ demoing @apachextable & open table formats.

Also amazing stuff from @JayChia5 on https://t.co/QPAc1gJaqe & @w_moustafa on ViewShift (dynamic data masking for data lakes)

[Dipankar Mazumdar @Dipankartnt]

Super excited to be speaking at @LinkedIn Big Data Meetup happening on 3rd May at HQ, Sunnyvale!

I will be talking about @apachextable & interoperability in open table formats such as Apache Hudi, Iceberg & Delta Lake in collab with Microsoft folks!

Join us on 3rd May.

[Dipankar Mazumdar @Dipankartnt]

[Blogged]: Interoperability between lakehouse table formats with Apache XTable.

Link: https://t.co/6wJuTvbG2F

[Dipankar Mazumdar @Dipankartnt]

Here is a sneak peak of something that I have been working on.

@dremio reads @apachehudi tables.

This is another example of "interoperability" with open lakehouse table formats.

[Apache XTable (Incubating) @apachextable]

Let Our Powers Combine!

[Kyle Weller @KyleJWeller]

At #DataCouncil last week I ran a live demo with #DeltaLake, #ApacheHudi, #ApacheIceberg showing how you can use all three table formats w/ @apachextable

My demo included: 🧵👇

[Apache XTable (Incubating) @apachextable]

@rahulj51 @criccomini @ApacheIceberg XTable reads/writes metadata to enable cross-table interoperability between formats. But it's not a project aiming to have general read/write client to the data. Check it out and share your feedback! https://t.co/oanABxNN8J

[Apache XTable (Incubating) @apachextable]

@rmoff Check out the blog covering the name change here: https://t.co/2Sg0QRgMSY

[Dipankar Mazumdar @Dipankartnt]

How to sync Apache XTable target tables with catalogs?

Once you translate an open table format using XTable, you might want to sync those tables with catalogs such as Hive Metastore, AWS Glue, Unity, etc.
🧵

[Dipankar Mazumdar @Dipankartnt]

OneTable is now Apache XTable (Incubating) 🎉

Table formats interoperability is a critical aspect for open lakehouse architectures.

If you are interested in solving some of the challenges within interoperability, join us!

GitHub: https://t.co/kJOZs6FVNb

[Apache XTable (Incubating) @apachextable]

Hello World 👋 OneTable has a new name and is now incubating in the Apache Software Foundation as Apache XTable™ (Incubating). The GH repo moved under Apache and more details are in this blog: https://t.co/2Sg0QRhkIw

#apacheiceberg #apachehudi #deltalake #datalakehouse