Data Eng & Infrastructure

Open Data Foundations across Hudi, Iceberg and Delta

When your data is at rest, Hudi, Delta and Iceberg are not so different yet it is increasingly hard to decide which table format to pick for your data platform. OneTable, a brand new open source project unlocks omni-directional interoperability between the popular lakehouse projects Apache Hudi, Delta Lake, and Apache Iceberg. Onetable offers lightweight conversion mechanisms that can take a source metadata format and sync it into one or more target metadata formats. This session will feature a live demo and describe real-world applications of how to build open data foundations that can accelerate your workloads into a variety of open source query engines including Spark, Presto, Trino, Flink and more. We will describe the technical foundations for Hudi, Delta and Iceberg and lay out the nuts and bolts of how Onetable seamlessly converts data between these formats. We will detail our journey to create the project, share the vision for the future and show how you can join this new open community.