Deep Dive into Delta (Parquet) and OneLake: Unpacking the Storage Behind Microsoft Fabric

Microsoft Fabric is a lake-centric data analytics platform, focused around Microsoft OneLake. A core feature of Fabric is that data items, like data warehouses and lakehouses, store their data automatically in OneLake in Delta format.

For all users deploying Fabric content, it is important to understand this underlying technology that ties all services together. This session takes a deep dive into the core storage technologies: OneLake, Delta, and Parquet.

It will avoid complex jargon and not assume advanced coding skills.

The session will break down the mechanics of Delta tables and their integration with Parquet. It will explain how Delta enhances traditional columnar storage with features such as transaction support, schema evolution, and performance optimisation. We’ll look at how it makes debugging and time-travel possible.

It will also include practical examples, visual aids, and real-world examples to illustrate how these technologies are applied to enable you to make correct architectural decisions when deploying data solutions. These come from experience managing global data consulting teams and deploying large enterprise data platforms.

Attendees: 
This session is for professionals familiar with Microsoft Fabric but unfamiliar with the inner workings of the Delta or Parquet format.
It’s ideal for data engineers, data analysts, and IT staff looking to optimise storage and performance within Fabric. Understanding of Fabric items such as lakehouse and warehouses is required.

Key Takeaways:
– Understand what OneLake is and how it underpins Microsoft Fabric.
– Learn how Delta tables build on Parquet, their unique capabilities, and why they are vital for modern data solutions.
– Discover Delta’s key features, such as ACID compliance, data versioning, and performance enhancements.
– Gain a foundational understanding to confidently deploy Microsoft Fabric and its storage technologies.

 

Share this on...