Microsoft Fabric was released on May 2023 with many surprises, and I can’t wait to use all of its features. While the data and analytics industry had a million options in the market, Microsft believed that all these options still made the data engineering teams and the analytics/AI teams have difficulty utilizing the output produced… READ MORE
Why Real-Time Machine Data Matters? Imagine this: A critical production machine is running slightly hotter than usual. It’s still operational, but that extra heat could indicate bearing wear, misalignment, or lubrication issues. If left unchecked, the machine could fail, leading to unplanned downtime and expensive repairs. Now, what if you could see that warning sign… READ MORE
Companies are under increasing pressure to manage data loss prevention and utilize data aptly. Data governance and security are critical in assuring proper quality, compliance, as well as security of data, especially in multi-cloud and hybrid environments. Microsoft Purview (previously known as Azure Purview) and Fabric offer powerful capabilities that aim to achieve these objectives.… READ MORE
This weekend, I came up with an idea to speed up query execution when running DuckDB inside a Fabric Notebook—and it actually works! 🎉 You can download the notebook here Approach Why It Works This approach effectively creates a temporary, ad hoc disk cache in the notebook. The cache: Despite its simplicity, this method has proven to be highly effective… READ MORE
Are you overwhelmed by managing multiple tools for data analytics? With Microsoft Fabric, you no longer need to juggle between different products. It’s a complete, unified platform that covers all your data needs from start to finish, making analytics easy for everyone! 🔗 What Makes Microsoft Fabric Special? 1. All-in-One Solution: Whether you’re a small department… READ MORE
As a Data Engineer, you might spend most of your time with tools like Azure Data Factory, Databricks, or Spark. But behind every robust pipeline and transformation logic, Python often plays a silent but crucial role. In my real-world projects — from cleaning raw datasets in Azure Databricks to automating blob cleanup in ADLS —… READ MORE
Data moves fast, and businesses need to keep up. Whether it’s tracking retail inventory or monitoring financial transactions, staying ahead requires analytics that are both lightning-fast and nearly up to the moment. Enter Direct Lake Storage Mode in Microsoft Fabric—a revolutionary approach that delivers high-performance analytics. In this guide, we’ll explore what Direct Lake is,… READ MORE
Originally Published May 2025, on ARCweb.com by Colin Masson This is Blog Post 4 in our series on the Industrial Data Fabric. In our previous posts, we discussed the importance of data quality (Blog Post 1), identified the essential building blocks (Blog Post 2), and described the key emerging archetypes (Blog Post 3). In this… READ MORE
Hello! Welcome back to another weekly blog. This week, I have very much still been hyped on data visualisation! Continuing from my previous posts, you can see what I like about visualisation and why I believe measurement is key to management. I can count on one hand the main KPI’s (Key Performance Indicators) to track… and I did!… READ MORE
Note: The views expressed in this blog are my own and do not necessarily reflect the opinions or positions of my employer. The Current World of Digital Analytics In today’s world, packaged analytics tools like Google Analytics, Adobe Analytics and Tealium dominate the market and landscape. Packaged analytics tools are essentially “out-of-the-box” platforms where businesses… READ MORE
