The Dashboard Effect

A Case Study: Unifying Data Sources with Azure Data Lake and Serverless SQL


Listen Later

Brick and Caleb discuss Blue Margin's use of Azure Data Lake for unified data management. Using a recent client project as an example, Caleb explains how he integrated multiple data sources using serverless SQL to create a single data repository with a semantic model to enhance consistency across projects and reports. They also discuss the current performance benefits of using a serverless SQL and the Microsoft Fabric OneLake updates they're waiting on before transitioning from Azure Data Lake.

In this episode:

  • Introduction to Azure Data Lake: Caleb kicks off the discussion with an overview of Azure Data Lake, emphasizing its role in creating a unified data repository. The conversation highlights the significance of maintaining "one copy of your data" to eliminate redundancy and ensure consistency across various data analysis projects.
  • Client Case Study: Caleb walks through a recent project of creating an Azure Data Lake for a client. Learn about the challenges of integrating multiple data sources and how serverless SQL views simplify data modeling and reporting.
  • Serverless SQL Explained: Caleb outlines the benefits of serverless SQL, including its flexibility, cost-effectiveness, and how it caters to users familiar with SQL Server without the need for a traditional database setup.
  • Semantic Modeling for Unified Reporting: Understand the process of creating a semantic layer that merges data from disparate systems, enabling consolidated reporting across different business units without compromising data integrity.
  • Performance Insights: Caleb shares his experience with the performance of serverless SQL on Azure Data Lake, busting myths about query execution times and handling large datasets efficiently.
  • Looking Ahead: Brick and Caleb discuss the features they're waiting on within Microsoft's Fabric OneLake before transitioning from Azure Data Lake. 

Click here to watch this episode on our YouTube channel.

Blue Margin increases enterprise value for PE-backed, mid-market companies by serving as their fractional data team. We advise on, build, and manage data platforms. Our strategy, proven with over 300 companies to-date, expands multiples through data transformation, as presented in our book, The Dashboard Effect.

Subscribe here to get more episodes of The Dashboard Effect podcast on your favorite podcast app.

Visit Blue Margin's library of additional BI resources.

...more
View all episodesView all episodes
Download on the App Store

The Dashboard EffectBy Brick Thompson, Jon Thompson, Caleb Ochs, Landon Ochs

  • 5
  • 5
  • 5
  • 5
  • 5

5

9 ratings


More shows like The Dashboard Effect

View all
Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,576 Listeners

HBR IdeaCast by Harvard Business Review

HBR IdeaCast

1,830 Listeners

Science Vs by Spotify Studios

Science Vs

12,181 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

301 Listeners

Front Row Seat with Ken Coleman by Ramsey Network

Front Row Seat with Ken Coleman

2,594 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Cost of Living by CBC

Cost of Living

28 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

141 Listeners

SmartLess by Jason Bateman, Sean Hayes, Will Arnett

SmartLess

58,263 Listeners

Raw Data with Rob Collie by P3 Adaptive

Raw Data with Rob Collie

52 Listeners

My Unsung Hero by Hidden Brain

My Unsung Hero

1,176 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

557 Listeners