The Dashboard Effect

A Case Study: Unifying Data Sources with Azure Data Lake and Serverless SQL


Listen Later

Brick and Caleb discuss Blue Margin's use of Azure Data Lake for unified data management. Using a recent client project as an example, Caleb explains how he integrated multiple data sources using serverless SQL to create a single data repository with a semantic model to enhance consistency across projects and reports. They also discuss the current performance benefits of using a serverless SQL and the Microsoft Fabric OneLake updates they're waiting on before transitioning from Azure Data Lake.

In this episode:

  • Introduction to Azure Data Lake: Caleb kicks off the discussion with an overview of Azure Data Lake, emphasizing its role in creating a unified data repository. The conversation highlights the significance of maintaining "one copy of your data" to eliminate redundancy and ensure consistency across various data analysis projects.
  • Client Case Study: Caleb walks through a recent project of creating an Azure Data Lake for a client. Learn about the challenges of integrating multiple data sources and how serverless SQL views simplify data modeling and reporting.
  • Serverless SQL Explained: Caleb outlines the benefits of serverless SQL, including its flexibility, cost-effectiveness, and how it caters to users familiar with SQL Server without the need for a traditional database setup.
  • Semantic Modeling for Unified Reporting: Understand the process of creating a semantic layer that merges data from disparate systems, enabling consolidated reporting across different business units without compromising data integrity.
  • Performance Insights: Caleb shares his experience with the performance of serverless SQL on Azure Data Lake, busting myths about query execution times and handling large datasets efficiently.
  • Looking Ahead: Brick and Caleb discuss the features they're waiting on within Microsoft's Fabric OneLake before transitioning from Azure Data Lake. 

Click here to watch this episode on our YouTube channel.

Blue Margin increases enterprise value for PE-backed, mid-market companies by serving as their fractional data team. We advise on, build, and manage data platforms. Our strategy, proven with over 300 companies to-date, expands multiples through data transformation, as presented in our book, The Dashboard Effect.

Subscribe here to get more episodes of The Dashboard Effect podcast on your favorite podcast app.

Visit Blue Margin's library of additional BI resources.

...more
View all episodesView all episodes
Download on the App Store

The Dashboard EffectBy Brick Thompson, Jon Thompson, Caleb Ochs, Landon Ochs

  • 5
  • 5
  • 5
  • 5
  • 5

5

9 ratings


More shows like The Dashboard Effect

View all
HBR IdeaCast by Harvard Business Review

HBR IdeaCast

253 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

285 Listeners

Data Skeptic by Kyle Polich

Data Skeptic

474 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

585 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

629 Listeners

SQL Data Partners Podcast by Carlos L Chacon

SQL Data Partners Podcast

26 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

297 Listeners

Python Bytes by Michael Kennedy and Brian Okken

Python Bytes

213 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

320 Listeners

DataFramed by DataCamp

DataFramed

268 Listeners

Practical AI by Practical AI LLC

Practical AI

196 Listeners

Me, Myself, and AI by MIT Sloan Management Review and Boston Consulting Group (BCG)

Me, Myself, and AI

99 Listeners

Explicit Measures Podcast by PowerBI.Tips

Explicit Measures Podcast

32 Listeners

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

143 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

179 Listeners