
Sign up to save your podcasts
Or


Mark Kromer and Abhishek Narain join Scott Hanselman to talk about two new capabilities in Azure Data Factory: Change Data Capture (CDC) and Managed Airflow. Change Data Capture in Azure Data Factory automatically detects data changes at the source without requiring complex designing or coding. Managed Airflow in Azure Data Factory is a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments on which you can operate end-to-end data pipelines at scale. Chapters 00:00 - Introduction 00:40 - Change Data Capture 01:17 - CDC demo 07:59 - Managed Airflow 09:06 - Managed Airflow demo 14:33 - Wrap-up Recommended resources Change data capture resource overview How to capture changed data from ADLS Gen2 to Azure SQL DB using a Change Data Capture (CDC) resource What is Azure Data Factory Managed Airflow? How does Azure Data Factory Managed Airflow work? Azure Data Factory Create a Pay-as-You-Go account (Azure) Create a free account (Azure) Connect Scott Hanselman | Twitter: @SHanselman Mark Kromer | Twitter: @KromerBigData Abhishek Narain | Twitter: @NarainAbhishek Azure Data Studio | Twitter: @AzDataFactory Azure SQL | Twitter: @AzureSQL Azure Friday | Twitter: @AzureFriday Azure | Twitter: @Azure
By Scott Hanselman4.7
3838 ratings
Mark Kromer and Abhishek Narain join Scott Hanselman to talk about two new capabilities in Azure Data Factory: Change Data Capture (CDC) and Managed Airflow. Change Data Capture in Azure Data Factory automatically detects data changes at the source without requiring complex designing or coding. Managed Airflow in Azure Data Factory is a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments on which you can operate end-to-end data pipelines at scale. Chapters 00:00 - Introduction 00:40 - Change Data Capture 01:17 - CDC demo 07:59 - Managed Airflow 09:06 - Managed Airflow demo 14:33 - Wrap-up Recommended resources Change data capture resource overview How to capture changed data from ADLS Gen2 to Azure SQL DB using a Change Data Capture (CDC) resource What is Azure Data Factory Managed Airflow? How does Azure Data Factory Managed Airflow work? Azure Data Factory Create a Pay-as-You-Go account (Azure) Create a free account (Azure) Connect Scott Hanselman | Twitter: @SHanselman Mark Kromer | Twitter: @KromerBigData Abhishek Narain | Twitter: @NarainAbhishek Azure Data Studio | Twitter: @AzDataFactory Azure SQL | Twitter: @AzureSQL Azure Friday | Twitter: @AzureFriday Azure | Twitter: @Azure

16,761 Listeners

272 Listeners

382 Listeners

289 Listeners

3,720 Listeners

623 Listeners

301 Listeners

988 Listeners

207 Listeners

244 Listeners

14 Listeners

10,278 Listeners

26 Listeners

637 Listeners

72 Listeners