The Python Podcast.__init__

Digging Into Dagster: An Opinionated Open Source Framework For Data Orchestration


Listen Later

Data applications are complex and continually evolving, often requiring collaboration across multiple teams. In order to keep everyone on the same page a high level abstraction is needed to facilitate a cross-cutting view of the data orchestration across integration, transformation, analytics, and machine learning. Dagster is an innovative new framework that leans on the power and flexibility of Python to provide an extensible interface to the complete lifecycle of data projects. In this episode Nick Schrock explains how he designed the Dagster project to allow for integration with the entire data ecosystem while providing an opinionated structure for connecting the different stages of computation. He also discusses how he is working to grow an open ecosystem around the Dagster project, and his thoughts on building a sustainable business on top of it without compromising the integrity of the community. This was a great conversation about playing the long game when building a business while providing a valuable utility to a complex problem domain.
...more
View all episodesView all episodes
Download on the App Store

The Python Podcast.__init__By Tobias Macey

  • 4.4
  • 4.4
  • 4.4
  • 4.4
  • 4.4

4.4

100 ratings


More shows like The Python Podcast.__init__

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,020 Listeners

Odd Lots by Bloomberg

Odd Lots

1,940 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

289 Listeners

Data Skeptic by Kyle Polich

Data Skeptic

479 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

585 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

Python Bytes by Michael Kennedy and Brian Okken

Python Bytes

215 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

987 Listeners

DataFramed by DataCamp

DataFramed

269 Listeners

Practical AI by Practical AI LLC

Practical AI

210 Listeners

The Intelligence from The Economist by The Economist

The Intelligence from The Economist

2,554 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

142 Listeners

声动早咖啡 by 声动活泼

声动早咖啡

292 Listeners

The Foreign Affairs Interview by Foreign Affairs Magazine

The Foreign Affairs Interview

444 Listeners