Contributor

Dagster with Nick Schrock

Listen Later

Eric Anderson (@ericmander) interviews Nick Schrock (@schrockn) about Dagster, the open-source data orchestrator for machine learning, analytics, and ETL. Nick is the founder and CEO of Elementl, and is well-known for creating the Project Infrastructure group at Facebook, which spawned GraphQL and React. On today’s episode of Contributor, Nick explains how he set out to fix an inefficiency he identified amongst the complexity of the data infrastructure domain.

In this episode we discuss:

  • Dagster’s place in the industry shift towards thinking of data as a software engineering discipline
  • Why Nick believes it’s time for the term “data cleaning” to be retired
  • The empowerment of Dagster’s instantaneous spin-up process and local development experience
  • How a partner integrated Dagster into workflow for ops workers on the warehouse floor
  • One user’s testimony that, “what dbt did for our SQL, Dagster did for our Python”

    • Links:

    • Dagster
    • Elementl
    • GraphQL
    • React
    • dbt
    • Snowflake
    • Apache Airflow

      • People mentioned:

      • Lee Byron (@leeb)
      • Dan Schafer (@dlschafer)
      • Abe Gong (@AbeGong)
        • ...more
        View all episodesView all episodes
        Download on the App Store
        ContributorBy Eric Anderson
        • 5
        • 5
        • 5
        • 5
        • 5

        5

        11 ratings

        More shows like Contributor

        View all
        Planet Money by NPR

        Planet Money

        30,680 Listeners

        The Daily by The New York Times

        The Daily

        112,277 Listeners

        This Week in AI by JJ Englert

        This Week in AI

        4 Listeners