Adventures in Machine Learning

Data Platform Innovation: Navigating Challenges and Building a Unified Experience - ML 147

04.11.2024 - By Charles M WoodPlay

Download our free app to listen on your phone

Download on the App StoreGet it on Google Play

Nick Schrock is the Founder of Dagster Labs. He is also the Creator of Dagster and the Co-creator of GraphQL. They delve into the world of data engineering, software development, and ML orchestration. In today's episode, they explore the challenges and intricacies of standardizing data movement, handling data access in various systems, and migrating data across different platforms. They share insights on the importance of building a system that spans multiple data platforms, the decision-making process behind tool development, and the impact of lineage in managing and migrating data. Join them as they uncover the complexities of open-source projects, API evolution, and the future of data engineering.SponsorsChuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs MembershipSocialsLinkedIn: Nick SchrockBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

More episodes from Adventures in Machine Learning