Jean-Georges Perrin compares Apache Spark to an operating system for data management. He explains how it can be used to pull data from disparate data sources, process the data, feed it into Machine Learning algorithms and stream the data out to other data streaming services.    Coupon code: podmladventure20    Panel    Charles Wood    Guest    Jean-Georges Perrin    Sponsors    Next Level Mastermind    Picks    Charles- Talk to people you don’t agree with and try to understand their point of view.Charles- Eureka on Amazon PrimeCharles- The Expanse books and seriesAdvertising Inquiries: https://redcircle.com/brandsPrivacy & Opt-Out: https://redcircle.com/privacyBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

ML 018: Mastering Data Pipelines with Apache Spark with Jean-Georges Perrin

Machine Learning is growing in leaps and bounds both in capability and adoption. Listen to our experts discuss the ideas and fundamentals needed to succeed as a Machine Learning Engineer.Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Technology

Tech News

Podcasting

Gadgets

Software How-To

Education

Training

Language Courses

Higher Education

K-12

Educational Technology

Business

Investing

Careers

Management & Marketing

Business News

Shopping

How To

Lukas Geiger is a Deep Learning Scientist, open-source developer, and an astroparticle physicist. He shares his experience using machine learning to analyze cosmic ray particles and detect secondary particles. We explore the challenges and opportunities of open source as a business model, the potential of models for edge computing, and the importance of understanding open-source code. Join us as we delve into the intersection of physics, machine learning, and the intricate world of software development.SponsorsChuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs MembershipSocialsLinkedIn: Lukas GeigerBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Harnessing Open Source Contributions in Machine Learning and Quantization - ML 148

Nick Schrock is the Founder of Dagster Labs. He is also the Creator of Dagster and the Co-creator of GraphQL. They delve into the world of data engineering, software development, and ML orchestration. In today's episode, they explore the challenges and intricacies of standardizing data movement, handling data access in various systems, and migrating data across different platforms. They share insights on the importance of building a system that spans multiple data platforms, the decision-making process behind tool development, and the impact of lineage in managing and migrating data. Join them as they uncover the complexities of open-source projects, API evolution, and the future of data engineering.SponsorsChuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs MembershipSocialsLinkedIn: Nick SchrockBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Data Platform Innovation: Navigating Challenges and Building a Unified Experience - ML 147

Ben and Michael dive into the dynamic relationship between engineers and scientists in the realms of software engineering and physical science. They explore the differences and similarities between these roles, sharing valuable insights on the research and testing processes, the importance of thorough research, the value of teamwork, and the challenges of transitioning between engineering and science. With analogies, real-world examples, and expert perspectives, they shed light on the intricacies of these roles and the considerations for hiring scientists and engineers based on company size and market effects. Tune in for a thought-provoking discussion on finding the optimal path between efficiency and innovation in the world of technology and research!SponsorsChuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs MembershipBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

The Science-Engineering Blend - ML 146

Michael and Ben dive into the critical role of design in software development processes. They emphasize the value of clear and understandable code, the importance of thorough design for complex projects, and the need for comprehensive documentation and peer reviews. The conversation also delves into the challenges of handling complex code, the significance of prototype research, and the distinction between design decisions and implementation details. Through real-world examples, they illustrate the impact of rushed processes on project outcomes and the responsibility of tech leads in analyzing and deleting unused code. Join them as they explore how process and organizational culture contribute to successful outcomes in tech companies and why companies invest in skilled individuals who can work efficiently within established processes.SponsorsChuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs MembershipBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

The Impact of Process on Successful Tech Companies - ML 145

Michael and Ben share their insights on being called in to fix issues in production systems at the last minute. They stress the importance of asking questions to understand the context and navigate the political landscape, and caution against providing half-baked solutions. They also discuss the significance of understanding project goals, documenting decision-making processes, and providing guidance to the team to avoid building unnecessary and difficult-to-maintain systems. Stay tuned as they share their experiences and valuable advice for navigating complex projects and delivering meaningful solutions.SponsorsChuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs MembershipBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

ML 018: Mastering Data Pipelines with Apache Spark with Jean-Georges Perrin

Download our free app to listen on your phone