Vanishing Gradients

Episode 11: Data Science: The Great Stagnation


Listen Later

Hugo speaks with Mark Saroufim, an Applied AI Engineer at Meta who works on PyTorch where his team’s main focus is making it as easy as possible for people to deploy PyTorch in production outside Meta.

Mark first came on our radar with an essay he wrote called Machine Learning: the Great Stagnation, which was concerned with the stagnation in machine learning in academic research and in which he stated

Machine learning researchers can now engage in risk-free, high-income, high-prestige work. They are today’s Medieval Catholic priests.

This is just the tip of the icebergs of Mark’s critical and often sociological eye and one of the reasons I was excited to speak with him.

In this conversation, we talk about the importance of open source software in modern data science and machine learning and how Mark thinks about making it as easy to use as possible. We also talk about risk assessments in considering whether to adopt open source or not, the supreme importance of good documentation, and what we can learn from the world of video game development when thinking about open source.

We then dive into the rise of the machine learning cult leader persona, in the context of examples such as Hugging Face and the community they’ve built. We discuss the role of marketing in open source tooling, along with for profit data science and ML tooling, how it can impact you as an end user, and how much of data science can be considered differing forms of live action role playing and simulation.

We also talk about developer marketing and content for data professionals and how we see some of the largest names in ML researchers being those that have gigantic Twitter followers, such as Andrei Karpathy. This is part of a broader trend in society about the skills that are required to capture significant mind share these days.

If that’s not enough, we jump into how machine learning ideally allows businesses to build sustainable and defensible moats, by which we mean the ability to maintain competitive advantages over competitors to retain market share.

In between this interview and its release, PyTorch joined the Linux Foundation, which is something we’ll need to get Mark back to discuss sometime.

Links

  • The Myth of Objective Tech Screens
  • Machine Learning: The Great Stagnation
  • Fear the Boom and Bust: Keynes vs. Hayek - The Original Economics Rap Battle!
  • History and the Security of Property by Nick Szabo
  • Mark on YouTube
  • Mark's Substack
  • Mark's Discord
  • ...more
    View all episodesView all episodes
    Download on the App Store

    Vanishing GradientsBy Hugo Bowne-Anderson

    • 5
    • 5
    • 5
    • 5
    • 5

    5

    11 ratings


    More shows like Vanishing Gradients

    View all
    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,001 Listeners

    Data Skeptic by Kyle Polich

    Data Skeptic

    470 Listeners

    Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

    Super Data Science: ML & AI Podcast with Jon Krohn

    296 Listeners

    DataFramed by DataCamp

    DataFramed

    269 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    190 Listeners

    Last Week in AI by Skynet Today

    Last Week in AI

    281 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    88 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    354 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    125 Listeners

    This Day in AI Podcast by Michael Sharkey, Chris Sharkey

    This Day in AI Podcast

    190 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    63 Listeners

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

    424 Listeners

    The Next Wave - AI and The Future of Technology by Hubspot Media

    The Next Wave - AI and The Future of Technology

    57 Listeners

    Training Data by Sequoia Capital

    Training Data

    36 Listeners

    High Signal: Data Science | Career | AI by Delphina

    High Signal: Data Science | Career | AI

    4 Listeners