Vanishing Gradients

Episode 11: Data Science: The Great Stagnation


Listen Later

Hugo speaks with Mark Saroufim, an Applied AI Engineer at Meta who works on PyTorch where his team’s main focus is making it as easy as possible for people to deploy PyTorch in production outside Meta.

Mark first came on our radar with an essay he wrote called Machine Learning: the Great Stagnation, which was concerned with the stagnation in machine learning in academic research and in which he stated

Machine learning researchers can now engage in risk-free, high-income, high-prestige work. They are today’s Medieval Catholic priests.

This is just the tip of the icebergs of Mark’s critical and often sociological eye and one of the reasons I was excited to speak with him.

In this conversation, we talk about the importance of open source software in modern data science and machine learning and how Mark thinks about making it as easy to use as possible. We also talk about risk assessments in considering whether to adopt open source or not, the supreme importance of good documentation, and what we can learn from the world of video game development when thinking about open source.

We then dive into the rise of the machine learning cult leader persona, in the context of examples such as Hugging Face and the community they’ve built. We discuss the role of marketing in open source tooling, along with for profit data science and ML tooling, how it can impact you as an end user, and how much of data science can be considered differing forms of live action role playing and simulation.

We also talk about developer marketing and content for data professionals and how we see some of the largest names in ML researchers being those that have gigantic Twitter followers, such as Andrei Karpathy. This is part of a broader trend in society about the skills that are required to capture significant mind share these days.

If that’s not enough, we jump into how machine learning ideally allows businesses to build sustainable and defensible moats, by which we mean the ability to maintain competitive advantages over competitors to retain market share.

In between this interview and its release, PyTorch joined the Linux Foundation, which is something we’ll need to get Mark back to discuss sometime.

Links

  • The Myth of Objective Tech Screens
  • Machine Learning: The Great Stagnation
  • Fear the Boom and Bust: Keynes vs. Hayek - The Original Economics Rap Battle!
  • History and the Security of Property by Nick Szabo
  • Mark on YouTube
  • Mark's Substack
  • Mark's Discord
  • ...more
    View all episodesView all episodes
    Download on the App Store

    Vanishing GradientsBy Hugo Bowne-Anderson

    • 5
    • 5
    • 5
    • 5
    • 5

    5

    11 ratings


    More shows like Vanishing Gradients

    View all
    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,032 Listeners

    Data Skeptic by Kyle Polich

    Data Skeptic

    480 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    441 Listeners

    Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

    Super Data Science: ML & AI Podcast with Jon Krohn

    298 Listeners

    NVIDIA AI Podcast by NVIDIA

    NVIDIA AI Podcast

    322 Listeners

    DataFramed by DataCamp

    DataFramed

    267 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    192 Listeners

    Google DeepMind: The Podcast by Hannah Fry

    Google DeepMind: The Podcast

    198 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    88 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    408 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    121 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    75 Listeners

    AI + a16z by a16z

    AI + a16z

    31 Listeners

    High Signal: Data Science | Career | AI by Delphina

    High Signal: Data Science | Career | AI

    4 Listeners

    OpenAI Podcast by OpenAI

    OpenAI Podcast

    28 Listeners