Vanishing Gradients

Episode 11: Data Science: The Great Stagnation


Listen Later

Hugo speaks with Mark Saroufim, an Applied AI Engineer at Meta who works on PyTorch where his team’s main focus is making it as easy as possible for people to deploy PyTorch in production outside Meta.
Mark first came on our radar with an essay he wrote called Machine Learning: the Great Stagnation (https://marksaroufim.substack.com/p/machine-learning-the-great-stagnation), which was concerned with the stagnation in machine learning in academic research and in which he stated
Machine learning researchers can now engage in risk-free, high-income, high-prestige work. They are today’s Medieval Catholic priests.
This is just the tip of the icebergs of Mark’s critical and often sociological eye and one of the reasons I was excited to speak with him.
In this conversation, we talk about the importance of open source software in modern data science and machine learning and how Mark thinks about making it as easy to use as possible. We also talk about risk assessments in considering whether to adopt open source or not, the supreme importance of good documentation, and what we can learn from the world of video game development when thinking about open source.
We then dive into the rise of the machine learning cult leader persona, in the context of examples such as Hugging Face and the community they’ve built. We discuss the role of marketing in open source tooling, along with for profit data science and ML tooling, how it can impact you as an end user, and how much of data science can be considered differing forms of live action role playing and simulation.
We also talk about developer marketing and content for data professionals and how we see some of the largest names in ML researchers being those that have gigantic Twitter followers, such as Andrei Karpathy. This is part of a broader trend in society about the skills that are required to capture significant mind share these days.
If that’s not enough, we jump into how machine learning ideally allows businesses to build sustainable and defensible moats, by which we mean the ability to maintain competitive advantages over competitors to retain market share.
In between this interview and its release, PyTorch joined the Linux Foundation, which is something we’ll need to get Mark back to discuss sometime.
Links
The Myth of Objective Tech Screens (https://marksaroufim.substack.com/p/the-myth-of-objective-tech-screens)
Machine Learning: The Great Stagnation (https://marksaroufim.substack.com/p/machine-learning-the-great-stagnation)
Fear the Boom and Bust: Keynes vs. Hayek - The Original Economics Rap Battle! (https://www.youtube.com/watch?v=d0nERTFo-Sk)
History and the Security of Property (https://archive.ph/dRXEK#selection-21.0-21.36) by Nick Szabo
Mark on YouTube (https://www.youtube.com/marksaroufim)
Mark's Substack (https://marksaroufim.substack.com/p/machine-learning-the-great-stagnation)
Mark's Discord (https://discord.com/invite/drmuTjWZrm)

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit hugobowne.substack.com
...more
View all episodesView all episodes
Download on the App Store

Vanishing GradientsBy Hugo Bowne-Anderson

  • 5
  • 5
  • 5
  • 5
  • 5

5

11 ratings


More shows like Vanishing Gradients

View all
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

537 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,319 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,090 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

Founders by David Senra

Founders

2,165 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,547 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

514 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

131 Listeners

AI + a16z by a16z

AI + a16z

35 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,425 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

21 Listeners

Training Data by Sequoia Capital

Training Data

40 Listeners

High Signal: Data Science | Career | AI by Delphina

High Signal: Data Science | Career | AI

19 Listeners

Cheeky Pint by Stripe

Cheeky Pint

45 Listeners