Y Combinator Startup Podcast

Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI


Listen Later

Ever wonder what it actually takes to train a frontier AI model?YC General Partner Ankit Gupta sits down with Nick Joseph, Anthropic's Head of Pre-training, to explore the engineering challenges behind training Claude—from managing thousands of GPUs and debugging cursed bugs to balancing compute between pre-training and RL. We cover scaling laws, data strategies, team composition, and why the hardest problems in AI are often infrastructure problems, not ML problems.

...more
View all episodesView all episodes
Download on the App Store

Y Combinator Startup PodcastBy Y Combinator

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

213 ratings


More shows like Y Combinator Startup Podcast

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,294 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

532 Listeners

The Official SaaStr Podcast: SaaS | Founders | Investors by SaaStr

The Official SaaStr Podcast: SaaS | Founders | Investors

172 Listeners

Startups For the Rest of Us by Rob Walling

Startups For the Rest of Us

700 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,092 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,984 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

75 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

204 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

130 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

503 Listeners

AI + a16z by a16z

AI + a16z

34 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

22 Listeners

Training Data by Sequoia Capital

Training Data

39 Listeners

Uncapped with Jack Altman by Alt Capital

Uncapped with Jack Altman

39 Listeners

Cheeky Pint by Stripe

Cheeky Pint

43 Listeners