Latent Space: The AI Engineer Podcast

Greg Brockman on OpenAI's Road to AGI


Listen Later

Greg Brockman, co-founder and president of OpenAI, joins us to talk about GPT-5 and GPT-OSS, the future of software engineering, why reinforcement learning is still scaling, and how OpenAI is planning to get to AGI.

Full Video Episode

Timestamps

00:00 Introductions01:04 The Evolution of Reasoning at OpenAI04:01 Online vs Offline Learning in Language Models06:44 Sample Efficiency and Human Curation in Reinforcement Learning08:16 Scaling Compute and Supercritical Learning13:21 Wall clock time limitations in RL and real-world interactions16:34 Experience with ARC Institute and DNA neural networks19:33 Defining the GPT-5 Era22:46 Evaluating Model Intelligence and Task Difficulty25:06 Practical Advice for Developers Using GPT-531:48 Model Specs37:21 Challenges in RL Preferences (e.g., try/catch)39:13 Model Routing and Hybrid Architectures in GPT-543:58 GPT-5 pricing and compute efficiency improvements46:04 Self-Improving Coding Agents and Tool Usage49:11 On-Device Models and Local vs Remote Agent Systems51:34 Engineering at OpenAI and Leveraging LLMs54:16 Structuring Codebases and Teams for AI Optimization55:27 The Value of Engineers in the Age of AGI58:42 Current state of AI research and lab diversity01:01:11 OpenAI’s Prioritization and Focus Areas01:03:05 Advice for Founders: It’s Not Too Late01:04:20 Future outlook and closing thoughts01:04:33 Time Capsule to 2045: Future of Compute and Abundance01:07:07 Time Capsule to 2005: More Problems Will Emerge



Get full access to Latent.Space at www.latent.space/subscribe
...more
View all episodesView all episodes
Download on the App Store

Latent Space: The AI Engineer PodcastBy Latent.Space

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

92 ratings


More shows like Latent Space: The AI Engineer Podcast

View all
The a16z Show by Andreessen Horowitz

The a16z Show

1,107 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

308 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

347 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

233 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

204 Listeners

Last Week in AI by Skynet Today

Last Week in AI

311 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

101 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

562 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

512 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

144 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

227 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

680 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

460 Listeners

AI + a16z by a16z

AI + a16z

33 Listeners