Training Data

The Breakthroughs Needed for AGI Have Already Been Made: OpenAI Former Research Head Bob McGrew


Listen Later

As OpenAI's former Head of Research, Bob McGrew witnessed the company's evolution from GPT-3’s breakthrough to today's reasoning models. He argues that there are three legs of the stool for AGI—Transformers, scaled pre-training, and reasoning—and that the fundamentals that will shape the next decade-plus are already in place. He thinks 2025 will be defined by reasoning while pre-training hits diminishing returns. Bob discusses why the agent economy will price services at compute costs due to near-infinite supply, fundamentally disrupting industries like law and medicine, and how his children use ChatGPT to spark curiosity and agency. From robotics breakthroughs to managing brilliant researchers, Bob offers a unique perspective on AI’s trajectory and where startups can still find defensible opportunities.

Hosted by: Stephanie Zhan and Sonya Huang, Sequoia Capital


Mentioned in this episode: 

  • Solving Rubik’s Cube with a robot hand: OpenAI’s original robotics research

  • Computer Use and Operator: Anthropic and OpenAI reasoning breakthroughs that originated with OpenAi researchers

  • Skild and Physical Intelligence: Robotics-oriented companies Bob sees as well-positioned now

  • Distyl: AI company founded by ex-Palintir alums to create enterprise workflows driven by proprietary data

  • Member of the technical staff: Title at OpenAI designed to break down barriers between AI researchers and engineers


    Howie.ai: Scheduling app that Bob uses

    ...more
    View all episodesView all episodes
    Download on the App Store

    Training DataBy Sequoia Capital

    • 4.3
    • 4.3
    • 4.3
    • 4.3
    • 4.3

    4.3

    35 ratings


    More shows like Training Data

    View all
    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,270 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,028 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    518 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    446 Listeners

    Invest Like the Best with Patrick O'Shaughnessy by Colossus | Investing & Business Podcasts

    Invest Like the Best with Patrick O'Shaughnessy

    2,314 Listeners

    Y Combinator Startup Podcast by Y Combinator

    Y Combinator Startup Podcast

    216 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    388 Listeners

    Lenny's Podcast: Product | Growth | Career by Lenny Rachitsky

    Lenny's Podcast: Product | Growth | Career

    1,334 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    122 Listeners

    Unsupervised Learning by by Redpoint Ventures

    Unsupervised Learning

    39 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    75 Listeners

    Crucible Moments by Sequoia Capital

    Crucible Moments

    91 Listeners

    The Ben & Marc Show by Marc Andreessen, Ben Horowitz

    The Ben & Marc Show

    134 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    454 Listeners

    AI + a16z by a16z

    AI + a16z

    30 Listeners

    Lightcone Podcast by Y Combinator

    Lightcone Podcast

    23 Listeners