Training Data

ReflectionAI Founder Ioannis Antonoglou: From AlphaGo to AGI


Listen Later

Ioannis Antonoglou, founding engineer at DeepMind and co-founder of ReflectionAI, has seen the triumphs of reinforcement learning firsthand. From AlphaGo to AlphaZero and MuZero, Ioannis has built the most powerful agents in the world. Ioannis breaks down key moments in AlphaGo's game against Lee Sodol (Moves 37 and 78), the importance of self-play and the impact of scale, reliability, planning and in-context learning as core factors that will unlock the next level of progress in AI.


Hosted by: Stephanie Zhan and Sonya Huang, Sequoia Capital


Mentioned in this episode:

  • PPO: Proximal Policy Optimization algorithm developed by DeepMind in game environments. Also used by OpenAI for RLHF in ChatGPT.
  • MuJoCo: Open source physics engine used to develop PPO
  • Monte Carlo Tree Search: Heuristic search algorithm used in AlphaGo as well as video compression for YouTube and the self-driving system at Tesla
  • AlphaZero: The DeepMind model that taught itself from scratch how to master the games of chess, shogi and Go
  • MuZero: The DeepMind follow up to AlphaZero that mastered games without knowing the rules and able to plan winning strategies in unknown environments
  • AlphaChem: Chemical Synthesis Planning with Tree Search and Deep Neural Network Policies
  • DQN: Deep Q-Network, Introduced in 2013 paper, Playing Atari with Deep Reinforcement Learning
  • AlphaFold: DeepMind model for predicting protein structures for which Demis Hassabis, John Jumper and David Baker won the 2024 Nobel Prize in Chemistry
    ...more
    View all episodesView all episodes
    Download on the App Store

    Training DataBy Sequoia Capital

    • 4.3
    • 4.3
    • 4.3
    • 4.3
    • 4.3

    4.3

    31 ratings


    More shows like Training Data

    View all
    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,270 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,005 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    512 Listeners

    Invest Like the Best with Patrick O'Shaughnessy by Colossus | Investing & Business Podcasts

    Invest Like the Best with Patrick O'Shaughnessy

    2,294 Listeners

    Y Combinator Startup Podcast by Y Combinator

    Y Combinator Startup Podcast

    209 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    88 Listeners

    Grit by Kleiner Perkins

    Grit

    190 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    342 Listeners

    The Logan Bartlett Show by by Redpoint Ventures

    The Logan Bartlett Show

    190 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    124 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    62 Listeners

    Crucible Moments by Sequoia Capital

    Crucible Moments

    90 Listeners

    The Ben & Marc Show by Marc Andreessen, Ben Horowitz

    The Ben & Marc Show

    120 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    440 Listeners

    AI + a16z by a16z

    AI + a16z

    28 Listeners

    Lightcone Podcast by Y Combinator

    Lightcone Podcast

    19 Listeners