alphalist.CTO Podcast - For CTOs and Technical Leaders

#124 - The Path to AGI: Inside poolside’s AI Model Factory for Code with Eiso Kant


Listen Later

Building Human-Level AI for Code: Model Factories, RL at Scale, and Distributed Teams

Technical Deep Dives:

  • Poolside’s model factory: end-to-end automation from raw data to production models
  • Scaling RL from code execution: 800,000+ containerized repos, millions of agent tasks
  • Immutable versioning with Apache Iceberg for full traceability
  • Distributed team structure: 120+ engineers across US/EU, monthly in-person sprints
  • Hardware orchestration: 10,000+ H200s, hot swap failover, dynamic allocation
  • Leadership: dividing responsibilities, low-ego culture, and the MIT principle
  • Future of software: managing agent workforces, context window strategies, continual learning
  • "Our model factory runs thousands of experiments before a single production model is trained. It’s an empirical science—every component, from data ingestion to evals, is versioned and traceable." – Eiso Kant

    Chapters:

    [00:04:28] Poolside’s unique approach to foundation models
    [00:13:02] Scaling hardware: 10,000+ H200s and orchestration
    [00:17:42] RL, agents, and the future of developer tools
    [00:24:56] Immutable versioning and evaluation frameworks
    [00:36:04] Distributed team structure and monthly sprints
    [00:40:26] Leadership, decision-making, and low-ego culture
    [00:45:54] Lessons for CTOs: breaking process dogma, preparing for agent-driven orgs
    [00:50:54] The next 3 years: AGI, agent workforces, and the end of manual coding
    [00:53:44] Context window, continual learning, and model memory
    [00:56:20] Everything collapses into the model: product, research, and daily life
    [00:59:46] Advice to a younger self: scale compute, trust RL+LM, and the four-minute mile

    ...more
    View all episodesView all episodes
    Download on the App Store

    alphalist.CTO Podcast - For CTOs and Technical LeadersBy Tobias Schlottke - alphalist CTO Podcast

    • 5
    • 5
    • 5
    • 5
    • 5

    5

    6 ratings


    More shows like alphalist.CTO Podcast - For CTOs and Technical Leaders

    View all
    OMR Podcast by Philipp Westermeyer - OMR

    OMR Podcast

    47 Listeners

    Lage der Nation - der Politik-Podcast aus Berlin by Philip Banse & Ulf Buermeyer

    Lage der Nation - der Politik-Podcast aus Berlin

    226 Listeners

    OMR Media by Pia Frey

    OMR Media

    3 Listeners

    The OMR Podcast International – Go inside the minds of the biggest names in digital and tech by Philipp Westermeyer, founder and CEO of OMR / Scott Peterson, digital marketing editor, OMR

    The OMR Podcast International – Go inside the minds of the biggest names in digital and tech

    3 Listeners

    OMR Education by OMR Education / Rolf Hermann / Andre Alpar / Tarek Müller

    OMR Education

    2 Listeners

    Das Thema – der wöchentliche Wirtschaftspodcast des manager magazins by manager magazin

    Das Thema – der wöchentliche Wirtschaftspodcast des manager magazins

    9 Listeners

    OK, America? by DIE ZEIT

    OK, America?

    102 Listeners

    OMR Silicon Valley Update by Christian Byza

    OMR Silicon Valley Update

    12 Listeners

    Doppelgänger by Philipp Glöckler, Philipp Klöckner

    Doppelgänger

    10 Listeners

    Hard Fork by The New York Times

    Hard Fork

    5,520 Listeners

    Macht und Millionen – Echte Wirtschaftskrimis by Business Insider

    Macht und Millionen – Echte Wirtschaftskrimis

    21 Listeners

    5050 by OMR by Isabelle Gardt & Kira Schubert

    5050 by OMR

    0 Listeners

    bto – der Ökonomie-Podcast von Dr. Daniel Stelter by Dr. Daniel Stelter

    bto – der Ökonomie-Podcast von Dr. Daniel Stelter

    24 Listeners

    OMRap by Torben Lux, Falk Schacht, Niko Hüls

    OMRap

    0 Listeners

    LANZ & PRECHT by ZDF, Markus Lanz & Richard David Precht

    LANZ & PRECHT

    312 Listeners

    The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief: Artificial Intelligence News and Analysis

    607 Listeners

    Was bisher geschah - Geschichtspodcast by Joachim Telgenbüscher, Nils Minkmar

    Was bisher geschah - Geschichtspodcast

    54 Listeners

    Hoss & Hopf by Kiarash Hossainpour, Philip Hopf

    Hoss & Hopf

    22 Listeners

    RONZHEIMER. by Paul Ronzheimer

    RONZHEIMER.

    108 Listeners

    Firewall: Jedes System hat eine Schwachstelle by DER SPIEGEL

    Firewall: Jedes System hat eine Schwachstelle

    10 Listeners

    OMR Rabbit Hole: Die Höhle der Löwen by Florian Rinke, OMR, Podstars by OMR

    OMR Rabbit Hole: Die Höhle der Löwen

    0 Listeners

    The Pragmatic Engineer by Gergely Orosz

    The Pragmatic Engineer

    64 Listeners