alphalist.CTO Podcast - For CTOs and Technical Leaders

#124 - The Path to AGI: Inside poolside’s AI Model Factory for Code with Eiso Kant


Listen Later

Building Human-Level AI for Code: Model Factories, RL at Scale, and Distributed Teams

Technical Deep Dives:

  • Poolside’s model factory: end-to-end automation from raw data to production models
  • Scaling RL from code execution: 800,000+ containerized repos, millions of agent tasks
  • Immutable versioning with Apache Iceberg for full traceability
  • Distributed team structure: 120+ engineers across US/EU, monthly in-person sprints
  • Hardware orchestration: 10,000+ H200s, hot swap failover, dynamic allocation
  • Leadership: dividing responsibilities, low-ego culture, and the MIT principle
  • Future of software: managing agent workforces, context window strategies, continual learning
  • "Our model factory runs thousands of experiments before a single production model is trained. It’s an empirical science—every component, from data ingestion to evals, is versioned and traceable." – Eiso Kant

    Chapters:

    [00:04:28] Poolside’s unique approach to foundation models
    [00:13:02] Scaling hardware: 10,000+ H200s and orchestration
    [00:17:42] RL, agents, and the future of developer tools
    [00:24:56] Immutable versioning and evaluation frameworks
    [00:36:04] Distributed team structure and monthly sprints
    [00:40:26] Leadership, decision-making, and low-ego culture
    [00:45:54] Lessons for CTOs: breaking process dogma, preparing for agent-driven orgs
    [00:50:54] The next 3 years: AGI, agent workforces, and the end of manual coding
    [00:53:44] Context window, continual learning, and model memory
    [00:56:20] Everything collapses into the model: product, research, and daily life
    [00:59:46] Advice to a younger self: scale compute, trust RL+LM, and the four-minute mile

    ...more
    View all episodesView all episodes
    Download on the App Store

    alphalist.CTO Podcast - For CTOs and Technical LeadersBy Tobias Schlottke - alphalist CTO Podcast

    • 5
    • 5
    • 5
    • 5
    • 5

    5

    6 ratings


    More shows like alphalist.CTO Podcast - For CTOs and Technical Leaders

    View all
    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    543 Listeners

    The a16z Show by Andreessen Horowitz

    The a16z Show

    1,111 Listeners

    OMR Podcast by Philipp Westermeyer - OMR

    OMR Podcast

    34 Listeners

    Lage der Nation - der Politik-Podcast aus Berlin by Philip Banse & Ulf Buermeyer

    Lage der Nation - der Politik-Podcast aus Berlin

    224 Listeners

    OMR Media by Pia Frey

    OMR Media

    3 Listeners

    The OMR Podcast International – Go inside the minds of the biggest names in digital and tech by Philipp Westermeyer, founder and CEO of OMR / Scott Peterson, digital marketing editor, OMR

    The OMR Podcast International – Go inside the minds of the biggest names in digital and tech

    3 Listeners

    OMR Education by OMR Education / Rolf Hermann / Andre Alpar / Tarek Müller

    OMR Education

    3 Listeners

    Das Thema – der wöchentliche Wirtschaftspodcast des manager magazins by manager magazin

    Das Thema – der wöchentliche Wirtschaftspodcast des manager magazins

    9 Listeners

    Handelsblatt Disrupt - Der Podcast über die Zukunft der Wirtschaft by Larissa Holzki, Handelsblatt

    Handelsblatt Disrupt - Der Podcast über die Zukunft der Wirtschaft

    15 Listeners

    OK, America? by DIE ZEIT

    OK, America?

    104 Listeners

    OMR Silicon Valley Update by Christian Byza

    OMR Silicon Valley Update

    11 Listeners

    Doppelgänger by Philipp Glöckler, Philipp Klöckner

    Doppelgänger

    16 Listeners

    Macht und Millionen – Echte Wirtschaftskrimis by Business Insider

    Macht und Millionen – Echte Wirtschaftskrimis

    19 Listeners

    5050 by OMR by Isabelle Gardt & Kira Schubert

    5050 by OMR

    0 Listeners

    bto – der Ökonomie-Podcast von Dr. Daniel Stelter by Dr. Daniel Stelter

    bto – der Ökonomie-Podcast von Dr. Daniel Stelter

    23 Listeners

    Machtwechsel by Dagmar Rosenfeld und Robin Alexander

    Machtwechsel

    120 Listeners

    OMRap by Torben Lux, Falk Schacht, Niko Hüls

    OMRap

    0 Listeners

    Lanz + Precht by ZDF, Markus Lanz & Richard David Precht

    Lanz + Precht

    343 Listeners

    Was bisher geschah - Geschichtspodcast by Joachim Telgenbüscher, Nils Minkmar

    Was bisher geschah - Geschichtspodcast

    44 Listeners

    RONZHEIMER. by Paul Ronzheimer

    RONZHEIMER.

    135 Listeners

    Firewall: Jedes System hat eine Schwachstelle by DER SPIEGEL

    Firewall: Jedes System hat eine Schwachstelle

    8 Listeners

    OMR Rabbit Hole: Die Höhle der Löwen by Florian Rinke, OMR, Podstars by OMR

    OMR Rabbit Hole: Die Höhle der Löwen

    0 Listeners