No Priors: Artificial Intelligence | Technology | Startups

Mistral 7B and the Open Source Revolution With Arthur Mensch, CEO Mistral AI


Listen Later

Open Source fuels the engine of innovation, according to Arthur Mensch, CEO and co-founder of Mistral AI. Mistral is a French AI company which recently made a splash with releasing Mistral 7B, the most powerful language model for its size to date, and outperforming much larger models. Sarah Guo and Elad Gil sit down with Arthur to discuss why open source could win the AI wars, their $100M+ seed financing, the true nature of scaling laws, why he started his company in France, and what Mistral is building next.


Arthur Mensch is Chief Executive Officer and co-founder of Mistral AI. A graduate of École Polytechnique, Télécom Paris and holder of the Master Mathématiques Vision Apprentissage at Paris Saclay, he completed his thesis in machine learning for functional brain imaging at Inria (Parietal team). He spent two years as a post-doctoral fellow in the Applied Mathematics department at ENS Ulm, where he carried out work in mathematics for optimization and machine learning. In 2020, he joined DeepMind as a researcher, working on large language models, before leaving in 2023 to co-found Mistral AI with Guillaume Lample and Timothee Lacroix.


Show Links: 

  • Arthur’s Linkedin
  • Mistral
  • Mistral 7b
  • Retro: Improving language models by retrieving from trillions of tokens
  • Chinchilla: Training Compute-Optimal Large Language Models
  • Sign up for new podcasts every week. Email feedback to [email protected]

    Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ArthurMensch


    Show Notes: 

    (0:00) - Why he co-founded Mistral

    (4:22) - Chinchilla and Proportionality 

    (6:16) - Mistral 7b

    (9:17) - Data and Annotations

    (10:33) - Open Source Ecosystem 

    (17:36) - Proposed Compute and Scale Limits

    (19:58) - Threat of Bioweapons 

    (23:08) - Guardrails and Safety 

    (29:46) - Mistral Platform

    (31:31) - French and European AI Startups

    ...more
    View all episodesView all episodes
    Download on the App Store

    No Priors: Artificial Intelligence | Technology | StartupsBy Conviction

    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    93 ratings


    More shows like No Priors: Artificial Intelligence | Technology | Startups

    View all
    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,281 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,009 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    527 Listeners

    Greymatter by Greylock Partners

    Greymatter

    121 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    439 Listeners

    Invest Like the Best with Patrick O'Shaughnessy by Colossus | Investing & Business Podcasts

    Invest Like the Best with Patrick O'Shaughnessy

    2,332 Listeners

    Y Combinator Startup Podcast by Y Combinator

    Y Combinator Startup Podcast

    214 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    196 Listeners

    All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

    All-In with Chamath, Jason, Sacks & Friedberg

    8,385 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    320 Listeners

    The Logan Bartlett Show by by Redpoint Ventures

    The Logan Bartlett Show

    189 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    70 Listeners

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

    397 Listeners

    The Ben & Marc Show by Marc Andreessen, Ben Horowitz

    The Ben & Marc Show

    106 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    424 Listeners