No Priors: Artificial Intelligence | Technology | Startups

Mistral 7B and the Open Source Revolution With Arthur Mensch, CEO Mistral AI


Listen Later

Open Source fuels the engine of innovation, according to Arthur Mensch, CEO and co-founder of Mistral AI. Mistral is a French AI company which recently made a splash with releasing Mistral 7B, the most powerful language model for its size to date, and outperforming much larger models. Sarah Guo and Elad Gil sit down with Arthur to discuss why open source could win the AI wars, their $100M+ seed financing, the true nature of scaling laws, why he started his company in France, and what Mistral is building next.


Arthur Mensch is Chief Executive Officer and co-founder of Mistral AI. A graduate of École Polytechnique, Télécom Paris and holder of the Master Mathématiques Vision Apprentissage at Paris Saclay, he completed his thesis in machine learning for functional brain imaging at Inria (Parietal team). He spent two years as a post-doctoral fellow in the Applied Mathematics department at ENS Ulm, where he carried out work in mathematics for optimization and machine learning. In 2020, he joined DeepMind as a researcher, working on large language models, before leaving in 2023 to co-found Mistral AI with Guillaume Lample and Timothee Lacroix.


Show Links: 

  • Arthur’s Linkedin
  • Mistral
  • Mistral 7b
  • Retro: Improving language models by retrieving from trillions of tokens
  • Chinchilla: Training Compute-Optimal Large Language Models
  • Sign up for new podcasts every week. Email feedback to [email protected]

    Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ArthurMensch


    Show Notes: 

    (0:00) - Why he co-founded Mistral

    (4:22) - Chinchilla and Proportionality 

    (6:16) - Mistral 7b

    (9:17) - Data and Annotations

    (10:33) - Open Source Ecosystem 

    (17:36) - Proposed Compute and Scale Limits

    (19:58) - Threat of Bioweapons 

    (23:08) - Guardrails and Safety 

    (29:46) - Mistral Platform

    (31:31) - French and European AI Startups

    ...more
    View all episodesView all episodes
    Download on the App Store

    No Priors: Artificial Intelligence | Technology | StartupsBy Conviction

    • 4.4
    • 4.4
    • 4.4
    • 4.4
    • 4.4

    4.4

    119 ratings


    More shows like No Priors: Artificial Intelligence | Technology | Startups

    View all
    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,288 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    537 Listeners

    The a16z Show by Andreessen Horowitz

    The a16z Show

    1,089 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    434 Listeners

    Y Combinator Startup Podcast by Y Combinator

    Y Combinator Startup Podcast

    226 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    95 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    512 Listeners

    The Logan Bartlett Show by by Redpoint Ventures

    The Logan Bartlett Show

    188 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    93 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    467 Listeners

    AI + a16z by a16z

    AI + a16z

    35 Listeners

    Lightcone Podcast by Y Combinator

    Lightcone Podcast

    21 Listeners

    Training Data by Sequoia Capital

    Training Data

    40 Listeners

    Uncapped with Jack Altman by Alt Capital

    Uncapped with Jack Altman

    44 Listeners

    Cheeky Pint by Stripe

    Cheeky Pint

    45 Listeners