No Priors: Artificial Intelligence | Technology | Startups

Mistral 7B and the Open Source Revolution With Arthur Mensch, CEO Mistral AI


Listen Later

Open Source fuels the engine of innovation, according to Arthur Mensch, CEO and co-founder of Mistral AI. Mistral is a French AI company which recently made a splash with releasing Mistral 7B, the most powerful language model for its size to date, and outperforming much larger models. Sarah Guo and Elad Gil sit down with Arthur to discuss why open source could win the AI wars, their $100M+ seed financing, the true nature of scaling laws, why he started his company in France, and what Mistral is building next.


Arthur Mensch is Chief Executive Officer and co-founder of Mistral AI. A graduate of École Polytechnique, Télécom Paris and holder of the Master Mathématiques Vision Apprentissage at Paris Saclay, he completed his thesis in machine learning for functional brain imaging at Inria (Parietal team). He spent two years as a post-doctoral fellow in the Applied Mathematics department at ENS Ulm, where he carried out work in mathematics for optimization and machine learning. In 2020, he joined DeepMind as a researcher, working on large language models, before leaving in 2023 to co-found Mistral AI with Guillaume Lample and Timothee Lacroix.


Show Links: 

  • Arthur’s Linkedin
  • Mistral
  • Mistral 7b
  • Retro: Improving language models by retrieving from trillions of tokens
  • Chinchilla: Training Compute-Optimal Large Language Models
  • Sign up for new podcasts every week. Email feedback to [email protected]

    Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ArthurMensch


    Show Notes: 

    (0:00) - Why he co-founded Mistral

    (4:22) - Chinchilla and Proportionality 

    (6:16) - Mistral 7b

    (9:17) - Data and Annotations

    (10:33) - Open Source Ecosystem 

    (17:36) - Proposed Compute and Scale Limits

    (19:58) - Threat of Bioweapons 

    (23:08) - Guardrails and Safety 

    (29:46) - Mistral Platform

    (31:31) - French and European AI Startups

    ...more
    View all episodesView all episodes
    Download on the App Store

    No Priors: Artificial Intelligence | Technology | StartupsBy Conviction

    • 4.4
    • 4.4
    • 4.4
    • 4.4
    • 4.4

    4.4

    114 ratings


    More shows like No Priors: Artificial Intelligence | Technology | Startups

    View all
    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,273 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,040 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    519 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    441 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    192 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    88 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    426 Listeners

    Unsupervised Learning by by Redpoint Ventures

    Unsupervised Learning

    50 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    75 Listeners

    The Ben & Marc Show by Marc Andreessen, Ben Horowitz

    The Ben & Marc Show

    135 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    461 Listeners

    AI + a16z by a16z

    AI + a16z

    31 Listeners

    Lightcone Podcast by Y Combinator

    Lightcone Podcast

    22 Listeners

    Training Data by Sequoia Capital

    Training Data

    43 Listeners

    Uncapped with Jack Altman by Alt Capital

    Uncapped with Jack Altman

    35 Listeners