No Priors: Artificial Intelligence | Technology | Startups

Mistral 7B and the Open Source Revolution With Arthur Mensch, CEO Mistral AI


Listen Later

Open Source fuels the engine of innovation, according to Arthur Mensch, CEO and co-founder of Mistral AI. Mistral is a French AI company which recently made a splash with releasing Mistral 7B, the most powerful language model for its size to date, and outperforming much larger models. Sarah Guo and Elad Gil sit down with Arthur to discuss why open source could win the AI wars, their $100M+ seed financing, the true nature of scaling laws, why he started his company in France, and what Mistral is building next.


Arthur Mensch is Chief Executive Officer and co-founder of Mistral AI. A graduate of École Polytechnique, Télécom Paris and holder of the Master Mathématiques Vision Apprentissage at Paris Saclay, he completed his thesis in machine learning for functional brain imaging at Inria (Parietal team). He spent two years as a post-doctoral fellow in the Applied Mathematics department at ENS Ulm, where he carried out work in mathematics for optimization and machine learning. In 2020, he joined DeepMind as a researcher, working on large language models, before leaving in 2023 to co-found Mistral AI with Guillaume Lample and Timothee Lacroix.


Show Links: 

  • Arthur’s Linkedin
  • Mistral
  • Mistral 7b
  • Retro: Improving language models by retrieving from trillions of tokens
  • Chinchilla: Training Compute-Optimal Large Language Models
  • Sign up for new podcasts every week. Email feedback to [email protected]

    Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ArthurMensch


    Show Notes: 

    (0:00) - Why he co-founded Mistral

    (4:22) - Chinchilla and Proportionality 

    (6:16) - Mistral 7b

    (9:17) - Data and Annotations

    (10:33) - Open Source Ecosystem 

    (17:36) - Proposed Compute and Scale Limits

    (19:58) - Threat of Bioweapons 

    (23:08) - Guardrails and Safety 

    (29:46) - Mistral Platform

    (31:31) - French and European AI Startups

    ...more
    View all episodesView all episodes
    Download on the App Store

    No Priors: Artificial Intelligence | Technology | StartupsBy Conviction

    • 4.4
    • 4.4
    • 4.4
    • 4.4
    • 4.4

    4.4

    112 ratings


    More shows like No Priors: Artificial Intelligence | Technology | Startups

    View all
    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,272 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,012 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    504 Listeners

    Invest Like the Best with Patrick O'Shaughnessy by Colossus | Investing & Business Podcasts

    Invest Like the Best with Patrick O'Shaughnessy

    2,288 Listeners

    Y Combinator Startup Podcast by Y Combinator

    Y Combinator Startup Podcast

    212 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    88 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    355 Listeners

    The Logan Bartlett Show by by Redpoint Ventures

    The Logan Bartlett Show

    189 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    76 Listeners

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

    443 Listeners

    The Ben & Marc Show by Marc Andreessen, Ben Horowitz

    The Ben & Marc Show

    131 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    445 Listeners

    AI + a16z by a16z

    AI + a16z

    30 Listeners

    Lightcone Podcast by Y Combinator

    Lightcone Podcast

    21 Listeners

    Training Data by Sequoia Capital

    Training Data

    36 Listeners