FYI - For Your Innovation

The Evolution of AI Models with Naveen Rao of MosaicML


Listen Later

There are many speculations about the future of artificial intelligence (AI), and in this episode, we hear the opinions and predictions of a player in the inner folds of the AI space. Naveen Rao is the CEO and Co-Founder of the machine learning (ML) training platform, MosaicML, and the former CEO and Co-Founder of Nervana Systems. Naveen shares insight into the thesis behind Mosaic and the practical applications of Large Language Models (LLMs), as well as the Generative Pre-trained Transformer-2 (GPT-2) to GPT-3 transition and the challenge of training models with the constraint of data limits. He predicts the evolution of AI models in terms of quantity, size, and function, and the future of computers in general. If you’re curious as to whether it makes sense to build smaller models or own your own model, this episode is for you. Tune in to hear Naveen’s opinions on the impact of AI on the economy, the danger of centralizing resources, what constitutes sentience, and much more.

“What we’re doing at Mosaic is building tools to enable more people to have access to these technologies. When it’s all centralized in one or two or three players, that creates a huge power dynamic.” — @NaveenGRao
Key Points From This Episode:
  • Naveen Rao’s educational background and interest in synthetic intelligence.
  • What led him to start his first AI company, Nervana Systems.
  • The thesis behind MosaicML.
  • What MosaicML offers customers.
  • What Naveen considers to be 2022’s most exciting breakthrough in AI.
  • The innovation of ChatGPT.
  • The GPT-2 to GPT-3 transition.
  • The challenge of training models with the constraint of data limits.
  • Naveen explains the concept of synthetic data.
  • He predicts the evolution of AI models in terms of quantity, size, and function.
  • Why it makes sense to build smaller models and own your own model where possible.
  • Data as a moat component.
  • Practical applications of LLMs.
  • Naveen’s opinion on whether AI will disrupt the economy or increase Gross Domestic Product (GDP).
  • The danger of the centralization of resources.
  • How MosaicML is making trading more efficient given the limits AI is facing.
  • The efficiency improvements MosaicML customers are seeking out.
  • Naveen’s prediction for the rate of cost decline.
  • The history of the computer password.
  • The future of computers.
  • The question of what constitutes sentience.
  • Naveen recounts the acquisition process of selling Nervana Systems to Intel.
  • How the innovator’s dilemma will play out among competitors in the AI space.
  • Naveen’s advice for his past self.
  • ...more
    View all episodesView all episodes
    Download on the App Store

    FYI - For Your InnovationBy ARK Invest

    • 4.7
    • 4.7
    • 4.7
    • 4.7
    • 4.7

    4.7

    388 ratings


    More shows like FYI - For Your Innovation

    View all
    We Study Billionaires - The Investor’s Podcast Network by The Investor's Podcast Network

    We Study Billionaires - The Investor’s Podcast Network

    3,373 Listeners

    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,288 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    537 Listeners

    Masters in Business by Bloomberg

    Masters in Business

    2,175 Listeners

    The a16z Show by Andreessen Horowitz

    The a16z Show

    1,089 Listeners

    The Meb Faber Show - Better Investing by The Idea Farm

    The Meb Faber Show - Better Investing

    941 Listeners

    Unchained by Laura Shin

    Unchained

    1,217 Listeners

    Azeem Azhar's Exponential View by Azeem Azhar

    Azeem Azhar's Exponential View

    612 Listeners

    Real Vision: Finance & Investing by Real Vision Podcast Network

    Real Vision: Finance & Investing

    911 Listeners

    The Intrinsic Value Podcast - The Investor’s Podcast Network by The Investor's Podcast Network

    The Intrinsic Value Podcast - The Investor’s Podcast Network

    560 Listeners

    All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

    All-In with Chamath, Jason, Sacks & Friedberg

    9,922 Listeners

    The Memo by Howard Marks by Oaktree Capital Management

    The Memo by Howard Marks

    448 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    130 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    467 Listeners

    AI + a16z by a16z

    AI + a16z

    35 Listeners