FYI - For Your Innovation

The Current State of Artificial Intelligence with James Wang


Listen Later

Scaling laws are as important to artificial intelligence (AI) as the law of gravity is in the world around us. AI is the empirical science of this decade, and Cerebras is a company dedicated to turning state-of-the-art research on large language models (LLMs) into open-source data that can be reproduced by developers across the world. In this episode, James Wang, an ARK alum and product marketing specialist at Cerebras, joins us for a discussion centered around the past and the future of LLM development and why the generative pre-trained transformer (GPT) innovation taking place in this field is like nothing that has ever come before it (and has seemingly limitless possibilities). He also explains the motivation behind Cerebras’ unique approach and the benefits that their architecture and models are providing to developers.

“All great science is reproducible, and AI is the great empirical science of our decade, so we wanted to make sure it’s reproducible.” — @draecomino
Key Points From This Episode:
  • Why Cerebras attracted James.
  • James explains the concept of wafer-scale computing and why it is so advantageous in the AI space.
  • A historical overview of large language model (LLM) development.
  • What James believes to be the most significant natural law that has been discovered in this century.
  • Why Cerebras wants to get state-of-the-art LLM data into the hands of as many people as possible.
  • The Cerebras GPT law.
  • Looking towards the future of LLMs.
  • Standard practice when it comes to training an LLM (and the problems that developers have been battling for years).
  • The potential advantage of Cerebras CS2 chips and computers.
  • Understanding the concept of disaggregated architecture.
  • How the Cerebras approach differs from the approach taken by other companies (NVIDIA and Dojo, for example).
  • Cerebras offerings that are available to be used by the public.
  • The current GPU cloud shortage (and why this adds to the appeal of Cerebras software).
  • Why the progress being made in the GPT space is incomparable to developments that have come before it.
  • Potential directions that the world could be heading in as a result of AI developments (and why James is optimistic about it all).
  • The AI use case that is keeping James up at night.
  • ...more
    View all episodesView all episodes
    Download on the App Store

    FYI - For Your InnovationBy ARK Invest

    • 4.7
    • 4.7
    • 4.7
    • 4.7
    • 4.7

    4.7

    388 ratings


    More shows like FYI - For Your Innovation

    View all
    We Study Billionaires - The Investor’s Podcast Network by The Investor's Podcast Network

    We Study Billionaires - The Investor’s Podcast Network

    3,373 Listeners

    This Week in Startups by Jason Calacanis

    This Week in Startups

    1,285 Listeners

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

    The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

    533 Listeners

    Masters in Business by Bloomberg

    Masters in Business

    2,177 Listeners

    The a16z Show by Andreessen Horowitz

    The a16z Show

    1,090 Listeners

    The Meb Faber Show - Better Investing by The Idea Farm

    The Meb Faber Show - Better Investing

    940 Listeners

    Unchained by Laura Shin

    Unchained

    1,215 Listeners

    Azeem Azhar's Exponential View by Azeem Azhar

    Azeem Azhar's Exponential View

    613 Listeners

    Real Vision: Finance & Investing by Real Vision Podcast Network

    Real Vision: Finance & Investing

    909 Listeners

    The Intrinsic Value Podcast - The Investor’s Podcast Network by The Investor's Podcast Network

    The Intrinsic Value Podcast - The Investor’s Podcast Network

    559 Listeners

    All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

    All-In with Chamath, Jason, Sacks & Friedberg

    9,938 Listeners

    The Memo by Howard Marks by Oaktree Capital Management

    The Memo by Howard Marks

    449 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    131 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    465 Listeners

    AI + a16z by a16z

    AI + a16z

    35 Listeners