Last Week in AI

AI Computing Hardware - Past, Present, and Future

Listen Later

A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible.

Join our brand new Discord here! https://discord.gg/nTyezGSKwP

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.

Sponsors:

  • The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.

    In this episode:

     - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.

     - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.
     - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.
     - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms.

    If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.

    Timestamps:

    • 00:00:00 Introduction
    • 00:03:08 Historical Recap: Early AI and Hardware
    • 00:11:51 The Rise of GPUs and Deep Learning
    • 00:15:39 Scaling Laws and the Evolution of AI Models
    • 00:24:05 The Bitter Lesson and the Future of AI Compute
    • 00:25:58 Moore's Law and Huang's Law
    • 00:30:12 Memory and Logic in AI Hardware
    • 00:34:53 Challenges in AI Hardware: The Memory Wall
    • 00:37:08 The Role of GPUs in Modern AI
    • 00:42:27 Fitting Neural Nets in GPUs
    • 00:48:04 Batch Sizes and GPU Utilization
    • 00:52:47 Parallelism in AI Models
    • 00:55:53 Matrix Multiplications and GPUs
    • 00:59:57 Understanding B200 and GB200
    • 01:05:41 Data Center Hierarchy
    • 01:13:42 High Bandwidth Memory (HBM)
    • 01:16:45 Fabrication and Packaging
    • 01:20:17 The Complexity of Semiconductor Fabrication
    • 01:24:34 Understanding Process Nodes
    • 01:28:26 The Art of Fabrication
    • 01:33:17 The Role of Yield in Fabrication
    • 01:35:47 The Photolithography Process
    • 01:40:38 Deep Ultraviolet Lithography (DUV)
    • 01:43:58 Extreme Ultraviolet Lithography (EUV)
    • 01:51:46 Export Controls and Their Impact
    • 01:54:22 The Rise of Custom AI Hardware
    • 02:00:10 The Future of AI and Hardware

      • See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

      ...more
      View all episodesView all episodes
      Download on the App Store
      Last Week in AIBy Skynet Today
      • 4.6
      • 4.6
      • 4.6
      • 4.6
      • 4.6

      4.6

      306 ratings

      More shows like Last Week in AI

      View all
      The a16z Show by Andreessen Horowitz

      The a16z Show

      1,105 Listeners

      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

      Super Data Science: ML & AI Podcast with Jon Krohn

      306 Listeners

      NVIDIA AI Podcast by NVIDIA

      NVIDIA AI Podcast

      343 Listeners

      Practical AI by Practical AI LLC

      Practical AI

      212 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      101 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      551 Listeners

      Big Technology Podcast by Alex Kantrowitz

      Big Technology Podcast

      512 Listeners

      The Artificial Intelligence Show by Paul Roetzer and Mike Kaput

      The Artificial Intelligence Show

      214 Listeners

      No Priors: Artificial Intelligence | Technology | Startups by Conviction

      No Priors: Artificial Intelligence | Technology | Startups

      150 Listeners

      Latent Space: The AI Engineer Podcast by Latent.Space

      Latent Space: The AI Engineer Podcast

      101 Listeners

      This Day in AI Podcast by Michael Sharkey, Chris Sharkey

      This Day in AI Podcast

      228 Listeners

      The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

      The AI Daily Brief: Artificial Intelligence News and Analysis

      688 Listeners

      Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

      Everyday AI Podcast – An AI and ChatGPT Podcast

      112 Listeners

      A Beginner's Guide to AI by Dietmar Fischer

      A Beginner's Guide to AI

      54 Listeners

      The Next Wave - AI and The Future of Technology by Mindstream (Hubspot Media)

      The Next Wave - AI and The Future of Technology

      55 Listeners