Last Week in AI

AI Computing Hardware - Past, Present, and Future

Listen Later

A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible.

Join our brand new Discord here! https://discord.gg/nTyezGSKwP

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.

Sponsors:

  • The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.

    In this episode:

     - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.

     - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.
     - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.
     - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms.

    If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.

    Timestamps:

    • 00:00:00 Introduction
    • 00:03:08 Historical Recap: Early AI and Hardware
    • 00:11:51 The Rise of GPUs and Deep Learning
    • 00:15:39 Scaling Laws and the Evolution of AI Models
    • 00:24:05 The Bitter Lesson and the Future of AI Compute
    • 00:25:58 Moore's Law and Huang's Law
    • 00:30:12 Memory and Logic in AI Hardware
    • 00:34:53 Challenges in AI Hardware: The Memory Wall
    • 00:37:08 The Role of GPUs in Modern AI
    • 00:42:27 Fitting Neural Nets in GPUs
    • 00:48:04 Batch Sizes and GPU Utilization
    • 00:52:47 Parallelism in AI Models
    • 00:55:53 Matrix Multiplications and GPUs
    • 00:59:57 Understanding B200 and GB200
    • 01:05:41 Data Center Hierarchy
    • 01:13:42 High Bandwidth Memory (HBM)
    • 01:16:45 Fabrication and Packaging
    • 01:20:17 The Complexity of Semiconductor Fabrication
    • 01:24:34 Understanding Process Nodes
    • 01:28:26 The Art of Fabrication
    • 01:33:17 The Role of Yield in Fabrication
    • 01:35:47 The Photolithography Process
    • 01:40:38 Deep Ultraviolet Lithography (DUV)
    • 01:43:58 Extreme Ultraviolet Lithography (EUV)
    • 01:51:46 Export Controls and Their Impact
    • 01:54:22 The Rise of Custom AI Hardware
    • 02:00:10 The Future of AI and Hardware

      • See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

      ...more
      View all episodesView all episodes
      Download on the App Store
      Last Week in AIBy Skynet Today
      • 4.6
      • 4.6
      • 4.6
      • 4.6
      • 4.6

      4.6

      300 ratings

      More shows like Last Week in AI

      View all
      The AI in Business Podcast by Daniel Faggella

      The AI in Business Podcast

      172 Listeners

      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

      Super Data Science: ML & AI Podcast with Jon Krohn

      302 Listeners

      NVIDIA AI Podcast by NVIDIA

      NVIDIA AI Podcast

      333 Listeners

      AI Today Podcast by AI & Data Today

      AI Today Podcast

      150 Listeners

      Practical AI by Practical AI LLC

      Practical AI

      204 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      95 Listeners

      The Artificial Intelligence Show by Paul Roetzer and Mike Kaput

      The Artificial Intelligence Show

      196 Listeners

      AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

      AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

      152 Listeners

      This Day in AI Podcast by Michael Sharkey, Chris Sharkey

      This Day in AI Podcast

      228 Listeners

      The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

      The AI Daily Brief: Artificial Intelligence News and Analysis

      630 Listeners

      AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

      AI For Humans: Making Artificial Intelligence Fun & Practical

      274 Listeners

      Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

      Everyday AI Podcast – An AI and ChatGPT Podcast

      110 Listeners

      A Beginner's Guide to AI by Dietmar Fischer

      A Beginner's Guide to AI

      53 Listeners

      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

      173 Listeners

      The TED AI Show by TED

      The TED AI Show

      47 Listeners