Super Data Science: ML & AI Podcast with Jon Krohn

881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

Listen Later

Emily Webber speaks to Jon Krohn about her work at Amazon Web Services, from its Annapurna Labs-developed Nitro System, a foundational technology that can enhance securities and performance in the cloud and how Trainium2 became AWS’ most powerful AI chip with four times the compute of Trainium. Hear the specs of AWS’s chips and when to use them.


Additional materials: www.superdatascience.com/881


This episode is brought to you by ODSC, the Open Data Science Conference.


Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.


In this episode you will learn:

  • (08:36) Emily’s work on AWS’ SageMaker and Trainium 
  • (23:54) How AWS Neuron lets builders tailor their approach to using frameworks 
  • (29:07) Why using an accelerator is better than using a GPU 
  • (35:29) The key differences between AWS Trainium and AWS Trainium2 
  • (52:45) How to select between AWS Trainium and AWS Trainium2
    • ...more
    View all episodesView all episodes
    Download on the App Store
    Super Data Science: ML & AI Podcast with Jon KrohnBy Jon Krohn
    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    294 ratings

    More shows like Super Data Science: ML & AI Podcast with Jon Krohn

    View all
    Data Skeptic by Kyle Polich

    Data Skeptic

    478 Listeners

    Talk Python To Me by Michael Kennedy

    Talk Python To Me

    588 Listeners

    The AI in Business Podcast by Daniel Faggella

    The AI in Business Podcast

    169 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    433 Listeners

    NVIDIA AI Podcast by NVIDIA

    NVIDIA AI Podcast

    341 Listeners

    Data Engineering Podcast by Tobias Macey

    Data Engineering Podcast

    146 Listeners

    Machine Learning Guide by OCDevel

    Machine Learning Guide

    768 Listeners

    DataFramed by DataCamp

    DataFramed

    268 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    211 Listeners

    The Real Python Podcast by Real Python

    The Real Python Podcast

    142 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    88 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    133 Listeners

    AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

    AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

    150 Listeners

    This Day in AI Podcast by Michael Sharkey, Chris Sharkey

    This Day in AI Podcast

    209 Listeners

    The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief: Artificial Intelligence News and Analysis

    557 Listeners