Super Data Science: ML & AI Podcast with Jon Krohn

973: AI Systems Performance Engineering, with Chris Fregly


Listen Later

No one should be manually writing code in 2026, thinks Chris Fregly, Jon Krohn’s guest on this week’s episode. In this interview about Chris’ latest book, AI Systems Performance Engineering, he explains why it’s so important to consider memory bandwidth when evaluating GPU performance, that understanding the full hardware software stack is the most valuable skill for anyone working in AI development, and which shortcuts we still shouldn’t ever take when writing code, even though we might be outsourcing a great deal to generative AI.


This episode is brought to you by the ⁠⁠Cisco, by Acceldata and by ⁠ODSC, the Open Data Science Conference⁠.


Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/973⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠


Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.


In this episode you will learn:

  • (03:39) Why Chris wrote AI Systems Performance Engineering 
    • (21:39) Essential coding metrics 
      • (37:24) The importance of inference when coding
        • (42:11) How to manage workflows while using AI agents
          • (51:37) Where and how to invest in the AI market
          • ...more
            View all episodesView all episodes
            Download on the App Store

            Super Data Science: ML & AI Podcast with Jon KrohnBy Jon Krohn

            • 4.6
            • 4.6
            • 4.6
            • 4.6
            • 4.6

            4.6

            295 ratings


            More shows like Super Data Science: ML & AI Podcast with Jon Krohn

            View all
            Data Skeptic by Kyle Polich

            Data Skeptic

            482 Listeners

            Software Engineering Daily by Software Engineering Daily

            Software Engineering Daily

            631 Listeners

            Talk Python To Me by Michael Kennedy

            Talk Python To Me

            583 Listeners

            NVIDIA AI Podcast by NVIDIA

            NVIDIA AI Podcast

            347 Listeners

            AI Today Podcast by AI & Data Today

            AI Today Podcast

            159 Listeners

            DataFramed by DataCamp

            DataFramed

            267 Listeners

            Practical AI by Practical AI LLC

            Practical AI

            211 Listeners

            The Real Python Podcast by Real Python

            The Real Python Podcast

            140 Listeners

            Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

            Machine Learning Street Talk (MLST)

            101 Listeners

            No Priors: Artificial Intelligence | Technology | Startups by Conviction

            No Priors: Artificial Intelligence | Technology | Startups

            143 Listeners

            AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

            AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

            161 Listeners

            This Day in AI Podcast by Michael Sharkey, Chris Sharkey

            This Day in AI Podcast

            228 Listeners

            The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

            The AI Daily Brief: Artificial Intelligence News and Analysis

            683 Listeners

            AI For Humans: Weekly AI News, Tools & Trends by Kevin Pereira & Gavin Purcell

            AI For Humans: Weekly AI News, Tools & Trends

            282 Listeners

            Training Data by Sequoia Capital

            Training Data

            41 Listeners