Vanishing Gradients

Episode 56: DeepMind Just Dropped Gemma 270M... And Here’s Why It Matters


Listen Later

While much of the AI world chases ever-larger models, Ravin Kumar (Google DeepMind) and his team build across the size spectrum, from billions of parameters down to this week’s release: Gemma 270M, the smallest member yet of the Gemma 3 open-weight family. At just 270 million parameters, a quarter the size of Gemma 1B, it’s designed for speed, efficiency, and fine-tuning.

We explore what makes 270M special, where it fits alongside its billion-parameter siblings, and why you might reach for it in production even if you think “small” means “just for experiments.”

We talk through:

  • Where 270M fits into the Gemma 3 lineup — and why it exists
  • On-device use cases where latency, privacy, and efficiency matter
  • How smaller models open up rapid, targeted fine-tuning
  • Running multiple models in parallel without heavyweight hardware
  • Why “small” models might drive the next big wave of AI adoption
  • If you’ve ever wondered what you’d do with a model this size (or how to squeeze the most out of it) this episode will show you how small can punch far above its weight.

    LINKS

    • Introducing Gemma 3 270M: The compact model for hyper-efficient AI (Google Developer Blog)
    • Full Model Fine-Tune Guide using Hugging Face Transformers
    • The Gemma 270M model on HuggingFace
    • The Gemma 270M model on Ollama
    • Building AI Agents with Gemma 3, a workshop with Ravin and Hugo (Code here)
    • From Images to Agents: Building and Evaluating Multimodal AI Workflows, a workshop with Ravin and Hugo(Code here)
    • Evaluating AI Agents: From Demos to Dependability, an upcoming workshop with Ravin and Hugo
    • Upcoming Events on Luma
    • Watch the podcast video on YouTube
    • 🎓 Learn more:

      • Hugo's course: Building LLM Applications for Data Scientists and Software Engineershttps://maven.com/s/course/d56067f338 ($600 off early bird discount for November cohort availiable until August 16)
      • ...more
        View all episodesView all episodes
        Download on the App Store

        Vanishing GradientsBy Hugo Bowne-Anderson

        • 5
        • 5
        • 5
        • 5
        • 5

        5

        11 ratings


        More shows like Vanishing Gradients

        View all
        Data Skeptic by Kyle Polich

        Data Skeptic

        477 Listeners

        a16z Podcast by Andreessen Horowitz

        a16z Podcast

        1,083 Listeners

        The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

        The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

        434 Listeners

        Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

        Super Data Science: ML & AI Podcast with Jon Krohn

        301 Listeners

        NVIDIA AI Podcast by NVIDIA

        NVIDIA AI Podcast

        341 Listeners

        DataFramed by DataCamp

        DataFramed

        268 Listeners

        Practical AI by Practical AI LLC

        Practical AI

        210 Listeners

        Google DeepMind: The Podcast by Hannah Fry

        Google DeepMind: The Podcast

        194 Listeners

        Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

        Machine Learning Street Talk (MLST)

        89 Listeners

        Dwarkesh Podcast by Dwarkesh Patel

        Dwarkesh Podcast

        489 Listeners

        No Priors: Artificial Intelligence | Technology | Startups by Conviction

        No Priors: Artificial Intelligence | Technology | Startups

        133 Listeners

        Latent Space: The AI Engineer Podcast by swyx + Alessio

        Latent Space: The AI Engineer Podcast

        97 Listeners

        AI + a16z by a16z

        AI + a16z

        33 Listeners

        High Signal: Data Science | Career | AI by Delphina

        High Signal: Data Science | Career | AI

        18 Listeners

        OpenAI Podcast by OpenAI

        OpenAI Podcast

        52 Listeners