DevOps and Docker Talk: Cloud Native Interviews and Tooling

Is Docker Building the Best AI Stack?


Listen Later

Bret and Nirmal are joined by Michael Irwin to discuss Docker's comprehensive AI toolkit, covering everything from local model deployment to cloud-based container orchestration across multiple interconnected tools and services.

😇 My new GitHub Security workshop has launched! A free 2-hour workshop with hands-on labs to harden your repos and your workflows from common supply chain attacks. I'll cover how attackers are getting in, and then we'll lock down a sample repo so you know what needs to be done to protect your code. You'll leave with a deep understanding of risks and mitigations as well as a list of helpful tools to keep your repos safe, including my new "gasa" tool for scanning your repos and orgs.


We run through almost the entire Docker AI ecosystem, including the Model Runner for hosting open-source models locally or remotely, the Hub model catalog, Gordon AI chatbot integration within Docker Desktop and CLI, how MCP toolkit and catalog enable seamless tool integration with local AI systems, Docker's open-source MCP gateway for managing these connections, plus Docker's new Offload service for running containers and models entirely in Docker Cloud and much, much more!

★Show Links★
Docker Model Runner
Gordon AI Blog Post
Docker Offload
Docker Gen AI Catalog
Docker MCP Catalog and Toolkit
Docker MCP Gateway Repository

Check out the video podcast version here: https://youtu.be/dUmSsnc33O0

Creators & Guests

  • Cristi Cotovan - Editor
  • Bret Fisher - Host
  • Beth Fisher - Producer
  • Nirmal Mehta - Host
  • Michael Irwin 🇺🇦 🕊 - Guest
  • You can also support this podcast by subscribing to my YouTube channel and my monthly newsletter at bret.news!

    Grab the best coupons for my GitHub, Agents, Docker, and Kubernetes courses.
    Join my cloud native DevOps community on Discord.
    Grab some merch at Bret's Loot Box
    Homepage bretfisher.com

    • (00:00) - Intro
  • (04:32) - Gordon AI
  • (09:41) - Docker Model Runner
  • (19:34) - State of Free Models
  • (22:11) - MCP Toolkit
  • (24:39) - MCP Gateway
  • (33:45) - MCP Server Limits
  • (38:31) - MCP Gateway vs API Gateway
  • (46:11) - Model Support in Docker Compose
  • (51:00) - Docker Offload
  • ...more
    View all episodesView all episodes
    Download on the App Store

    DevOps and Docker Talk: Cloud Native Interviews and ToolingBy Bret Fisher

    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    54 ratings


    More shows like DevOps and Docker Talk: Cloud Native Interviews and Tooling

    View all
    The Joe Rogan Experience by Joe Rogan

    The Joe Rogan Experience

    228,383 Listeners

    All Ears English Podcast by Lindsay McMahon and Michelle Kaplan

    All Ears English Podcast

    2,237 Listeners

    The Daily by The New York Times

    The Daily

    111,948 Listeners

    Agentic DevOps : AI Engineering for Infrastructure by Bret Fisher

    Agentic DevOps : AI Engineering for Infrastructure

    2 Listeners