In this episode, I chat with a powerhouse combo of Kelsey Hightower and Jérôme Petazzoni, who's combined influence in the container space can not be overstated. I was a bit nervous for this one, having such big stars on the show n' all, but I think it went great as we dove into various Kubernetes and container topics. This is surely "one for the books"! ★Show Links★[Sponsor] Manning Publications, get 40% off your first book or video order at manning.com with coupon  poddocdev19 (enter at checkout)Bret's Docker and Kubernetes CoursesKelsey Hightower KubeCon 2019 US KeynoteKelsey's Tweet On Future of K8sHerokuArrested DevOps Podcast Kelsey Hightower EpisodeGoogle Cloud Run​Docker In DockerAquasecurity TrivySnykKelsey's TwitterJerome's Twitter

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news! Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Kubernetes Future with Kelsey Hightower and Jérôme Petazzoni

Interviews from Bret Fisher's live show with co-host Nirmal Mehta. Topics cover container and cloud topics like Docker, Kubernetes, Swarm, Cloud Native development, DevOps, SRE, GitOps, DevSecOps, platform engineering, and the full software lifecycle. Full show notes and more info available at https://podcast.bretfisher.com

Tech News

Technology

Education

Training

Language Courses

Higher Education

K-12

Educational Technology

News

How To

Bret and Nirmal are joined by friend of the show, Matt Williams, to learn how to run your own local ChatGPT clone and GitHub Copilot clone with Ollama and Docker's "GenAI Stack," to build apps on top of open source LLMs. We've designed this conversation for tech people like myself, who are no strangers to using LLMs in web products like chat GPT, but are curious about running open source generative AI models locally and how they might set up their Docker environment to develop things on top of these open source LLMs. 
Matt Williams is walking us through all the parts of this solution, and with detailed explanations, shows us how Ollama can make it easier on Mac, Windows, and Linux to set up LLM stacks. Be sure to check out the live recording of the complete show from April 18, 2024 on YouTube (Ep. 262).   ★Topics★ Creators & Guests
  Cristi Cotovan - Editor
  Beth Fisher - Producer
  Bret Fisher - Host
  Matt Williams - Host
  Nirmal Mehta - Host

(00:00) - Intro
(01:32) - Understanding LLMs and Ollama
(03:16) - Ollama's Elevator Pitch
(08:40) - Installing and Extending Ollama
(17:17) - HuggingFace and Other Libraries
(19:24) - Which Model Should You Use?
(26:28) - Ollama and Its Applications
(28:57) - Retrieval Augmented Generation (RAG)
(36:44) - Deploying Models and API Endpoints
(40:38) - DockerCon Keynote and LLM Demo
(47:44) - Getting Started with Ollama


You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news! Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Local GenAI LLMs with Ollama and Docker

Bret is joined by Jasper Paul and Vinoth Kanagaraj, observability experts and Site24x7 Product Managers, to discuss achieving end-to-end visibility for applications on Kubernetes infrastructure. We answer questions on all things monitoring, OpenTelemetry, and KPIs for DevOps and SREs. 
We talk about the industry's evolution from monitoring to full observability platforms, as well as adjacent topics for helping you with your own Kubernetes and application monitoring, including going through some of the most useful metrics in Kubernetes and AI's role in metric analysis and alerting humans. Be sure to check out the live recording of the complete show from April 25, 2024 on YouTube (Ep. 263). Includes demos. ★Topics★
Site24x7 Full stack observability
Site24x7 Kubernetes monitoring
Voting App Creators & Guests
  Cristi Cotovan - Editor
  Beth Fisher - Producer
  Bret Fisher - Host
  J.P. Jasper - Guest

(00:00) - Intro
(02:01) - Observability vs Monitoring
(08:32) - The New App Health Layer
(14:39) - Attributes Collected
(17:47) - Unified Observability
(19:00) - AI-Powered Insights: The Role of AIOps
(21:51) - OpenTelemetry and Multi-Cluster Monitoring
(25:45) - Windows Support
(26:06) - Correlating Requests Between Microservices
(28:14) - Synthetic vs Real-Time Monitoring
(30:25) - Dashboards, Tracing and Metrics
(37:17) - Getting Started


You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news! Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Kubernetes Observability with Site24x7

Bret and Nirmal are joined by Neil Cresswell and Steven Kang from Portainer to look at K2D, a new project that enables us to leverage Kubernetes tooling to manage Docker containers on tiny devices at the far edge. 
K2D stands for Kubernetes to Docker, which is a bit of a crazy idea -- it's a partial Kubernetes API running on top of Docker Engine without needing a full Kubernetes control plane. If you work with very small devices, including older Raspberry PIs, 32-bit machines, maybe industry sensors and the infrastructure we now call 'edge', the container hardware is often hard for you to make simple, reliable, and automated all at the same time.  So this project uses less resources than a single node K3S and still allows you to use Kubernetes tools to deploy and manage your containers, which are in fact just running on a Docker Engine with no full-fledged Kubernetes distribution going on there. We get into far more detail on the architecture, the Portainer team's motivations for this new open source project and what its limitations are, because it's not real Kubernetes, so it can't do everything. Be sure to check out the video version of this episode for any demos. This episode is from our YouTube Live show on March 28, 2024 (Ep. 260). ★Topics★
K2D website
K2D Docs Creators & Guests
  Cristi Cotovan - Editor
  Beth Fisher - Producer
  Bret Fisher - Host
  Neil Cresswell - Guest
  Nirmal Mehta - Host
  Steven Kang - Guest

(00:00) - Intro
(02:40) - Introducing the guests
(03:56) - Why K2D? Architecture and Motivations
(05:55) - How Efficient is K2D?
(10:25) - K2D Architecture Explained: Components and Operations
(20:42) - What Happens When Resources are Exhausted?
(23:18) - K2D for Edge Deployment with Portainer or Argo CD
(28:22) - K2D Future Roadmap
(30:36) - Getting Started with K2D


You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news! Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

K2D by Portainer

Bret and Nirmal are joined by Dan Lorenc from Chainguard to walk them through Chainguard's approach to building secure, minimal container images for popular open source software. 
They discuss why it is important to have secure and minimal container images. Dan explains how Chainguard helps remove the pain of CVEs, laggy software updates and patches and much more. Chainguard is now available also on Docker Hub. They spend the first part of the show talking about the week's big news: the XZ supply chain attack, and Dan was the best man to explain it. They also touch on CVEs, things you can do to reduce the attack surface, SLSA, and more during this jam-packed show. Be sure to check out the live recording of the complete show from April 4, 2024 on YouTube (Ep. 261). ★Topics★
Chainguard Website 
Vulnerability Management Certification course 
True Cost of Vulnerability Management 
Chainguard Images 
Chainguard on Docker Hub Announcement Creators & Guests
  Cristi Cotovan - Editor
  Beth Fisher - Producer
  Bret Fisher - Host
  Nirmal Mehta - Host
  Dan Lorenc - Guest

(00:00) - Intro
(05:14) - Dan's Take on the XZ Hack
(14:59) - Chainguard Distro Creation
(21:21) - Chainguard in Docker Hub Announcement
(24:26) - Free Images vs Private Images
(26:27) - Zero CVE Approach
(28:33) - Ways to Reduce Attack Surfaces
(39:56) - Chainguard Academy
(41:08) - Real Time Antivirus Malware Scanner
(43:52) - Google Distro Lists Worth Using
(45:56) - Chainguard for Buildpacks
(46:20) - SLSA
(56:08) - What's Next for Chainguard?
(56:52) - Getting Started with Chainguard


You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news! Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Chainguard: Building Secure Container Images

Bret and Nirmal are joined by Phil Estes of AWS to show us the Finch project, which bundles the best open source tools for building and running containers locally. Now it runs on macOS and Windows WSL2. 
We've been talking with Phil about this show for months, and now that Finch has come to Windows, we thought it was the best time to clue you in as to why AWS created the Finch project and what it does.  You've probably heard of containerd, the most popular container runtime on the planet and BuildKit, the best way, in my opinion, to build container images. Those two work hand in hand in Docker and many other container tools. But you might not have heard of nerdctl or Lima, which are also open source tools that work with containerd and BuildKit to help you run containers locally in a virtual machine. Well, AWS had the idea of making an easy installer for these four tools. That's how Finch was born.  Finch is not meant to be a replacement of your existing way to run containers. The tools it installs are a bit of a minimum feature set, if you will, and more focused on providing people the exact tools AWS uses in its container platforms, mainly containerd and BuildKit, which are everywhere in AWS. Rather than building something that's feature equivalent to other local container solutions like Docker Desktop and Rancher Desktop, Finch keeps it simple and does the bare minimum.   If you just want an easily installable and minimal way to build and run local containers at the command line with no goofy, high-end fancy features, pure open source and just on Mac and Windows, at least at this point, you should give Finch a try. Be sure to check out the live recording of the complete show from February 22, 2024 on YouTube (Ep. 255). ★Topics★
Finch Website
Bret's local container runtime spreadsheet Creators & Guests
  Phil Estes - Guest
  Cristi Cotovan - Editor
  Beth Fisher - Producer
  Bret Fisher - Host
  Nirmal Mehta - Host

(00:00) - Intro
(00:35) - What is Finch?
(03:53) - Phil's History with Docker and Finch
(07:59) - Deep Dive into AWS Finch Project
(11:41) - How do the Components Tie Together
(25:31) - Finch's Position in the Container Ecosystem
(26:47) - Finch's Capabilities and Comparisons
(27:45) - VM Management and Lima Integration
(37:51) - Finch's Roadmap and Community Engagement
(41:49) - How Does Finch Connect to Lima?
(42:45) - Potential Lima Conflicts with Finch
(46:38) - Getting Started wtih Finch


You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news! Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Kubernetes Future with Kelsey Hightower and Jérôme Petazzoni

Download our free app to listen on your phone