Kubernetes Podcast from Google

Guests are Maciej Rozacki, Product Manager on GKE for AI Training, and Wojciech Tyczyński, Software Engineer on the GKE team at Google. We explore what it means for GKE to support 65k nodes, and the open source contributions that made this possible

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

The Kubernetes Podcast is on Bluesky

OpenTelemetry expanding into CI/CD observability

Gitpod is moving away from Kubernetes

OpenCost is a CNCF Incubated project

Guests:

• Maciek

• Wojciech

Kubernetes OSS Scalability thresholds

PGS on the Kubernetes Podcast

Batch Working Group

Serving Working Group episode on the podcast

Dynamic Resource Allocation

Kueue

Multitenancy and Fairness at Scale with Kueue

SIG Scalability

Consistent Reads from Cache

Kubernetes Scalability: A Multi-Dimensional Analysis

Yuan is a principal software engineer at Red Hat, working on OpenShift AI. Previously, he has led AI infrastructure and platform teams at various companies. He holds leadership positions in open source projects, including Argo, Kubeflow, and Kubernetes WG Serving. Yuan authored three technical books and is a regular conference speaker, technical advisor, and leader at various organizations.

Eduardo is an environmental engineer derailed into a software engineer. Eduardo has been working on making containerized environments the de facto solution for High Performance Computing(HPC) for over 8 years now. Began as a core contributor to the niche Singularity Containers, today known as Apptainer under the Linux foundation. In 2019 Eduardo moved up the ladder to work on making Kubernetes better for performance oriented applications. Nowadays Eduardo works at NVIDIA on the Core Cloud Native team working on enabling specialized accelerators into Kubernetes workloads.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

Docker official terraform provider

Tetrate and Bloomberg Envoy AI Gateway 

KubeCon+CloudNativeCon North America 2024 laptop drive

Remaining KCDs for 2024

Yuan Tang

Eduardo ArangoWG Serving

Kserve

Kserve Serving models with OCI images

LLM Gateway

Dynamic Resources Allocation

This episode is special. We collaborated with the folks behind the Cloud Security Podcast from Google, Anton Chuvakin(LinkedIn)and Tim Peacock, to bring you a joint episode. We had the pleasure to jointly interview Michelle Chubirka, a Cloud Security Developer Advocate. We talked about VM and Container security, debunked some myths about isolation, attack surfaces, immutability of containers, and more.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• Nvidia NIM on GKE

• Kubernetes Steering Committee Election Results for 2024

• The schedule for KubeCon and CloudNativeCon India

• Diagrid Catalyst Beta

• Dapr on the Kubernetes Podcast with Salaboy

• Cloud Security Podcast

• Anton Chuvakin

• Tim Peacock

• Michelle Chubirka

• Dora report

• Container Security: It’s All About the Supply Chain - Michele Chubirka

• Software composition analysis (SCA)

• DevSecOps Decisioning Principles

• Kubernetes CIS Benchmark

• Cloud-Native Consumption Principles

• State of WebAssembly outside the Browser - Abdel Sghiouar

• Why Perfect Compliance Is the Enemy of Good Kubernetes Security - Michele Chubirka - KubeCon NA 2024

• Cloud Code

• Skaffold

• Introduction to Distributed ML Workloads with Ray on Kubernetes - Mofi Rahman & Abdel Sghiouar - KubeCon NA 2024

Marvin Beckers is a Team Lead at Kubermatic and a contributor and maintainer of the CNCF Sandbox Project, KCP. KCP is an open source horizontally scalable control plane for Kubernetes-like APIs.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• [Docker Blog] Announcing Upgraded Docker Plans: Simpler, More Value, Better Development and Productivity 

• [LinuxFoundation Blog] Linux Foundation Announces Intent to Form Developer Relations Foundation

• [Computer Weekly Article] NetApp Insight 2024 - Live show report: day zero

• KCP

• Kubernetes Resource Model (KRM)

• Crossplane

• Cloud Native Maturity Model

Guests are Avin Regmi and David Xia from Spotify. We spoke to Avin and David about their work building Spotify’s Machine Learning Platform, Hendrix. They also specifically talk about how they use Ray to enable inference and batch workloads. Ray was featured on episode 235 of our show, so make sure you check out that episode too.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

IBM acquired Kubecost

KubeCon Japan in 2025

Call for Proposals for KubeCon EU 2025 is now open

Artifact Hub is a CNCF incubating project

OpenMetrics is dead, long live OpenMetrics

Kubecolor 0.4.0

Avin Regmi

David Xia

Hendrix ML Platform

Ray on Kubernetes

KubeRay

Workbench instances

Backstage

PyTorch

Ray Summit 2024

Kueue

Solomon Hykes is the co-founder of Dagger. He is probably best known as the creator of Docker. The tool that changed how developers package, run and distribute software in the last 11 years. His impact on our industry is undeniable. Today, we discuss his new venture, Dagger. Dagger is a new approach to how we do CI/CD.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• Kubeadm v1beta4

• 1.32 Release Cycle Info

• Updates to the Certified Kubernetes Administrator Exam

• 2024 Generative AI Survey

• Microsoft Azure Advanced Container Networking enhancements

• Solomon Hykes on LinkedIn

• Dagger

• OpenStack

• Act (GitHub Actions Locally)

• Buildkit

• Cue

• GraphQL

• Dagger Discord

• Caching - Dagger Documentation

• Bazel

• Terraform

• Pulumi

• Kubectl

• gRPC

• GraphQL

• Google Cloud’s Package Index

• The Daggerverse

• Cloud Foundry

• PostHog

• RedHat Development Model

• Scaffold

• Solomon Hykes - Docker, Dagger, and the Future of DevOps

• Directed Acyclic Graphs

• Solomon Hykes on wikipedia

• Stack Overflow

In this episode, guest host and AI correspondent Mofi Rahman interviews Richard Liaw and Kai-Hsun Chen from Anyscale about Ray and KubeRay. Ray is an open-source unified compute framework that makes it easy to scale AI and Python workloads, while KubeRay integrates Ray’s capabilities into Kubernetes clusters.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• CNCF Blog - LitmusChaos audit complete!

• Kubernetes Podcast from Google episode 234 - LitmusChaos, with Karthik Satchitanand

• Google Cloud Blog - Run your AI inference applications on Cloud Run with NVIDIA GPUs

• Diginomica article - KubeCon China - at 33-and-a-third, Linux is a long player. So, why does Linus Torvalds hate AI?

• CNCF-Hosted Co-Located Event Schedule for KubeCon NA 2024 

• Google Kubernetes Engine Release Notes - August 20, 2024 (1.31 available in Rapid Channel)

• Kubernetes Podcast from Google - Kubernetes v1.31: "Elli", with Angelos Kolaitis

• Red Hat Press Release - Red Hat OpenStack Services on OpenShift is Now Generally Available

• Red Hat Enables OpenStack to Run Natively on OpenShift Platform

• Broadcom Revamps Tanzu to Simplify Cloud-Native App Development and Deployment

• Tanzu Platform 10 Offers Cloud Foundry Users Deep Visibility and Productivity Enhancements

• VMware Explore Conference Website

• CNCF Blog - Announcing 500 Kubestronauts

• CNCF - Kubestronaut FAQ

• Dapr Day 2024 Virtual Event Website

• Kai-Hsun Chen on LinkedIn

• Richard Liaw on LinkedIn

• Ray from the RISE Lab at UC Berkeley

• Ray: A Distributed System for AI by Robert Nishihara and Philipp Moritz - Jan 9, 2018

• KubeRay Docs

• KubeRay on GitHub

• PyTorch

• Apache Airflow

• Apache Spark

• Kubeflow

• Apache Submarine (retired)

• Jupyter Notebooks

• VS Code

• Examples of schedulers for Batch/AI workloads in Kubernetes

• Kueue

• Volcano

• Apache Yunikorn

• Examples of observability tools for Batch/AI workloads in Kubernetes

• Prometheus

• Grafana

• Fluentbit

• Examples of loadbalancers

• Nginx

• Istio

• Ray Data: Scalable Datasets for ML

• Dask Python - Parallel Python

• Ray Serve: Scalable and Programmable Serving

• HPA - Horizontal Pod Autoscaling in Kubernetes

• Karpenter - “Just-in-time nodes for any Kubernetes cluster”

• Lazy Computation Graphs with the Ray DAG API

• Types of hardware accelerators

• Google Cloud Tensor Processing Units (TPUs)

• AMD Instinct

• AMD Radeon

• AWS Trainium

• AWS Inferentia

• Pandas

• Numpy

• KubeCon EU 2024 - Accelerators(FPGA/GPU) Chaining to Efficiently Handle Large AI/ML Workloads in K8s - Sampath Priyankara, Nippon Telegraph and Telephone Corporation & Masataka Sonoda, Fujitsu Limited

• NVidia Megatron

• DRA - Dynamic Resource Allocation in Kubernetes

• Different ways of Running RayJob on Kubernetes

• Ray framework diagram in the docs

In this episode, we spoke to Karthik Satchitanand. Karthik is a principal software engineer at Harness and co-founder and maintainer of LitmusChaos, a CNCF incubated project. We talked about Chaos engineering , the Litmus project and more.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• Kubernetes 1.31 release blog

• Kubernetes 1.31 release episode of the Kubernetes Podcast from Google

• KubeCon NA 2024 Schedule

• Score accepted as a CNCF Sandbox Project

• LitmusChaos

• principlesofchaos.org

• Okteto

• LitmusChaosCon

• community.cncf.io

• Chaos Monkey

• Chapter 5 of “Chaos Engineering” by Casey Rosenthal, Nora Jones, published by O’Reilly, covers DiRT

• LitmusChaos ChaosHub

• Klustered on YouTube

• Rawkode Academy

Guest is Angelos Kolaitis, Angelos is a senior Software Engineer at Canonical working on Kubernetes. He has multiple contributions to open source projects, a highlight of which is his involvement in the Kubernetes Release Team since Kubernetes v1.26.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• Gemma2 2b

• AWS deprecates services

• Refreshing the KCD program: a new chapter in community building

• Angelos Kolaitis

• kubernetes 1.31 release blog

• Kat Cosgrove k8s 1.30 release lead

• Kubernetes 1.31 Removals and Major Changes

• KEP-3063 Dynamic Resource Allocation

• Completing the largest migration in Kubernetes history

Ohad Maislish is the CEO and co-founder of env0 and part of the founding team for the OpenTofu project. Before env0, Ohad was the CEO and founder of Arno Software, a cloud infrastructure services company, and Capester, a startup that empowered citizens in smart cities worldwide. Over the course of this career, Ohad has also served in different technical and management roles at Ravello Systems, eToro, and VMware. He was also the youngest developer at Microsoft Israel at the age of 17, after starting his bachelor's degree at the age of 14.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

The Kubernetes Removals and Major Changes blog for v1.31

Google Cloud Announced GKE Extended support

Bob Killen has joined as a Senior Technical Program Manager

Microsoft announced general availability of Microsoft Azure Container Storage

CNCF Glossary Turkish edition

Ohad Maislish

• LinkedIn

• Twitter/X

IaC Podcast

OpenTofu

OpenTofu Day

OpenTofu Manifesto

OpenTofu announcement

OpenTofu state encryption

OpenTofu 1.8 early evaluation of variables

ValKey

AWS Support for ValKey

KubeCon EU Co-lo: Atlantis and OpenTofu: The Future of Open-Source IaC

Abdel chatting on the IaC Podcast at kubeCon Paris 24

OpenTofu State and Plan Encryption

IaC Podcast