Kubernetes Podcast from Google

In this episode, guest host and AI correspondent Mofi Rahman interviews Richard Liaw and Kai-Hsun Chen from Anyscale about Ray and KubeRay. Ray is an open-source unified compute framework that makes it easy to scale AI and Python workloads, while KubeRay integrates Ray’s capabilities into Kubernetes clusters.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• CNCF Blog - LitmusChaos audit complete!

• Kubernetes Podcast from Google episode 234 - LitmusChaos, with Karthik Satchitanand

• Google Cloud Blog - Run your AI inference applications on Cloud Run with NVIDIA GPUs

• Diginomica article - KubeCon China - at 33-and-a-third, Linux is a long player. So, why does Linus Torvalds hate AI?

• CNCF-Hosted Co-Located Event Schedule for KubeCon NA 2024 

• Google Kubernetes Engine Release Notes - August 20, 2024 (1.31 available in Rapid Channel)

• Kubernetes Podcast from Google - Kubernetes v1.31: "Elli", with Angelos Kolaitis

• Red Hat Press Release - Red Hat OpenStack Services on OpenShift is Now Generally Available

• Red Hat Enables OpenStack to Run Natively on OpenShift Platform

• Broadcom Revamps Tanzu to Simplify Cloud-Native App Development and Deployment

• Tanzu Platform 10 Offers Cloud Foundry Users Deep Visibility and Productivity Enhancements

• VMware Explore Conference Website

• CNCF Blog - Announcing 500 Kubestronauts

• CNCF - Kubestronaut FAQ

• Dapr Day 2024 Virtual Event Website

• Kai-Hsun Chen on LinkedIn

• Richard Liaw on LinkedIn

• Ray from the RISE Lab at UC Berkeley

• Ray: A Distributed System for AI by Robert Nishihara and Philipp Moritz - Jan 9, 2018

• KubeRay Docs

• KubeRay on GitHub

• PyTorch

• Apache Airflow

• Apache Spark

• Kubeflow

• Apache Submarine (retired)

• Jupyter Notebooks

• VS Code

• Examples of schedulers for Batch/AI workloads in Kubernetes

• Kueue

• Volcano

• Apache Yunikorn

• Examples of observability tools for Batch/AI workloads in Kubernetes

• Prometheus

• Grafana

• Fluentbit

• Examples of loadbalancers

• Nginx

• Istio

• Ray Data: Scalable Datasets for ML

• Dask Python - Parallel Python

• Ray Serve: Scalable and Programmable Serving

• HPA - Horizontal Pod Autoscaling in Kubernetes

• Karpenter - “Just-in-time nodes for any Kubernetes cluster”

• Lazy Computation Graphs with the Ray DAG API

• Types of hardware accelerators

• Google Cloud Tensor Processing Units (TPUs)

• AMD Instinct

• AMD Radeon

• AWS Trainium

• AWS Inferentia

• Pandas

• Numpy

• KubeCon EU 2024 - Accelerators(FPGA/GPU) Chaining to Efficiently Handle Large AI/ML Workloads in K8s - Sampath Priyankara, Nippon Telegraph and Telephone Corporation & Masataka Sonoda, Fujitsu Limited

• NVidia Megatron

• DRA - Dynamic Resource Allocation in Kubernetes

• Different ways of Running RayJob on Kubernetes

• Ray framework diagram in the docs

In this episode, we spoke to Karthik Satchitanand. Karthik is a principal software engineer at Harness and co-founder and maintainer of LitmusChaos, a CNCF incubated project. We talked about Chaos engineering , the Litmus project and more.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• Kubernetes 1.31 release blog

• Kubernetes 1.31 release episode of the Kubernetes Podcast from Google

• KubeCon NA 2024 Schedule

• Score accepted as a CNCF Sandbox Project

• LitmusChaos

• principlesofchaos.org

• Okteto

• LitmusChaosCon

• community.cncf.io

• Chaos Monkey

• Chapter 5 of “Chaos Engineering” by Casey Rosenthal, Nora Jones, published by O’Reilly, covers DiRT

• LitmusChaos ChaosHub

• Klustered on YouTube

• Rawkode Academy

Guest is Angelos Kolaitis, Angelos is a senior Software Engineer at Canonical working on Kubernetes. He has multiple contributions to open source projects, a highlight of which is his involvement in the Kubernetes Release Team since Kubernetes v1.26.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• Gemma2 2b

• AWS deprecates services

• Refreshing the KCD program: a new chapter in community building

• Angelos Kolaitis

• kubernetes 1.31 release blog

• Kat Cosgrove k8s 1.30 release lead

• Kubernetes 1.31 Removals and Major Changes

• KEP-3063 Dynamic Resource Allocation

• Completing the largest migration in Kubernetes history

Ohad Maislish is the CEO and co-founder of env0 and part of the founding team for the OpenTofu project. Before env0, Ohad was the CEO and founder of Arno Software, a cloud infrastructure services company, and Capester, a startup that empowered citizens in smart cities worldwide. Over the course of this career, Ohad has also served in different technical and management roles at Ravello Systems, eToro, and VMware. He was also the youngest developer at Microsoft Israel at the age of 17, after starting his bachelor's degree at the age of 14.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

The Kubernetes Removals and Major Changes blog for v1.31

Google Cloud Announced GKE Extended support

Bob Killen has joined as a Senior Technical Program Manager

Microsoft announced general availability of Microsoft Azure Container Storage

CNCF Glossary Turkish edition

Ohad Maislish

• LinkedIn

• Twitter/X

IaC Podcast

OpenTofu

OpenTofu Day

OpenTofu Manifesto

OpenTofu announcement

OpenTofu state encryption

OpenTofu 1.8 early evaluation of variables

ValKey

AWS Support for ValKey

KubeCon EU Co-lo: Atlantis and OpenTofu: The Future of Open-Source IaC

Abdel chatting on the IaC Podcast at kubeCon Paris 24

OpenTofu State and Plan Encryption

IaC Podcast

Mauricio Salatino is a software engineer at Diagrid working on the Dapr project but also serves as a chair for the newly formed App Development Working Group under the TAG App Delivery for the CNCF. He also serves as a member of the steering committee for Knative and the Keptn project.  Mauricio authored a book about Platform Engineering on Kubernetes for Manning and co-authored some books on Jboss. He used to work for Red Hat and VMware. 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• ArgoCD announced that ArgoRollouts now supports version 1.0 of the Kubernetes Gateway API

• Gateway API Supported providers

• Google has released Gemma 2

• Dapr (Distributed Application Runtime)

• JBoss

• Overview of JNDI (Java Naming and Directory Interface)

• Secrets Management Overview on Dapr

• Knative

• Java Spring Boot

• App Development Working Group (Cloud Native Computing Foundation)

• Spring AI

• Langchain

• Dapr and service meshes

• Istio

• Vcluster

• Testcontainers

Charity Majors is the co-founder and CTO of honeycomb.io. She pioneered the concept of modern Observability, drawing on her years of experience building and managing massive distributed systems at Parse (acquired by Facebook), then subsequently at Facebook, and at  Linden Lab building Second Life. She is the co-author of Observability Engineering and Database Reliability Engineering (O'Reilly). She loves free speech, free software and single malt scotch. 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• CNCF Blog: Vitess 20 is now Generally Available

• Vitess Blog: Announcing Vitess 20

• Anthropic Blog: Claude 3.5 Sonnet

• KubeCon India 2024 CFP

• Apps on Azure Blog: Announcing support of OCI v1.1 specification in Azure Container Registry

• VMware Tanzu Blog: Announcing VMware Tanzu Greenplum 7.2: Powering Your Business with Enhanced Performance and Advanced Capabilities

• VMware Tanzu Blog: Join the public beta for GenAI on Tanzu Platform today!

• CNCF: Adobe End User Journey Report

• Honeycomb.io

• O’Reilly Book: Observability Engineering

• O’Reilly Book: Database Reliability Engineering

• Charity’s blog site: charity.wtf

• Charity Blog: Questionable Advice: “My boss says we don’t need any engineering managers. Is he right?”

• Daniel H. Pink book: “Drive: The Surprising Truth About What Motivates Us”

• In which, “He examines the three elements of true motivation—autonomy, mastery, and purpose-and offers smart and surprising techniques for putting these into action in a unique book that will change how we think and transform how we live.”

• Charity blog on Stack Overflow: “Generative AI is not going to build your engineering team for you”

• In which she talks about how the tech industry is an apprenticeship industry.

• Charity Majors in the Google Cloud Next 2024 Developer Keynote

• honeycomb.io blog: “How Time Series Databases Work—And Where They Don't” by Alex Vondrak

• honeycomb.io blog: “Why Observability Requires a Distributed Column Store” by Alex Vondrak

• CNCF Kubernetes Community Days (KCDs)

• CNCF Kubernetes Community Days (KCDs) on GitHub

• Julia Evans Blog

• Wizard Zines by Julia Evans

• “Help! I Have a Manager!” zine by Julia Evans

• Aja Hammerly aka “thagomizer” blog

• “The Toaster Parable”

• “Manager Toolkit: Manage The Person In Front Of You”

• “Manager Toolkit: Useful Manager Phrases for 1:1s”

• “Manager Toolkit: You Talk, I Type”

In this episode, we talk to three active leaders who have been around since the very beginning of Kubernetes. We explore how Kubernetes has changed since its inception, with a particular focus on current efforts in Open source Kubernetes to support AI/ML style workloads.

Maciej Szulik is currently taking a seat in the Kubernetes Steering Committee. He’s also leading Special Interests Groups responsible for kubectl, workload and batch controllers. Maciej has been contributing to Kubernetes since the early days, jumping from one area to another where help was needed. He authored the first version of audit and helped shape its current one, as well as touched multiple other places in apimachinery. He was also responsible for designing and implementing Job and CronJob controllers. In kubectl he was responsible for the plugin mechanism and several major refactors to simplify the code. Since May 2024 he joined the ranks of Production Readiness Review (PRR) approvers helping ensure high production standards for the future of Kubernetes releases. 

Clayton Coleman is a long-time Kubernetes contributor, having helped launch Kubernetes as open source, being on the bootstrap steering committee, and working across a number of SIGs to make Kubernetes a reliable and powerful foundation for workloads.  At Red Hat he led OpenShift’s pivot onto Kubernetes and its growth across on-premise, edge, and into cloud.  At Google he is now focused on enabling the next generation of key workloads, especially AI/ML in Kubernetes and on GKE.

Dawn Chen has been a Principal Software Engineer at Google cloud since May 2007. Dawn has worked on an open source project called Kubernetes before the project was founded. She has been one of tech leads in both Kubernetes and GKE, and founded SIG Node from scratch. She also led Anthos platform team for the last 4 years, and mainly focuses on the core infrastructure. Prior to Kubernetes, she was the one of the tech leads for Google internal container infrastructure -- Borg for about 7 years. Outside of work, she is a wife, a mother of a 16-year old boy and a good friend. She enjoys reading, cooking, hiking and traveling.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

• Kubernetes 1.31 Code Freeze is on July 9th

• Kubernetes Working Group Batch

• Kubernetes Working Group Serving

• Blog: Introducing Indexed Jobs (2021)

• Docs: Kubernetes Jobs

• KEP: Elastic Indexed Jobs

• Docs: Kubernetes CronJobs

• KubeCon EU 2021: The Long, Winding and Bumpy Road to CronJob’s GA - Maciej Szulik, Red Hat & Alay Patel, Red Hat

• KubeCon EU 2018: Writing Kube Controllers for Everyone - Maciej Szulik, Red Hat (Beginner Skill Level)

• Kubernetes Working Group Device Management

• Kubernetes Enhancement Proposal process README

• DockerCon 2014: The announcement of Kubernetes at DockerCon

• Blog: AI & Kubernetes (by Kaslin)

• Kueue - “Kueue is a cloud-native job queueing system for batch, HPC, AI/ML, and similar applications in a Kubernetes cluster.”

• Whitepaper: Large-scale cluster management at {Google} with {Borg}

• Email: “Containers: Introduction” - An email introducing the concept of Linux containers to the Linux community

• Blog - “Scaling Kubernetes to 7,500 nodes” - OpenAI

• Ray on Kubernetes

We talk with Nikhita Raghunath, Nabarun Pal, and Paco Xu. Nikhita, Nabarun, and Paco have each held various leadership positions related to the Kubernetes project. They talk about their journeys, the various leadership roles they’ve been in, and offer advice for new contributors and those who want to move into leadership in the project.

Nikhita is a Staff Software Engineer at Broadcom. She is currently a member of the CNCF Technical Oversight Committee (TOC) overseeing all technical matters of the CNCF. In the past, she was a member of the Kubernetes Steering Committee, a technical lead for SIG Contributor Experience and has also won the CNCF Top Committer Award. Currently, she is also a co-chair of the KubeCon+CloudNativeCon conference.

Nabarun is a Staff Software Engineer at Broadcom, a maintainer of the Kubernetes project, a member of the Kubernetes Steering Committee and a chair of Kubernetes SIG Contributor Experience. In the past, he was the release lead for Kubernetes 1.21 and has served eight release teams. Nabarun also works actively with the Python community by organizing PyCon India and has been recognized in media publications for his work.

Paco is an open source team lead in DaoCloud. He started to work on container/docker in 2016 and later started to participate in the Kubernetes Community in 2018. He is a current member of Kubernetes Steering Committee and works mainly on kubeadm and sig-node. He is Co-chair of KubeCon+CloudNativeCon China 2024.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

Blog: 10 Years of Kubernetes

CNCF-Hosted Co-Located Events Overview

CFP for CNCF-hosted Co-located Events

Kubernetes Community Days

CNCF Technical Oversight Committee

SIG ContribEx

Google Summer of Code

CNCF Top Committer Award 2021 - Nikhita Raghunath

Blog Post: Google Summer of Code with Kubernetes by Nikhita Raghunath

Kubernetes Docs: Extend the Kubernetes API with CustomResourceDefinitions

SIG API Machinery

SIG Testing

SIG Release

CNCF Chop Wood Carry Water Award 2018 - Nikhita Raghunath

Kubernetes Steering Committee

KubeCon India

KubeCon NA

Kubernetes 1.21: Power to the Community

Pycon India

Kubernetes Python Client on GitHub

Kubernetes Contributor Summit 2019 YouTube Playlist

Kubernetes Release Team

KubeCon NA 2024 Scholarships (applications due by September 1, 2024)

Kubeadm

SIG Node

KubeCon China 2024

Kubelet

Kubernetes Production Readiness Review Process

Kubernetes Release Team CI Signal Lead Runbook

Welcome to the second episode of the 4 part special series for the Kubernetes 10 year anniversary. In this episode we spoke to two very influential people in Kubernetes’ history. Tim Hockin and Kelsey Hightower Both have been involved with the project since its inception and both had, and continue to have, impact on the project and the community.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

KuberTenes Regional Events

Kubernetes Twitter Account

Kubernetes introduces hydrophone

AKS Automatic

CKS Changes after Sept 12, 2024

KubeCon and CloudNativeCon CFP Closes June 9th

KubeCon Co-Located events CFP Closes June 14, 2024

Google Borg

Google Omega

Let Me Contain That For You

Kubernetes Sidecars

Why Service Is the Worst API in Kubernetes

Kubernetes Maintainers Read Mean Comments

Kubernetes The Hard Way

Kelsey retirement announcement

Redpanda

Crossplane

Llama 3

Open-core model

Lets Encrypt

Google's infrastructure for everyone else

Kubernetes: Up and Running

CNI

Kubernetes Networking

Kubernetes Resource Model (KRM)

This episode is the first in our four-part Kubernetes 10 Years Anniversary special! The focus of this episode is on Kubernetes maintainers who have been involved with the project since its early days, and who are still active today. Featuring guests: David Eads, Davanum Srinivas (Dims), and Federico Bongiovanni.

David is a senior principal software engineer at Red Hat.  He started contributing to Kubernetes before v1 and now serves as a sig-auth tech lead and sig-apimachinery tech lead and chair.

Dims is a principal engineer at AWS, long term contributor to Kubernetes who served in multiple committees for the project. Today dims is in the Technical Oversight Committee or TOC. Welcome to the show Dims!

Federico Bongiovanni is an engineering manager at Google. He started using Kubernetes in the early days at a previous company, and became a contributor about 6 years ago when he joined Google. Today, he’s a Co-chair of SIG-APIMachinery. Welcome to the show! Would you like to tell us more about yourself?

Do you have something cool to share? Some questions? Let us know:

- web: [kubernetespodcast.com](https://kubernetespodcast.com)

- mail: [[email protected]](mailto:[email protected])

- twitter: [@kubernetespod](https://twitter.com/kubernetespod)

https://istio.io/latest/news/releases/1.22.x/announcing-1.22/

https://kubernetes.io/blog/2024/05/09/gateway-api-v1-1/

https://traefik.io/blog/traefik-3-0-ga-has-landed-heres-how-to-migrate/

https://devblogs.microsoft.com/dotnet/dotnet-build-2024-announcements/

https://events.linuxfoundation.org/kuber10es-birthday-bash/

https://www.cncf.io/kubertenes/

Kubernetes SIG Auth

Kubernetes SIG API Machinery

Automagic kubectl config merging causes hair loss

Safety or Usability: Why Not Both? Towards Referential Auth in K8s - Rob Scott, Google & Mo Khan, Microsoft

Open Stack

Kubernetes Cloud Provider OpenStack

RedHat OpenShift

Kubernetes SIG Architecture

Kubernetes Kubelet

Blog: Completing the Largest Migration in Kubernetes History

Dims’ PR removing over 1 million lines of Cloud Provider code from Kubernetes

KubeCon EU 2024 talk: Kubernetes Is FINALLY Removing in-Tree Cloud Providers - Bridget Kromhout & Chris Privitere

KEP-2395: Removing In-Tree Cloud Provider Code

Blog from 2019 about the reasoning behind the removal of cloud provider code

Blog about setting cloud provider code to disabled by default in v1.29

The March 2024 Spotlight blog on SIG Cloud Provider

Kubernetes Maintainers Read Mean Comments - Tim Hockin, Google & Davanum Srinivas, Amazon Web Services

“Working in Public: The Making and Maintenance of Open Source Software” by Nadia Eghbal

Keynote: A Vision for Vision - Kubernetes in Its Second Decade - Tim Hockin

SIG K8s Infrastructure