DevOps and Docker Talk: Cloud Native Interviews and Tooling

Kubernetes Autoscaling with Karpenter

Listen Later

😇 My new GitHub Security workshop has launched! A free 2-hour workshop with hands-on labs to harden your repos and your workflows from common supply chain attacks. I'll cover how attackers are getting in, and then we'll lock down a sample repo so you know what needs to be done to protect your code. You'll leave with a deep understanding of risks and mitigations as well as a list of helpful tools to keep your repos safe, including my new "gasa" tool for scanning your repos and orgs.


Bret is joined by Nirmal Mehta, a Principal Specialist Solution Architect at AWS, and a Docker Captain, to discuss Karpenter, an autoscaling solution launched by AWS in 2021. Karpenter simplifies Kubernetes infrastructure by automating node scaling up and down, giving you "the right nodes at the right time."

Autoscaling, particularly for Kubernetes, can be quite a complex project when you first start. Bret and Nirmal discuss how Karpenter works, how it can help or complement your existing setup, and how autoscaling generally works.

Streamed live on YouTube on June 9, 2022.


Unedited live recording of this show on YouTube (Ep #173). Includes demos.


★Topics★
Starship Shell Prompt
Bret's favorite shell setup
Karpenter
Karpenter release blog
K8s Scheduling Concepts

Other types of autoscalers:
Horizontal Pod Autoscaler
Vertical Pod Autoscaler
Cluster Autoscaler


★Nirmal Mehta★
Nirmal on Twitter
Nirmal on LinkedIn


★Join my Community★
Best coupons for my Docker and Kubernetes courses

Chat with us on our Discord Server Vital DevOps

Homepage bretfisher.com

  • (00:00) - DDT MAIN
  • (00:04) - Intro
  • (00:51) - Custom intro
  • (02:08) - Main Show
  • (02:12) - Introductions
  • (03:12) - Nirmal's Jobs
  • (03:58) - Talking about Kubernetes cluster scaling
  • (05:04) - Who are we addressing?
  • (06:29) - What is Karpenter not addressing?
  • (06:52) - Auto-scaling at pod level
  • (07:40) - Cluster auto-scaling
  • (09:07) - Karpenter is alternate to cluser autoscaler
  • (09:21) - Question
  • (10:11) - Issues Karpenter was created to address
  • (12:29) - What is Karpenter?
  • (13:51) - Selective instance type provisioning
  • (14:47) - Matching deployment definition to instance types
  • (16:08) - Question: Is Karpenter designed only for AWS?
  • (17:13) - Question: Can you auto-scale control plane nodes?
  • (19:21) - The Kubernetes Scheduler
  • (23:14) - Question: Does Karpenter auto-scale down?
  • (25:05) - Question: EKS with Karpenter spot instances
  • (25:58) - Question: Karpenter and AWS auto-scaling groups
  • (26:10) - Question: Installation and provisioning
  • (27:20) - Only affects unschedulable pods
  • (28:49) - Demo intro
  • (29:14) - Demo
  • (29:19) - Scaling Down
  • (30:27) - Keeping your nodes fresh
  • (32:54) - If you want to learn more
  • (33:23) - Goals for 2022
  • (34:15) - Questions
  • (34:21) - Question: Cost-effective instances
  • (35:35) - Question: Instances to IoC and automatically destroyed?
  • (38:25) - Question: Features being pushed upstream into Kubernetes
  • (40:28) - Question: Rebalancing
  • (44:28) - Scaling down is hard too
  • (46:18) - Question: Horizontal pod auto-scaler trigger Karpenter
  • (47:25) - Question: Specs and Documentation
  • (48:01) - Question: How does it pick instance sizes?
  • (48:55) - Question: Karpenter respects desire to spread workloads
  • (49:29) - Question: EKSAnywhere support
  • (49:50) - Question: How do you pick AMIs?
  • (50:37) - Winding down
  • (52:25) - Wrapping up
  • (52:30) - Outro

    • You can also support this podcast by subscribing to my YouTube channel and my monthly newsletter at bret.news!

    Grab the best coupons for my GitHub, Agents, Docker, and Kubernetes courses.
    Join my cloud native DevOps community on Discord.
    Grab some merch at Bret's Loot Box
    Homepage bretfisher.com

    ...more
    View all episodesView all episodes
    Download on the App Store
    DevOps and Docker Talk: Cloud Native Interviews and ToolingBy Bret Fisher
    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    54 ratings

    More shows like DevOps and Docker Talk: Cloud Native Interviews and Tooling

    View all
    The Joe Rogan Experience by Joe Rogan

    The Joe Rogan Experience

    228,383 Listeners

    All Ears English Podcast by Lindsay McMahon and Michelle Kaplan

    All Ears English Podcast

    2,237 Listeners

    The Daily by The New York Times

    The Daily

    111,948 Listeners

    Agentic DevOps : AI Engineering for Infrastructure by Bret Fisher

    Agentic DevOps : AI Engineering for Infrastructure

    2 Listeners