Giant Conversations

Giant Conversations

By Giant Swarm GmbHTechnology
Download on the App Store

Giant Conversations episodes

  • GC - #36 Kubernetes at the Edge
    On-Prem experts Antonia von den Driesch and Xavier Avriller talk KubeEdge and Edge to Cloud
    Giant Conversations Episode #36

    Episode Date: May 6, 2026

    Topic:

    Kubernetes at the Edge

    Hosted by:

    • Tommy Hobin
    • Special Guests:

      • Antonia von den Driesch
      • Xavier Avriller
      • Introduction to Antonia, Xavier and Team Rocket:

        Antonia von den Driesch is a Platform Engineer on Team Rocket at Giant Swarm and alongside Solutions Architect Xavier Avriller work with Manuel Gawert and Simon Weald on "Bringing seamless Kubernetes experiences on-premises, from edge to cloud."

        Short intro - GS and Edge computing
        • Smart factories
        • Distributed K8s
        • Edge to cloud
        • Kubernetes at the Edge EU Tour

          Hamburg, Atlanta, Aarhus, Warsaw, London, Edinburgh

          Q: You've been traveling across Europe and went to the US talking about this technology. What's the one thing that surprises people most when they first hear about what KubeEdge can do?

          A (X): We found that people often enquire about reliability because of the extra components that make up Kubeedge and show interest in how data syncs back to the cluster after being offline. NOTE Resources footprint (70MB).

          Q: Favorite city? Cuisine? Atlanta perhaps?

          A (X): London for the variety and Atlanta for the fried chicken!

          A (A): Chicken waffles in Atlanta and georgian dumplings in Warsaw.

          KubeEdge and Edge to Cloud - Delving In

          Q: Can you explain KubeEdge in simple terms — and then give me a real-world example of it solving a problem that would have been really difficult to solve before?

          A (A): KubeEdge allows to run kubernetes nodes on small machines with capabilities to interact with IOT devices and sustain connectivity outages. One of the fun use cases done in China is around satellites to improve flood prevention mitigation.

          Q: Who are the kinds of companies that typically come to you — and what are they usually struggling with before they find you?

          A (X): At GS we mostly interact with manufacturing companies who want to improve the efficiency of their factories through cloud native technologies. The main struggles are around building and managing a distributed platform with all the components that go along with it, GS has experience in multi tiers cloud to edge architectures. Customers also often need to address unreliable connectivity and sometimes even need air gap in the most extreme cases.

          Q: When this all works the way it's supposed to — what does that actually change for the people on the ground? Like the person working in the factory or the hospital?

          A: (A) It will often automate tasks that used to be done manually by a person, this improves consistency and reliability. It may simplify troubleshooting steps on a factory line or simply maintain operations during a network outage.

          Edge to Cloud at Giant Swarm

          Q: For a company that's convinced this is the direction they need to go — why does it matter who helps them get there? What does Giant Swarm bring that they couldn't just figure out on their own?

          A (X): Honestly they could figure it all out all on their own, but it takes a lot of time and money to get there. GS gets you up and running in a week and you get specialized teams that have been doing this for years available to help and get the pages.

          Edge to Cloud - Resources

          On Stage - Kubernetes at the Edge – Come see It In Action!

          ContainerDays 2026 — Warsaw

          KubeCon North America 2025
          ContainerDays 2025 - Denmark
          With Special Guest Simon Weald: ContainerDays 2025 - Hamburg
          Kubernetes Community Days - Edinburgh

          Blog Post from Manuel Gawert: Treat the edge like infrastructure, not an exception

          14 min
        • GC - #35 Manufacturing IIoT
          Delve deep into IIoT as we discuss challenges, adoption, scaling, and cost benefits of IIoT
          Giant Conversations Episode #34

          Topic:

          Manufacturing IIoT

          Hosted by:

          • Tommy Hobin
          • Special Guest:

            • Manuel Gawert -
            • Manufacturing IIoT - Why is IIoT Important?

              Introduction to Manuel Gawert: Technical PO for On-Premise Giant Swarm. Working with manufacturer's on Edge, IIoT, and On-Premise. Learn about Giant Swarm's IIoT offering here.

              Q: Why should a traditional manufacturer care about adopting IIoT now?

              Q: Can you give a real-world example /use case of how our IIoT platform helps improve factory operations?

              Manufacturing IIoT - Delving In

              Q: What's the "high-level" approach to scaling IIoT infrastructure across multiple facilities or geographic locations?

              Q: How do Kubernetes-native architecture benefit industrial customers compared to legacy systems?

              Q: How is IIoT important to digital transformation trends like AI, cloud adoption, or supply chain automation?

              Manufacturing IIoT at Giant Swarm

              Q: Do these platforms (our platform) help reduce costs? I'm sure they do, but how?

              Q: How do we handle interoperability with existing factory systems like SCADA, PLCs, and MES platforms?

              Q: Where do you see the future of manufacturing heading with platforms like ours?

              Manufacturing IIoT - From the Blog

              Blog Post: What works in Industrial IoT: lessons from real-world smart factories

              Blog Post: Unlocking smart factory success

              Blog Post: GitOps in hybrid factory environments: simplifying deployments, hardening operations

              Blog Post: Seamless Industrial IoT management: Azure Arc integration for hybrid environments

              26 min
            • GC - #34 AI for Infrastructure
              Truly deep insights from Timo Derstappen on how AI will change the role of Platform Engineer
              Giant Conversations Episode #34

              Join us for AI Beyond the Hype from Giant Swarm

              Episode Date: June 27, 2025

              Topic:

              AI for Infrastructure

              Hosted by:

              • Oliver Thylmann
              • Tommy Hobin
              • Special Guest:

                • Timo Derstappen
                • AI Beyond the Hype
                  AI for Infrastructure

                  Recap of AI for Infrastructure - Mainly the presentation about AI: Your New Superpowered, Semi-Intelligent, Tireless Partner

                  Conversation Starters

                  Your New Role: The Product Manager

                  AI is Both Smart & Dumb alongside "Shit in Shit out"

                  Vibe coding as the new development flow

                  The human aspect of AI for Infrastructure

                  Giant Swarm's Muster

                  Next Podcast

                  Manufacturing IIoT with Manuel Gawert

                  42 min
                • GC - #33 Cloud Native Monitoring and Observability
                  IYKYK - Join us as we talk to Dominik Schmidle about the Giant Swarm Observability Platform.
                  Giant Conversations Episode #33

                  Topic:

                  Monitoring and Observability

                  Hosted by:

                  • Tommy Hobin
                  • Special Guest:

                    Dominik Schmidle

                    Monitoring and Observability for Beginners

                    Start with the basics: NOT what is Monitoring and Observability - why is monitoring and observability important for DevOps? What is an example?

                    Monitoring and Observability in the News

                    Observability is evolving: 2025 observability is less about shiny graphs and more about getting answers faster, safely, and at scale.

                    Grafana 12 release (May 07 2025): Observability as Code, Grafana Alerting improvements, Grafana Drilldown General Availability, and more

                    Key enhancements:

                    • Git Sync: experimental support to version-control dashboards and folders via Git from within Grafana, including branch and PR workflows
                    • CLI tool (grafanactl): manage, pull, push, validate Grafana resources from the command line
                    • Alerting Improvements: Tool to import Prometheus/Loki alert rules into Grafana-managed alerts, preserving original behavior
                    • Grafana Drilldown (Explore Metrics, Logs & Traces) moved to GA
                    • OpenTelemetry + Grafana Labs roadmap (May 20 2025)

                      OpenTelemetry pushed stable, turn-key Spring Boot instrumentation and added resource-aware Prometheus export, so labels like k8s.node.name flow straight into Prom dashboards.

                      Monitoring and Observability at Giant Swarm
                      • Did our first Talk about how we created the Product on "Mastering Observability" Conference!

                      • Topic was Observability Platform @ Scale and which challenges we faced when scaling

                      • Interesting: Most problems when scaling were organizational instead of technical (observability as a product)

                      • ie. one problem: What's actually our product and what's our interface to the customer?

                      • ie. second problem: The Vision of the Observability Platform - where do we want to go with it -> Longterm Roadmap

                      • Now working on the roadmap! What progress?

                      • We worked a lot on our Multi-Tenancy concept based on Grafana Organisations that allows us to onboard a customers marketing team into the observability platform!

                      • We connect GitOps and ClickOps in Grafana - managing a persisted Grafana with GitOps Resources (Dashboards and Orgs) loaded in, so people can create those resources in the way the like best.

                      • Getting AI into the observability platform: directions and reviews!

                      • Next Podcast

                        AI Event: AI for Infrastructure - How Will AI Change the Life of a Platform Engineer? Giant Swarm CTO, Timo Derstappen will walk us through the event while going over questions from our audience.

                        46 min
                      • GC - #32 Onsite with AI
                        In this episode, Oliver and Tommy discuss the Giant Swarm onsites, AI in the news and plug our NEXT event AI for Infrastructure
                        Giant Conversations Episode #32
                        AI for Infrastructure

                        Giant Swarm NEXT: Coffee edition with QAWare

                        June 24th, at 9:30 am CEST
                        Join Us: https://swarm.ly/3FnyeeL

                        AI for Infrastructure: How Will AI Change the Life of a Platform Engineer?

                        Episode Date: June 4, 2025

                        Topic:

                        AI Event and Onsites + Swarmalicious News

                        Hosted by:

                        • Oliver Thylmann
                        • Tommy Hobin
                        • This years Team Onsites

                          Location: Mallorca - near Santanyi

                          Sessions:

                          Team Atlas and Cabbage: Release Requirements Session

                          • Release-as-a-Service
                          • Consistency across clusters(less exceptions)
                          • Testing as integral part of releases
                          • Be on a cluster fast(like weekly at least)
                          • Transparency for customers in a structured way
                          • Planeteers: (OLI FILLS IN)

                            TeamUp:

                            • Improving feedback sessions
                            • Modular marketing services
                            • How we analyse conversion data
                            • Brainstorming using new methods: Rapid Ideation with AI Assistance
                            • Gifts and company SWAG (we are relaunching the Shop)
                            • Shield:

                              • Adopting Kubescape as our platform "core" (from Trivy)
                              • Kubescape would enable some features we don't currently have, but it is either missing or duplicating some we do have
                              • Example:

                                • Anomaly detection. Falco is also CNCF and has lots of users, so it's not clear whether we'd ditch it for Kubescape's agent.
                                • Are there things that even the expensive commercial tools don't do that we can do for customers?

                                  Examples:

                                  • L1 security oncall - we take the pager for certain types of security issues and are the first entrypoint / triage for them
                                  • Active remediation of findings - the scanner says "this is bad" and we make it good by actually working on customer applications
                                  • Any fun stories?

                                    TeamUp got to run into 3 other teams while there - Teams Cabbage, Atlas, and Shield

                                    Jonas swam around 300 Meters to a deserted Island

                                    Jonas also snuck out at night with a night camara and came back with 2 sea cucumbers. He also mentioned that he scared some people

                                    We tested the well in the house - it works.. the water was probably not potable

                                    Next Onsite?

                                    Alicante - the whole company

                                    Swarmalicious AI News

                                    Mary Meeker's Bond AI Special Report:

                                    340 slides into her new BOND “Trends – Artificial Intelligence” report. If you want to get the most out of it - ask ChatGPT to summarize it for you:

                                    Easy Takeaway - Adoption

                                    • Facebook 4.5 years to reach 100M users
                                    • ChatGPT 0.2 years
                                    • Old AI News - Starting today [April 10th 2025], memory in ChatGPT can now reference all of your past chats to provide more personalized responses, drawing on your preferences and interests to make it even more helpful for writing, getting advice, learning, and beyond.

                                      Reference: Dress this dog in a pelican costume. Sign in the back written Half Bay Moon

                                      The previous memory feature—where the model would sometimes take notes on things I’d told it—still kept me in control. I could browse those notes at any time to see exactly what was being recorded, and delete the ones that weren’t helpful for my ongoing prompts.

                                      Yeti TikTok "powered" by AI: yetibubbavlog

                                      • 21.2K Followers
                                      • 175.4K Likes
                                      • CloudFlare is trapping misbehaving bots in an AI Labyrinth.

                                        AI Labyrinth, a new mitigation approach that uses AI-generated content to slow down, confuse, and waste the resources of AI Crawlers and other bots that don’t respect “no crawl” directives.

                                        AI for Infrastructure

                                        AI for Infrastructure: How Will AI Change the Life of a Platform Engineer?

                                        AI-powered agents already making waves in the space — including tools like kagent, robusta.dev, and incident.io, which are helping teams detect issues faster, reduce toil, and boost operational confidence.

                                        Special Guests:

                                        Mario-Leander Reimer - Managing Director and CTO, QAware
                                        Timo Derstappen - CTO and Co-Founder, Giant Swarm

                                        Moderated by Tommy Hobin

                                        Next Weeks Podcast

                                        June 12, 2025 Dominik Schmidle will be talking about Monitoring and Observability.

                                        28 min
                                      • GC - #31 KubeCon Unedited
                                        We bring back Heather and Joe to talk (almost) all things London and KubeCon. Just as chaotic, fun, and educational as KubeCon itself. See you there!
                                        Giant Conversations Episode #31

                                        Episode Date: March 28, 2025

                                        Topic:

                                        KubeCon London

                                        Hosted by:

                                        • Oliver Thylmann
                                        • Tommy Hobin
                                        • Special Guests:

                                          Heather Clancy

                                          Joe Salisbury

                                          ### See you at KubeCon - a marketer's take
                                          We'll be at KubeCon in London Drop by booth N450

                                          Date: 1-4 April 2025 in London

                                          Giant Swarm Lineup - KubeCon:

                                          • Marco Ebert: How To Gateway With Ingress - 140 Days InGate
                                          • Giant Swarm Lineup - KubeCon (Platform Engineering Day):

                                            • Dominik Kress: Platform-as-a-Product: First Insights From CNCF Platform Working Group's Ongoing Research
                                            • Giant Swarm Lineup at Rejekts:

                                              • Marcus Noble: Pod Deep Dive: Everything You Didn't Know You Needed to Know
                                              • Joe Salisbury: The Cluster API Migration Retrospective: Live migrating hundreds of clusters to Cluster API
                                              • Anyone on this Pocast a bit nervous?

                                                ### Stuff to Know
                                                • Download the CityMapper app to get your way around London's Tube System
                                                • The station near the venue is Custom House (there exit ExCel), available from Heathrow Terminals by the Elizabeth line
                                                • What parties are you attending?
                                                • ### Fun and a little nerdy bit of things to do in London

                                                  Only a 5 minute walk from Holborn Tube Station: The Novelty Automation Museum - very reminiscent of our invention hero Simone Giertz

                                                  Oi, check this out >> https://www.timhunkin.com/a260_travel-by-tube.htm

                                                  Have y'all thought about going to an arcade? Do y'all say y'all? I don't care, here's a list of arcades.

                                                  • Horizon 22!
                                                  • Natural History Museum (South kensington in general - Science Museum, V&A, kensington creperie)
                                                  • spitalfields market (more food)
                                                  • sky garden (alternative to horizon22
                                                  • hms belfast (if you're into navy stuff)
                                                  • london transport museum (if you're into trains lol)
                                                  • tooting market / broadway market / the wheatshef shout out to the ends
                                                  • Hayward Gallery
                                                  • Food Guide

                                                    The Dishoom paradox (Kricket)

                                                    Blacklock (lol at Joe)
                                                    Gaucho
                                                    Borough Market
                                                    Bermondsey Beer Mile
                                                    40 Maltby Street.

                                                    ### Talks at Rejekts/KubeCon that peak our interest
                                                    • (KC) Marco Ebert: How To Gateway With Ingress - 140 Days InGate

                                                    • (R) Marcus Noble: Pod Deep Dive: Everything You Didn't Know You Needed to Know

                                                    • (R) Joe Salisbury: The Cluster API Migration Retrospective: Live migrating hundreds of clusters to Cluster API

                                                    • (KC) Dominik Kress: Platform-as-a-Product: First Insights From CNCF Platform Working Group's Ongoing Research

                                                    • (R) James Laverack, Luigi Zhou: High-Scale Networking for ML Workloads With Cilium

                                                    • (R) Frederic Branczyk, Jimmy Zelinskie: From Milliseconds to Microseconds: Pushing Kubernetes Workloads to the Limit

                                                    • (KC) Joe's Wildcard: Dennis Marttinen, Security and Cloud Computing (SECCLO) Master Student, Aalto University: Thousands of Virtual Kubelets: 1-to-1 Mapping a Supercomputer To Kubernetes With Supernetes

                                                    • 45 min
                                                    • GC - #30 One Year of Giant Conversations
                                                      It's not a cut together sho of memories. Tech news keeps coming in and we're here to decipher it for you... still.
                                                      Giant Conversations Episode #30

                                                      Episode Date: March 12 2025

                                                      Hosted by:

                                                      • Oliver Thylmann
                                                      • Tommy Hobin
                                                      • Contributors:

                                                        • Puja Abbassi
                                                        • Martin Proffitt
                                                        • Marcus Noble
                                                        • Marian Steinbach
                                                        • ### Swarmalicious News
                                                          We'll be at KubeCon in London Drop by booth N450

                                                          Date: 1-4 April 2025 in London

                                                          Giant Swarm Lineup - KubeCon:

                                                          • Marco Ebert: How To Gateway With Ingress - 140 Days InGate
                                                          • Giant Swarm Lineup at Rejekts:

                                                            • Marcus Noble: Pod Deep Dive: Everything You Didn't Know You Needed to Know
                                                            • Joe Salisbury: The Cluster API Migration Retrospective: Live migrating hundreds of clusters to Cluster API
                                                            • Oliver's Take: You don't often go to conferences. I've heard there are three kinds of people who go:

                                                              1. Heavy learners who can't miss a session, take notes, and bring back boatloads of informatio
                                                              2. Those who just kind of hang around and network a bit
                                                              3. Those who party till the daytime and go to the conference slightly drunk
                                                              4. …. there's proibably a fourth.
                                                              5. The Evolution of IT Operations and Opsgenie:

                                                                Opsgenie end of support – effective April 5th, 2027: On this date, access to Opsgenie will be shut off, and the product will no longer accessible. Any unmigrated data in Opsgenie will also be deleted at this point.

                                                                This a reasonable amount of time to do something about it - right?

                                                                Undocumented commands found in Bluetooth chip used by a billion devices

                                                                Researchers have identified undocumented vendor-specific commands in the ESP32 microcontroller, a widely used chip enabling Wi-Fi and Bluetooth connectivity in over a billion IoT devices as of 2023.

                                                                The security issues include:

                                                                • Spoof Trusted Devices: Impersonate legitimate devices to gain unauthorized access.
                                                                • Access Data Illegally: Retrieve sensitive information without permission.
                                                                • Network Pivoting: Move laterally within a network to compromise additional devices.
                                                                • Establish Persistence: Maintain long-term unauthorized access to devices.
                                                                • On May 5, Microsoft’s Skype will shut down for good:

                                                                  Moving to Teams…

                                                                  Why is Microsoft doing this?

                                                                  Integration Challenges: After acquiring Skype in 2011, Microsoft faced difficulties integrating it into its ecosystem, leading to technical issues and user dissatisfaction.

                                                                  Rise of Competitors: The emergence of platforms like Zoom and WhatsApp, offering user-friendly interfaces and reliable services, diminished Skype's market share.

                                                                  Strategic Shift to Teams: Microsoft's focus shifted to Teams, a platform that seamlessly integrates with its suite of productivity tools, aligning better with modern communication needs.

                                                                  Cast AI 2025 Kubernetes Cost Benchmark Report

                                                                  Key findings:

                                                                  • Only 10% of provisioned CPUs are utilized
                                                                  • Memory utilization averages just 23%
                                                                  • The gap between provisioned and requested resources is massive— 40% for CPU, 57% for memory
                                                                  • The data for our 106 clusters shows

                                                                    • CPU Utalization Mean between 9.6% and 13.7%, Max 19.6%
                                                                    • Memory Utalization Mean between 20.3% and 40.9%, Max 46.7%
                                                                    • How data centres can chase renewable energy across Europe

                                                                      In Ireland, data centers' share of electricity consumption was 21% in 2023 and is projected to reach 32% by 2026. This article covers

                                                                      Geographical Flexibility: Locating data centers in regions abundant in renewable resources—such as wind-rich northern Europe or sun-rich southern Europe—allows for optimal utilization of local renewable energy capacities.

                                                                      Operational Flexibility: Scheduling non-time-sensitive computational tasks during periods of high renewable energy availability can reduce reliance on non-renewable power sources.

                                                                      Dynamic Load Shifting: By distributing computing tasks across various locations based on real-time renewable energy availability, data centers can minimize energy costs and emissions. For instance, when wind generation is low in one area, tasks can be shifted to another region with higher wind output.

                                                                      The European Centre for Medium-Range Weather Forecasts (ECMWF) has introduced the Artificial Intelligence Forecasting System (AIFS), an AI-based weather model that significantly enhances forecasting accuracy while reducing energy consumption by approximately 1,000 times compared to traditional methods.

                                                                      Key Features of AIFS:

                                                                      Enhanced Accuracy: AIFS leverages machine learning techniques to provide more precise weather predictions, improving the reliability of forecasts.

                                                                      Energy Efficiency: The system's AI-driven approach drastically reduces the computational resources required, leading to substantial energy savings.

                                                                      Operational Integration: As the first operational forecasting model extensively utilizing machine learning across various parameters, AIFS represents a significant advancement in meteorological practices.

                                                                      39 min
                                                                    • GC - #29 It's Puja Two Y'all
                                                                      Confidential computing, Flux 2.5 GA, agent mode for GitHub Copilot, and much more.
                                                                      Giant Conversations Episode #29

                                                                      Episode Date: March 5 2025

                                                                      Topic:

                                                                      Puja Two Y'all!

                                                                      Hosted by:

                                                                      • Oliver Thylmann
                                                                      • Tommy Hobin
                                                                      • Special Guest:

                                                                        Puja Abbassi

                                                                        Contributors:

                                                                        • Puja Abbassi
                                                                        • Timo Derstappen
                                                                        • Simon Weald
                                                                        • Zach Stone
                                                                        • Martin Proffitt
                                                                        • Marcus Noble
                                                                        • Subscribe to Marcus' Kubernetes Newsletter https://cloudnative.now/

                                                                          ### Swarmalicious News

                                                                          Marcus Noble: Tekton Incubation Application - This is from May 1, 2024. Is it new?

                                                                          Martin Proffitt: Introducing Flux 2.5 GA.

                                                                          • General Availability of the Bucket API: The Bucket API has reached General Availability (GA), providing a stable interface for managing bucket resources.
                                                                          • CLI Enhancements: The flux command-line interface now includes a create secret proxy command, facilitating the creation of proxy secrets. Additionally, the create source commands have been updated with a --proxy-secret-ref flag to support proxy configurations.
                                                                          • Dependency Updates: Flux components have been updated to align with Kubernetes v1.31.1, ensuring compatibility and leveraging the latest Kubernetes features.
                                                                          • Testing Improvements: Conformance tests now cover Kubernetes versions 1.29 through 1.31, ensuring robust support across these versions.
                                                                          • Puja Abbassi: Six Sins of Platform Teams

                                                                            where Sergey Tselovalnikov discusses common pitfalls that platform teams encounter, such as:

                                                                            • Structuring teams around specific solutions
                                                                            • Losing empathy towards product engineers
                                                                            • Overengineering solutions
                                                                            • Neglecting user feedback
                                                                            • Imposing mandatory usage
                                                                            • Lack of clear success metrics
                                                                            • Marcus Noble: CVE-2025-0426: Node Denial of Service via kubelet Checkpoint API. A security issue was discovered in Kubernetes where a large number of container checkpoint requests made to the unauthenticated kubelet read-only HTTP endpoint may cause a Node Denial of Service by filling the Node's disk. What is this process?

                                                                              Simon Weald: Tolerating full cloud outages with Monzo Stand-in

                                                                              Monzo introduces "Monzo Stand-in," a backup banking infrastructure hosted on Google Cloud Platform (GCP) designed to maintain essential banking services during outages of their primary platform on Amazon Web Services (AWS).
                                                                              Notes:

                                                                              • Independent Operation: Monzo Stand-in runs on GCP, while the primary platform operates on AWS, ensuring that a failure in one doesn't affect the other.
                                                                              • Essential Services Coverage: During primary platform outages, Stand-in supports vital functions such as card spending, cash withdrawals, bank transfers, balance checks, transaction history, and card freezing/unfreezing.
                                                                              • Simplified App Interface: When Stand-in is active, the Monzo app automatically transitions to a streamlined user interface, focusing on essential banking features to maintain user accessibility.
                                                                              • Risk Mitigation Strategy: By developing a separate set of services for Stand-in, Monzo avoids complexities and potential issues related to real-time data replication and consistency between platforms.
                                                                              • Puja Abbassi: Confidential computing is a new technology that enables 1Password to bring its end-to-end encryption model into the cloud.

                                                                                Confidential AI with: https://www.edgeless.systems/

                                                                                ### AI News

                                                                                Puja / Timo: Introducing agent mode for GitHub Copilot in VS Code, announcing the general availability of Copilot Edits, and providing a first look at our SWE agent.

                                                                                Puja: ChatGPT for DevOps: otto8.ai. Easily integrate CLIs, Docker Images, JavaScript, Python, and Shell scripts with AI.

                                                                                36 min
                                                                              • GC - #28 Besties
                                                                                Our colleague Puja Abbassi joins us and we discuss some of our BFFs content. We're talk about you Frederic, Viktor, Tim, and Millennium BCP.
                                                                                Giant Conversations Episode #28

                                                                                Episode Date: February 12 2025

                                                                                Topic:

                                                                                Hosted by:

                                                                                • Oliver Thylmann
                                                                                • Tommy Hobin
                                                                                • Special Guest:

                                                                                  Puja Abbassi

                                                                                  Contributors:

                                                                                  • Puja Abbassi
                                                                                  • Timo Derstappen
                                                                                  • Simon Weald
                                                                                  • Zach Stone
                                                                                  • Martin Proffitt
                                                                                  • Marcus Noble
                                                                                  • Xavier Avrillier
                                                                                  • ### Swarmalicious News

                                                                                    Zach Stone - TIL about this k8s native global load balancer project, currently CNCF sandbox: A cloud native Kubernetes Global Balancer

                                                                                    Advantages:

                                                                                    • Kubernetes Native Integration
                                                                                    • High Availability and Automatic Failover
                                                                                    • Flexible Load Balancing Strategies
                                                                                    • New Applications:

                                                                                      • Multi-Cluster Deployments
                                                                                      • Integration with Liqo
                                                                                      • Enhanced Observability
                                                                                      • Puja Abbassi - Our friends from Polar Signals built a nice tool to detect cross-zone traffic: eBPF Tool Identifies Cross-Zone Kubernetes Network Traffic

                                                                                        From The New Stack: Polar Signals couldn't figure out why it had so much expensive cross-zone traffic. So it turned to eBPF to deliver the answers, and cut its cloud bill in half.

                                                                                        Martin Proffitt - Why I Changed My Mind About Backstage? A Brutally Honest Opinion

                                                                                        What is his brutally honest opinion? It IS difficult to work with. But so was Kubernetes in the past. Better options back then would have been Docker, Mesosphere, etc. But NOW K8s is the defacto standard. Port for example may be easier now, but he believes Backstage will become the main choice in the future. Predominantly because of CNCF involvement.

                                                                                        Marcus Noble - Kubernetes History Inspector

                                                                                        This tool parses Kubernetes and Google Kubernetes Engine (GKE) logs, generating a comprehensive timeline of all events within a cluster.

                                                                                        Key Features:

                                                                                        • Comprehensive Event Timeline
                                                                                        • Information-Dense Interface
                                                                                        • Xavier Avrillier - Cilium Releases v1.17.0: https://github.com/cilium/cilium/releases/tag/v1.17.0

                                                                                          The new Cilium version includes some pretty cool new features including:

                                                                                          • Quality of Service: Annotate your Pods for Guaranteed, Burstable or BestEffort egress network traffic priority
                                                                                          • FQDN Filtering for hostNetwork: Use CiliumClusterwideNetworkPolicy to configure Layer 7 filtering for DNS requests on nodes in the cluster
                                                                                          • AI News

                                                                                            Timo Derstappen: - Let's different llms talk to each other to find consensus. llm-consortium

                                                                                            Key Features:

                                                                                            Multi-Model Orchestration: The system coordinates responses from multiple LLMs simultaneously, allowing each model to contribute its unique strengths to the problem-solving process.

                                                                                            Iterative Refinement: Through multiple rounds of evaluation, the consortium refines responses to improve accuracy and coherence, ensuring that the final output is well-vetted.

                                                                                            Advanced Arbitration: A designated arbiter model synthesizes responses from various LLMs, evaluating and combining them to produce optimal results.

                                                                                            Blockchain Verification: Decisions and consensus are recorded on the Solana blockchain, providing transparency and verifiability of AI-generated outputs.

                                                                                            Puja Abbassi - DeepSeek claims its ‘reasoning’ model beats OpenAI’s o1 on certain benchmarks

                                                                                            Chinese AI lab DeepSeek has released an open version of DeepSeek-R1, its so-called reasoning model, that it claims performs as well as OpenAI’s o1 on certain AI benchmarks.

                                                                                            Tim from Netlight mentioned is running most of his LLM workloads on K8s through: https://github.com/vllm-project/vllm

                                                                                            It's a bit complex, but it supposedly what OpenAI also uses under the hood and very very powerful: DOCS

                                                                                            Timo Derstappen - Openai launched their first agent: https://www.youtube.com/live/CSE77wAdDLg

                                                                                            Simon Weald - Trolling SMS spammers with Ollama: https://evan.widloski.com/software/sms_llm/

                                                                                            46 min
                                                                                          • GC - #27 Our 2025 Cloud Native Predictions
                                                                                            Oliver and Tommy delve into his Cloud Native predictions for 20 25 and recap his predictions from 2024 And looking into the future from the Team at Giant Swarm
                                                                                            Giant Conversations Episode #27

                                                                                            Topic

                                                                                            Cloud Native Predictions for 2025 from Giant Swarm
                                                                                            Hosted by:

                                                                                            • Tommy Hobin
                                                                                            • Oliver Thylmann
                                                                                            • Last year's predictions: Was Oli right?

                                                                                              • Decision making will be a people topic
                                                                                              • CNCF will gain in strength and add key projects CNCF Project List and CNCF Project Count
                                                                                              • More companies or projects will fold or merge
                                                                                              • The IDP, Internal Developer Platform trend will go full force
                                                                                              • GitOps becomes the standard
                                                                                              • Edge clusters gain traction
                                                                                              • AI Ops is a thing
                                                                                              • - Community forks for Open Source projects on the horizon
                                                                                                Main topic: Cloud native predictions for 2025

                                                                                                Looking Ahead: 2025's Unfolding Story

                                                                                                Predictions gathered from Swarmalicious:

                                                                                                1. Gateway API:

                                                                                                The release of Gateway API v1.2.0 in November 2024 introduced features such as WebSocket support, timeouts, and retries

                                                                                                The upcoming Gateway API v1.3 is expected to be released around the end of January 2025. It will possibly include:

                                                                                                • Expanded Protocol Support
                                                                                                • Enhanced Configuration Options
                                                                                                • Improved Observability
                                                                                                • Authentication and Security Enhancements
                                                                                                • Better Cross-Cluster and Multi-Tenancy Support
                                                                                                • User experience and usability (UI)
                                                                                                • 2. Stronger focus on UI: Flux, Headlamp, Backstage etc.:

                                                                                                  Why Together They Matter and complement each other:

                                                                                                  • Flux ensures operational consistency through GitOps.
                                                                                                  • Headlamp simplifies operational management for Kubernetes clusters.
                                                                                                  • Backstage abstracts Kubernetes details to enhance developer productivity.
                                                                                                  • This will help solve:

                                                                                                    Developer and Operator Alignment: Together, they bridge the gap between infrastructure operators and application developers.
                                                                                                    Improved Kubernetes Adoption: By addressing different pain points, these tools lower the barrier for Kubernetes adoption across organizations.

                                                                                                    3. More indie community activity. KCDs and more "grassroots" style events and communities (the CNCF is still very active in these):

                                                                                                    • DevOpsDays
                                                                                                    • KCDs
                                                                                                    • CloudNativeDay events
                                                                                                    • Industry-Specific Kubernetes Communities
                                                                                                    • Financial Services: FinOps Foundation, Cloud Native Financial Services Day (CNCF)
                                                                                                      Healthcare and Life Sciences: HealthTech User Groups (Focus on HIPPA Compliance and Security)
                                                                                                      Telecommunications: Open Networking Foundation, Kubernetes in Telco (CNCF SIG)
                                                                                                      Gaming: Game Developers Kubernetes Group, Open GameStack Initiative
                                                                                                      Manufacturing: CNCF IoT Edge Working Group, Industry 4.0 Kubernetes Group
                                                                                                      Retail and E-Commerce: Retail Kubernetes Users Group, CNCF App Delivery SIG
                                                                                                      Automotive: Autoware Foundation, CNCF Edge Computing SIG

                                                                                                      4. Formalisation in the platform space around capabilities and maturity:

                                                                                                      This formalization is driven by the need to manage complexity, foster innovation, and ensure scalable, secure, and reliable platform ecosystems.

                                                                                                      • Platform Capability Frameworks
                                                                                                      • Maturity Models
                                                                                                      • Governance and Compliance
                                                                                                      • Metrics for Measuring Maturity
                                                                                                      • Collaboration Between Teams
                                                                                                      • Adoption of Standards
                                                                                                      • Emphasis on Innovation and Adaptability
                                                                                                      • 44 min

                                                                                                      About Giant Conversations

                                                                                                      From the publisher's feed

                                                                                                      Big Ideas. Authentic Perspectives.