
Sign up to save your podcasts
Or


Sabina Anja, Chief Technologist and executive advisor at VMware Cloud Foundation, talks with host Amey Ambade about how AI workloads reshape GPU network design, and why the network moves into the critical path of computation once a model is too large for a single GPU. Using Llama 3's 405 billion parameters as a starting point, Sabina explains how sharding spreads model weights across many GPUs. She then walks through the difference between scaling up inside a server over NVLink and scaling out across servers over the cluster network. She describes collective traffic as synchronous: no GPU moves to the next step until every GPU finishes, so one slow GPU or congested link, called a straggler, stalls the whole job. The conversation covers data, tensor, and pipeline parallelism and the distinct traffic pattern each produces, with analogies such as splitting a restaurant bill to explain all-reduce. It then moves to physical topology, including rail-optimized designs, dedicated back-end AI networks that echo the storage area networks of the past, and why oversubscription, a sensible cost bet in enterprise networks, fails when AI traffic runs every link at full capacity.
The discussion then turns to congestion and latency: why synchronized collectives produce sudden bursts that overflow switch buffers, how older techniques such as priority flow control return to pause traffic before loss, and how overlapping communication with computation hides some network delay. On inference, Sabina explains how sharded models pay network latency on every generated token, why the prefill and decode phases have different resource demands, and why some systems separate them into different GPU pools and move the KV cache between them. She also describes how mixture-of-experts models can concentrate traffic on the servers that host popular experts. The episode closes with a vendor-neutral framework for evaluating network fabrics: treat the network as a design constraint in the same way as compute and memory, and give the network team concrete information about the traffic a workload will generate. Her summary of the challenge is that AI networking is a watermelon-through-a-keyhole problem.
Marian Kamenistak, founder of the Engineering Leaders Community and former VP of Engineering at Mews, joins host Priyanka Raghavan to discuss product management for software engineers. As AI increasingly takes over more of the code-writing process, the role of software engineers is evolving. The episode starts with some fundamental concepts of product management before diving into practical case studies and real-world examples. The discussion looks beyond simply building a product and explores the entire product lifecycle—from understanding customer needs to measuring how the product is actually used. Marian discusses success metrics and the importance of defining them up front to make better product decisions. Through case studies, he demonstrates how engineers can develop a stronger product mindset without necessarily becoming traditional product managers. The conversation concludes by exploring the emerging idea of a "Product Builder"—a new kind of engineering role combining technical skills with product thinking and market awareness. With AI agents increasingly handling many of the tactical and repetitive tasks, future product builders might need to focus more on creativity, customer understanding, strategy, and connecting technology to business outcomes.
Dr Andrew Tridgell of the Ardupilot project discusses flight control software for autonomous and remote controlled aircraft. This field has advanced considerably in recent years, and autonomous vehicles are playing an increasingly important role in many industries -- from package delivery to scientific surveying and film-making -- as well as in the consumer market.
Host Jason Davey speaks with Tridgell about the fundamental concepts required to keep a drone in the air, the hardware and software architecture behind these vehicles, and how development and testing are handled in Ardupilot, one of the leading open source flight control software stacks.
Danilo Krummrich, a software engineer at Red Hat, speaks with host Gregory M. Kapfhammer about the using the Rust programming language in the Linux kernel. After introducing the Nova project, which leverages Rust for building NVIDIA GPU drivers, they explore the benefits associated with Rust, such as GPU driver memory safety. The conversation also examines topics like best practices for implementing self-referential structures with Rust and the pin-init crate. Danilo also describes practical performance considerations and lessons learned from building and maintaining the Nova project.
Sowjanya Pandruju, Cloud Application Architect with Amazon Web Services, Vice Chair of the IEEE Computer Society Madison Section, and Chair of the IEEE Women in Engineering (WIE) Madison Section (Region 4), speaks with SE Radio host Gavin Henry about managing agent state. Sowjanya discusses what agents are and are not, what agent state is, the role an LLM actually plays, why agents need state, the different types of state, where to store agent state, how multi-agents change things, and the solutions to the various challenges created by managing agent state.
Brought to you by IEEE Computer Society and IEEE Software magazine.
Tim Varelmann, the founder of Bluebird Optimization, which helps companies automate complex decision-making, speaks with host Sriram Panyam about mathematical optimization. The episode begins by differentiating optimization from what software engineers usually mean by the word. Making something faster or smaller is improvement, whereas optimization means finding the provably best solution after which no further improvement is possible unless the problem's parameters change. The conversation examines the difference between simulation and optimization, where optimization is already running, optimization and AI, key software engineering principles, and how you can get started with mathematical optimization.
Sahil Walia, a senior technical architect at Snowflake, joins host Robert Blumen for a conversation about schema migration and data migration. Together, they discuss the basics of schema: do all data sets have schema?; what drives schema change?; are data migration and schema migration the same thing? Must they happen at the same time? They then talk about the challenges and failure modes of schema migration, including challenges at scale, migrating without downtime, the concept of "safety" in data migrations, and safety patterns for data migration - double writes, read repair, replication, ending on the Apache Iceberg case study.
Raju Dandigam speaks with host Amey Ambade about building robust AI agents for production. Raju recommends treating an agent as a software subsystem rather than a standalone model call. That means designing decision contracts and tool boundaries, choosing between predictable workflows and multi-agent orchestration, and managing the runtime, state, and streaming that make agents durable. A recurring theme is that the model should not own the system: the right architecture is usually the simplest one that meets the product need while preserving reliability and control, with the language model placed inside a controlled runtime that settles authentication, policy, data freshness, and idempotency before it is ever asked to reason.
They focus largely on how teams can be sure that an agent works and how to debug it when it does not. The episode covers behavioral testing against contracts, golden scenarios, and observability that captures the full execution path rather than flat logs, which is the gap behind agent-inspect and its readable execution trees. Raju and Amey close on operating agents in production: measuring cost and latency per run, knowing when a simpler model or no AI path is the right call, and treating prompts, schemas, tools, and evaluation sets as owned, versioned artifacts.
Brought to you by IEEE Computer Society and IEEE Software magazine.
Erin Catto of Kintsugiyama, veteran video game developer who worked on the Tomb Raider series at Crystal Dynamics and later contributed to Diablo III, Overwatch, and other franchises at Blizzard, discusses video game physics engines with host Jason Davey. Erin created the popular open-source Box2D library used in titles including Angry Birds and Noita, and he released Box3D in 2026, bringing the much-loved physics engine to the third dimension. Underpinning everything from platformers and racing games to industrial robotics simulations, modern physics engines present a host of interesting engineering challenges, including the need to balance accuracy, stability, determinism, and performance. Catto describes the core concepts, the various trade-offs and factors that influence the design of these systems, and how they fit into the broader software architecture of a video game.
Milan Milanovic, Microsoft MVP for Developer Technologies and author of the book, Laws of Software Engineering, joins host Giovanni Asproni for a conversation based on the content of his book—a collection of 53 empirical and mathematical laws governing modern software engineering. The book includes some well-known laws, such as Conway's and Brooks's laws, as well as other lesser-known but just as important, including Gilb's and Tesler's laws. The episode starts with an introduction to the laws and the criteria that Milan used to choose them. The episode continues with some practical hints on how to apply the laws and concludes with thoughts on the importance of the laws for teams using artificial intelligence tools in their day-to-day work.