Sign up to save your podcasts
Or
Share Why Enterprise AI Is Really an Infrastructure Problem | Colton Shaw, Spectro Cloud
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Why Enterprise AI Is Really an Infrastructure Problem | Colton Shaw, Spectro Cloud
Everyone is talking about AI models—but the hardest part of enterprise AI isn't choosing a model. It's building the infrastructure to run it securely, reliably, and at scale.
In this episode, Docker's Per Krogslund is joined by Colton Shaw, Principal Architect at Spectro Cloud, for a conversation about the often-overlooked foundation of enterprise AI. They discuss why incidents like Log4Shell transformed software supply chain security, how Software Bills of Materials (SBOMs) provide visibility into application dependencies, and why AI-generated code introduces new governance challenges.
Colton also shares lessons from deploying Kubernetes across highly regulated and air-gapped public sector environments, explains why edge AI is reshaping industries from defense to healthcare, and discusses how organizations can balance open-source innovation with enterprise-grade security, resiliency, and operational control.
Whether you're modernizing cloud infrastructure, evaluating AI platforms, or preparing your organization for production AI, this episode offers practical insights into building systems that are secure, flexible, and ready for the future.
In This Episode You'll Hear
Timestamps
(00:00) Welcome to Ship Happens
(00:38) Meet Colton and Spectro Cloud
(01:22) Why SBOMs Matter for Enterprise AI
(03:57) The Log4Shell Wake-Up Call
(07:19) Hardening Containers for AI Workloads
(09:33) Security Requirements in Regulated Industries
(14:16) What Spectro Cloud Does
(15:54) Kubernetes in Air-Gapped Defense Environments
(19:16) Why AI Infrastructure Is Different
(20:45) The Current State of AI Operations
(24:24) Budgeting for AI: Tokens vs. Talent
(26:28) AI Sovereignty and Avoiding Vendor Lock-In
(29:58) Building and Serving Your Own Models
(32:54) Choosing the Right AI Model
(36:52) Model Routing for Reliability and Resilience
(40:33) Designing Invisible AI Failover
(41:02) Managing Developer Complexity
(43:45) AI Development Environments at Scale
(45:04) Edge AI in the Real World
(52:28) Why Human-in-the-Loop Still Matters
(58:22) Governance, Audit Trails, and Responsible AI
(01:05:20) Open-Source vs. Proprietary Models
(01:11:46) Moving Beyond APIs to AI Strategy
(01:17:39) Closing Predictions
About the Guest
Colton Shaw is a Principal Architect at Spectro Cloud, where he helps public sector and enterprise organizations design, deploy, and secure Kubernetes platforms across cloud, edge, and air-gapped environments. His work focuses on modern infrastructure, software supply chain security, AI governance, and helping organizations operationalize AI in highly regulated industries, including defense and government. With deep expertise in Kubernetes, container security, and edge computing, Colton works with teams building resilient platforms that support mission-critical applications at scale.
Links & Resources
🌐 Learn more about Spectro Cloud: https://www.spectrocloud.com
🐳 Learn more about Docker: https://www.docker.com
☸️ Kubernetes Documentation: https://kubernetes.io
🛡️ Learn more about Software Bills of Materials (SBOMs): https://www.cisa.gov/sbom
📄 Learn more about the Log4Shell vulnerability: https://www.cisa.gov/news-events/cybersecurity-advisories/aa21-356a
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
View all episodes
By DockerEveryone is talking about AI models—but the hardest part of enterprise AI isn't choosing a model. It's building the infrastructure to run it securely, reliably, and at scale.
In this episode, Docker's Per Krogslund is joined by Colton Shaw, Principal Architect at Spectro Cloud, for a conversation about the often-overlooked foundation of enterprise AI. They discuss why incidents like Log4Shell transformed software supply chain security, how Software Bills of Materials (SBOMs) provide visibility into application dependencies, and why AI-generated code introduces new governance challenges.
Colton also shares lessons from deploying Kubernetes across highly regulated and air-gapped public sector environments, explains why edge AI is reshaping industries from defense to healthcare, and discusses how organizations can balance open-source innovation with enterprise-grade security, resiliency, and operational control.
Whether you're modernizing cloud infrastructure, evaluating AI platforms, or preparing your organization for production AI, this episode offers practical insights into building systems that are secure, flexible, and ready for the future.
In This Episode You'll Hear
Timestamps
(00:00) Welcome to Ship Happens
(00:38) Meet Colton and Spectro Cloud
(01:22) Why SBOMs Matter for Enterprise AI
(03:57) The Log4Shell Wake-Up Call
(07:19) Hardening Containers for AI Workloads
(09:33) Security Requirements in Regulated Industries
(14:16) What Spectro Cloud Does
(15:54) Kubernetes in Air-Gapped Defense Environments
(19:16) Why AI Infrastructure Is Different
(20:45) The Current State of AI Operations
(24:24) Budgeting for AI: Tokens vs. Talent
(26:28) AI Sovereignty and Avoiding Vendor Lock-In
(29:58) Building and Serving Your Own Models
(32:54) Choosing the Right AI Model
(36:52) Model Routing for Reliability and Resilience
(40:33) Designing Invisible AI Failover
(41:02) Managing Developer Complexity
(43:45) AI Development Environments at Scale
(45:04) Edge AI in the Real World
(52:28) Why Human-in-the-Loop Still Matters
(58:22) Governance, Audit Trails, and Responsible AI
(01:05:20) Open-Source vs. Proprietary Models
(01:11:46) Moving Beyond APIs to AI Strategy
(01:17:39) Closing Predictions
About the Guest
Colton Shaw is a Principal Architect at Spectro Cloud, where he helps public sector and enterprise organizations design, deploy, and secure Kubernetes platforms across cloud, edge, and air-gapped environments. His work focuses on modern infrastructure, software supply chain security, AI governance, and helping organizations operationalize AI in highly regulated industries, including defense and government. With deep expertise in Kubernetes, container security, and edge computing, Colton works with teams building resilient platforms that support mission-critical applications at scale.
Links & Resources
🌐 Learn more about Spectro Cloud: https://www.spectrocloud.com
🐳 Learn more about Docker: https://www.docker.com
☸️ Kubernetes Documentation: https://kubernetes.io
🛡️ Learn more about Software Bills of Materials (SBOMs): https://www.cisa.gov/sbom
📄 Learn more about the Log4Shell vulnerability: https://www.cisa.gov/news-events/cybersecurity-advisories/aa21-356a
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.