Data Driven
Download on the App Store

Data Driven episodes

  • Self-Healing Pipelines and the Evolving Role of Data Engineers in the AI Era

    Welcome back to Data Driven, the podcast exploring the dynamic intersection of artificial intelligence, data science, and the foundational world of data engineering. In this episode, we dive into the realm of data pipelines, enterprise analytics, and the ever-evolving tools that power our most advanced AI models. Our guest is a seasoned data engineering and analytics professional from the College of Southern Nevada, sharing over five years of expertise spanning pharmaceutical supply chain analytics, business intelligence, and leading-edge platforms like Azure Data Factory, Databricks, and Power BI.


    The conversation focused on the often under-appreciated work of data engineers, the challenges of maintaining data quality, and the art of making data truly AI-ready. One concept discussed was reporting drift and its impact on business decision-making. A key theme that emerged was the transformative influence of AI integration within analytics platforms such as Power BI, as well as the arrival of AI agents and self-healing data pipelines. The discussion explored the universal lessons from industries like pharma and higher education, the advancing role of dashboards, and just how quickly science fiction is becoming reality in the data space. Get ready for a thought-provoking look at how organizations can future-proof their data infrastructure in the age of AI.

    Links
    • Pratham on LinkedIn -https://www.linkedin.com/in/ypratham4/
    • Watch on YouTube -https://youtu.be/G8JdYyV_Cas

    Time Stamps

    00:00 Intro and guest introduction

    05:47 Copyright challenges in AI training

    07:38 Early doubts about LLM effectiveness

    13:08 Evolving impact of new technology

    16:48 AI simplifying data analysis

    18:41 Frustrations with Stack Overflow

    22:45 AI agents in data engineering

    26:48 AI conversation evolving rapidly

    31:26 Talking about kids and technology

    34:40 Building RAG for file classification

    36:26 Exploring AI in Data Visualization

    40 min
  • Why Mike Dymott Slows His AI Agents Down on Purpose

    Welcome to another episode of Data Driven, where we dive into the evolving landscape of artificial intelligence, data science, and the critical importance of data engineering.

    In this episode, the conversation focused on the journey from traditional CRM systems to AI-powered business solutions, emphasizing why solid data and well-designed processes are more crucial than ever. One concept discussed was the orchestration between humans and AI agents, highlighting the need for seamless handoffs and the risks of letting agents loose on bad data. The discussion explored lessons learned from digital transformation projects, the pitfalls of simply automating broken processes, and the real-world impact of AI on customer experiences.

    A key theme that emerged was the shift towards industry-specific and distributed AI models, along with the increasing importance of resilience, security, and responsible implementation. Tune in for practical insights, war stories from the field, and actionable advice on building trustworthy, effective AI-driven organizations.

    Links
    • Watch on YouTube -https://www.youtube.com/watch?v=CHqv65OGlgM

    Time Stamps

    00:00 Leading ISAM with data focus

    06:44 Understanding Problems in Hackathons

    10:25 Challenges in Business Transformations

    11:45 Discussing digital transformation challenges

    14:59 Handling Failures in Complex Systems

    20:24 Testing with production-like data

    24:11 Blame and responsibility in AI errors

    25:13 Responsibility in AI implementation

    28:07 Security and data center trends

    32:24 Repurposing Cold War data centers

    37:44 Discussing CEO risk and resilience

    39:46 Bill Gates' ongoing influence at Microsoft

    42:15 AI in Motion podcast details

    44 min
  • Would You Trust Your Data Scientists With Your Kubernetes Cluster?

    rank La Vigne, technical marketing manager at Klique, takes the KubeCon stage to talk about GPU control and token control for the SUSE AI Factory. You may not know the name Klique yet — it's ClearML, same DNA, same software, evolved for modern AI implementations, sitting on top of the foundation SUSE already gives you.


    Walking the expo floor, Frank kept hearing two themes: cost control for token spend, and how you integrate AI into Kubernetes. Klique's answer is governed self-serve access, with four pieces: an AI development studio for practitioners, an orchestration engine so admins can manage GPUs, CPUs, and cloud APIs on one screen, a governance engine with spend visibility and auditability, and an AI engine that can sit in front of every model with spend control behind it. Enable, control, publish, and measure — for every user, AI actor, or agent.


    SUSE AI Factory is built for managing the hardware, in a way that's comfortable for Kubernetes engineers. Klique runs on top of that and talks to the AI practitioner. The question Frank would ask IT ops: would you trust your data scientists with access to your Kubernetes cluster? The answer should be no. That's not their wheelhouse. It's the same GPUs and the same hardware, viewed through two lenses — one for the platform team in SUSE Rancher, one for the AI teams. That turns the cluster into pools, policies, and models. The end user sees a well-defined endpoint. Admins keep governance over what people can do and what they can spend, so you're talking to Dana before the surprise bill shows up at the end of the month.


    The LLM gateway is one governed entry point to every model. You can change keys and models to adjust cost without sending a note to every developer to update an endpoint or an environment variable. Spend controls include cost quotas, wallet budgets, and budget metering, authenticated through the gateway and metered per session. A gateway alone, Frank says, is a commodity; tying it to cost, budget, and metering is the point.


    In the live view, a tenant is at 62% of their allocation. Everybody's green except Dana, who's spending all the tokens. Maybe Dana has a good reason. Now you know who to ask — in a friendly way — instead of reverse-engineering it through financial alchemy when the bill arrives.


    This episode is the audio from Frank's talk at KubeCon. The video is linked in the comments. Frank also pointed people to his LinkedIn if they want to talk more about Klique.

    8 min
  • The Collision of AI, Data, and DevOps: Insights from KubeCon 2026

    Welcome to Data Driven, where this week’s episode comes to you live from KubeCon 2026. The conversation focused on the emerging intersection of artificial intelligence, data, and DevOps, highlighting how Kubernetes is poised to play a pivotal role in advancing AI innovation. A key theme that emerged was the rise of tokenomics and the shifting economics of AI, particularly as organizations balance cloud and on-premise solutions in pursuit of cost control and privacy. The discussion explored the growing need for collaboration between IT admins, AI builders, and data scientists, and introduced new strategies for managing AI infrastructure in a rapidly evolving hybrid world. Tune in for insights into the future of AI deployment—and what it means for your career.

    7 min
  • Exploring the Collision of AI and DevOps Worlds at KubeCon North America Day Zero

    Welcome to a special episode of Data Driven, coming to you from day zero of KubeCon North America 2026 in Salt Lake City.

    The conversation focused on the evolving intersection between data, AI, and DevOps, with particular attention to the role of Kubernetes and its growing impact on both worlds. A key theme that emerged was the surprising disconnect between traditional data professionals and Kubernetes, even as the technology increasingly underpins cloud data services and AI workloads. The discussion explored how the convergence of DevOps and AI is forcing a new kind of collaboration, raising questions about tooling, infrastructure, and the right skill sets for future enterprise AI platforms.

    Several points were raised, including the challenges of managing token costs, the need for scalable data solutions, and the importance of creating safe, productive spaces for both infrastructure admins and AI builders. Join us as we dive into the observations and trends shaping the future of data and AI at this year’s KubeCon.

    Links
    • Watch the original live stream -https://www.youtube.com/watch?v=G2tZDGLw23o


    5 min
  • Your SQL Is Correct. Why Is Your Report Wrong?

    Welcome to another episode of Data Driven, the podcast where the worlds of artificial intelligence, data science, and data engineering intersect. In this episode, the conversation focused on the crucial role of data quality, automation, and reporting in healthcare analytics.

    The discussion explored topics such as Electronic Visit Verification (EVV) systems, challenges and strategies in maintaining accurate and reliable data, and the balance between leveraging automation tools like Power BI, Python, and SQL with maintaining compliance and stakeholder trust. Insights were shared on practical data engineering pitfalls, troubleshooting in real-life scenarios, and advice for those starting out in the data field.

    A key theme that emerged was the importance of human judgment in collaboration with technology, and the necessity of continual learning and curiosity in an ever-evolving industry. Whether you're a seasoned data professional or just beginning your analytics journey, this episode offers practical wisdom and firsthand experiences from the front lines of data-driven decision making.

    Links
    • Watch on YouTube -https://www.youtube.com/watch?v=XdwFCO4EQbE

    Time Stamps

    00:00 Tracking and Analyzing Caregiver Timesheets

    06:26 Collaborating and Automating with BI Tools

    09:09 Choosing the right data tools

    12:51 Ensuring Data Quality Standards

    17:41 AI's role in tech industry

    19:35 Automating Data Management and Architecture

    22:56 Setting business requirements for reports

    28:20 Troubleshooting Power BI time zones

    31:35 Troubleshooting and career growth journey

    36:15 Stay curious and keep learning

    37:53 Wrapping up the show

    39 min
  • Human Oversight in AI Agents – Addressing Trust, Authorization, and Enterprise Governance

    The conversation focused on the complex realities of deploying AI agents in enterprise environments, moving beyond the hype to examine what these agents should be allowed to do versus what they can do. One concept discussed was the critical importance of defining clear boundaries and authorizations for AI agents—emphasizing that failures often stem from insufficiently thought-out controls rather than the underlying models themselves 02:08.

    A key theme that emerged was the necessity of human oversight, especially for high-stakes decisions in sectors like healthcare and finance 11:45. The discussion explored evolving practices in agent governance, accountability, and the growing need for transparency as AI systems become increasingly sophisticated and embedded in daily workflows 22:12.

    Several points were raised, including the risks of over-reliance on AI, the need to maintain auditability, and the consequences of blurring the line between human and AI agency. Set against the backdrop of a rapidly shifting technological landscape, this episode offers practical insights for organizations seeking to harness AI responsibly, while staying alert to new ethical and operational challenges.

    Links
    • Nitin on LinkedIn -https://www.linkedin.com/in/nitingupta-profile/
    • Watch on YouTube -https://youtu.be/2g_AZqLRib8


    Time Stamps

    00:00 Challenges in Enterprise AI Agents

    04:14 Comparing AI tools: Muse vs. GrokBot

    08:25 Challenges in AI Adoption and Trust

    11:45 Establishing AI-human decision boundaries

    13:18 Automating Agent Supervision

    18:49 Determining AI vs. human tasks

    19:49 Automating payments with AI

    23:13 Human vs. AI Decision-Making

    27:24 Using AI for presentation feedback

    32:16 Boosting productivity for small businesses

    35:20 Ethical questions in tech industries

    36:35 Impact of AI on Society

    41:26 Prioritizing tasks for automation

    43:20 Learning from major tech frameworks

    45 min
  • Your Security Model Is Stuck in the ’80s. AI Isn’t.

    In this episode of Data Driven, Frank La Vigne talks with Richard Luna, CEO of Protected Harbor, about why security built around keeping attackers outside a network leaves organizations exposed once someone gets in. Richard explains his concern that AI-driven attacks will probe multiple weaknesses at once, and makes the case for layered defenses, network segmentation, and infrastructure designed around the applications it supports.

    The conversation moves from security architecture to the people and processes that make systems dependable. Richard shares how his team plans for failures, works across technical silos, and tests vendor claims before putting equipment into production. Frank and Richard also explore the promise of AI-assisted coding, the experience junior developers need to build, and the expensive gap between a successful demo and software that holds up under real demand.

    From a storage cluster that failed on its second day of testing to a deployment that collapsed under load, the episode offers practical lessons in building durable systems and teams that take responsibility for them.

    Key Takeaways

    • Design beyond the perimeter. Richard argues for barriers and tripwires inside the environment, with attention to how data moves between systems.

    • Build around application needs. Storage performance, traffic separation, redundancy, and failure recovery should reflect the actual workload.

    • Break down technical silos. Developers and infrastructure teams need each other’s knowledge to diagnose problems and implement security effectively.

    • Keep human judgment in AI-assisted development. Generated code and automated tests still need experienced review and realistic load testing.

    • Make accountability specific. Divide responsibilities clearly, give engineers a path to ask for help, and involve clients when they own a blocker.

    • Test before trusting. Vendor assurances and a working demo do not establish how a system will behave in production.


    About the Guest

    Richard Luna is the CEO of Protected Harbor. His career has spanned software development, managed services, hosting, DevOps, and SaaS infrastructure engineering. In this conversation, he brings that experience to the design, operation, and security of systems that businesses depend on.


    Links and Resources
    • Richard on LinkedIn:https://www.linkedin.com/in/richardluna/
    • Protected Harbor:https://www.protectedharbor.com/
    • Watch on YouTube -https://youtu.be/y6ZHVmJtf9o

    Time Stamps

    00:00 Why the 1980s security model falls short

    01:21 Introducing Richard Luna

    02:32 What SaaS infrastructure engineering means

    03:53 AI threats, perimeter defenses, and information silos

    05:44 Building barriers and tripwires

    07:17 Application-aware infrastructure

    10:27 Phased change and lessons from Toyota

    11:22 Rebuilding infrastructure around the workload

    13:37 Collaboration, zero trust, and asking for help

    15:35 Data flow, security, and finding the root cause

    18:19 Listening to clients and earning long-term trust

    20:08 AI-assisted coding and the next generation of developers

    21:17 Why generated tests are not enough

    25:17 DevOps experience and “works on my machine”

    26:58 Learning from the loss of a customer

    29:02 Dividing responsibilities without losing accountability

    31:56 Oversight meetings that remove obstacles

    33:34 Empowering clients and engineers

    35:42 Respect, culture, and learning across teams

    38:06 Building a business by solving clients’ problems

    42:01 Planning for failure instead of fighting fires

    43:01 Stress-testing enterprise storage

    47:01 A deployment failure and the cost of skipping tests

    48:32 Cloud scaling and runaway costs

    49:48 Closing thoughts and connecting with Richard


    Subscribe to Data Driven for more conversations about data science, AI, data engineering, and the people building the systems behind them.

    51 min
  • Beyond Dashboards – How Decision Intelligence Optimizes Industrial Asset Risk

    In this episode of Data Driven, host Frank La Vigne sits down with Andy Pruett, co-founder and CEO of Lumiscent, to explore a topic often overlooked in the industrial sector: it’s not a data problem—it’s a decision problem.

    Andy explains how industrial companies are drowning in sensor data, but struggle to transform that information into actionable decisions that minimize physical asset risk. The conversation dives into how AI-powered decision intelligence can illuminate hidden vulnerabilities, contextualize risk in real-time, and empower industries like mining, manufacturing, and energy to make smarter, faster calls on the shop floor.

    From the challenges of aging infrastructure to the growing retirement wave of experienced engineers, this episode reveals how the right blend of technology and expertise is shaping a new era of operational resilience and risk management.

    Links
    • Andy on LinkedIn -https://www.linkedin.com/in/andypruett/
    • Watch on YouTube -https://www.youtube.com/watch?v=qzpVpgoO5KA
    • Lumicent -https://www.lumicent.com/
    • Blog Post -https://www.franksworld.com/2026/09/28/navigating-the-data-tsunami-from-iot-sensors-to-smarter-decisions-in-industrial-operations/

    Time Stamps

    00:00 Focusing on asset risk management

    03:56 Managing food plant risks

    07:48 Managing information in heavy industries

    11:45 Workforce challenges and knowledge loss

    16:00 Transforming data into decisions

    18:46 Predictive maintenance challenges in plants

    22:14 Adoption urgency and house analogy

    27:32 Collaborating with Risk Engineers

    29:16 Understanding insurance risk strategies

    32:31 Insurance industry changes and parametrics

    36:46 Managing risk in operations

    40:03 Challenges with predictive analytics in cars

    43:02 Getting into engineering from Alaska

    45:37 Handling a power outage crisis

    49:01 Wrapping up and contact info

    51 min
  • How Compliance Became Cool: Richa Kaul on Security, Privacy, and AI

    Welcome back to "Data Driven," the podcast where we explore the cutting edge of data science, AI, and the rapidly evolving world of data governance.

    In this episode, we sit down with Richa Kaul, founder and CEO of Complyance, an AI-driven platform transforming governance, risk, and compliance for enterprises. Drawing on her experience as a data privacy enthusiast and leader in the compliance space, Richa Kaul dives into the pressing challenges of securing sensitive data, the complexities of global compliance frameworks, and how AI both complicates and protects our interconnected world.

    We discuss the pivotal role of the Chief Information Security Officer, the importance of proactive, layered security measures, and why compliance is rapidly gaining attention—not just as a regulatory checkbox, but as a central business strategy. With practical advice for both enterprises and individuals on maintaining digital privacy and security, this episode is essential listening for anyone navigating today’s high-stakes data landscape.

    Links
    • Richa on LinkedIn -https://www.linkedin.com/in/richa-kaul/
    • Complyance Web site -https://www.complyance.com/
    • Complyance on LinkedIn -https://linkedin.com/company/complyancehq/
    • Watch on YouTube -https://www.youtube.com/watch?v=CFsUcm5u4MY


    Timestamped overview


    00:00 Privacy and security frameworks overview

    03:54 Impact of Equifax data breach

    06:21 Focusing on data security

    09:58 Managing complex enterprise security controls

    15:53 Focus on AI and information security

    18:37 Learning from Fire Safety Education

    20:47 Phone security in modern cyber warfare

    24:48 Concerns about IoT device security

    29:10 Protecting Privacy from Algorithms

    30:44 Security and privacy concerns

    35:23 GTA's social commentary on privacy

    39:11 AI's Role in Cybersecurity Awareness

    41:03 Global connectivity and surveillance issues

    44:47 Ending on a positive note

    46 min

About Data Driven

From the publisher's feed

Data Driven: the podcast where we explore the emerging field of Data Science. We bring the best minds in Data, Software Engineering, Machine Learning, and Artificial Intelligence right to you every Tuesday.

More shows like Data Driven

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

31,957 Listeners

London Real by Brian Rose

London Real

1,182 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

144 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,349 Listeners