The AI Adoption Podcast

Trust, Explainability, and Human Oversight in AI Defence and Security Systems


Listen Later

In this episode of The AI Adoption Podcast, I speak with Sumeet Bhatia from Cisco about the changing role of AI in defence and security. The discussion stays close to operational reality rather than abstract theory.

We explore how AI now operates at a speed that humans cannot match. That speed allows threats to be detected earlier and systems to respond before damage spreads. At the same time, it creates new risks around trust and control. Sumeet explains that data purity, provenance, and governance are not technical hygiene issues but strategic and operational warfare necessities.

Data integrity runs through the entire conversation. Poisoned data can quietly distort AI behaviour, while misinformation can undermine confidence in the information presented to human decision makers. In defence environments, that loss of confidence can be as damaging as the attack itself.

Explainability becomes critical when decisions carry serious consequences. Opaque models make it difficult to understand how conclusions are reached. Without clear decision trails, accountability weakens and trust erodes under pressure.

We also discuss the rise of multi-vector attacks. Disruption no longer arrives through a single route. Infrastructure, cyber systems, and information channels can all be targeted together. AI helps by recognising patterns across these fronts before instability escalates.

The episode also looks at AI in operational contexts. Defence logistics faces challenges similar to large commercial supply chains. AI can support planning, predict failure points, and improve crisis response when conditions change quickly.

Lessons from defence extend well beyond the military domain. The need for speed must be balanced with verification and human judgement. Policy continues to struggle to keep pace with technical capability and developments.

Human oversight remains essential where lethal decisions are involved. Looking ahead, effective human–AI teaming will depend on new training approaches and a serious investment in skills.

Chapters

00:00 The Rise of Autonomous Cyber Warfare

03:00 AI in Defence and Security

05:58 AI's Role in Threat Detection

08:57 Human-AI Collaboration in National Security

11:59 Data Integrity and Misinformation Challenges

14:50 The Explainability Crisis in AI

17:40 Multi-Vector Attacks and Their Implications

20:54 Operational Enhancements Through AI

23:59 Lessons from Defence for the Private Sector

27:02 Policy Considerations for AI in Defence

30:02 The Future of Human-AI Teaming

...more
View all episodesView all episodes
Download on the App Store

The AI Adoption PodcastBy Professor Ashley Braganza