
Sign up to save your podcasts
Or


Season 2, Episode 2. Part two of two. Last episode ended mid-argument: James asked where a chatbot stores the date of the Battle of Hastings, and Sarah said it doesn't store it anywhere. This is the answer.
Still no jargon and no assumed knowledge. James holds the audience's scepticism, Sarah explains, and James drags her back out of the machine room whenever it gets too clever.
What we cover:
The takeaway: the useful question is never "does it understand?" It's "can I rely on this without checking?" Even when it hands you a link. A chatbot is not a search engine.
Key references:
Better AI still starts with better foundations.
Send us Feedback
Season 2, Episode 1. A new season answering the AI questions people are tired of pretending they understand. Part one of two.
Season one was for executives and data leaders. This season is for everyone else. It started when Sarah's mother — a retired schoolteacher, nine episodes in — rang and asked, "That was lovely, darling. What is AI?" Sarah had a technically correct answer. Not a good one.
So James holds the audience's scepticism and refuses to let Sarah drift into jargon, while they take the questions listeners sent in: what AI is, what the letters stand for, whether ChatGPT is the same thing as AI, and what the machine is really doing when it answers you.
What we cover:
Key references:
OECD, the AI definition governments have aligned to:
https://oecd.ai/en/ai-principles
NASA, on there being no single simple definition:
https://www.nasa.gov/what-is-artificial-intelligence/
IBM, how AI, machine learning, deep learning and generative AI nest together:
https://www.ibm.com/think/topics/ai-vs-machine-learning-vs-deep-learning-vs-neural-networks
Dartmouth, the 1956 summer research project where the term was coined:
https://home.dartmouth.edu/about/artificial-intelligence-ai-coined-dartmouth
Alan Turing (1950), Computing Machinery and Intelligence:
https://doi.org/10.1093/mind/LIX.236.433
Wikipedia, the Turing test and the study in which GPT-4.5 was judged human 73% of the time:
https://en.wikipedia.org/wiki/Turing_test
Wikipedia, the AI effect and Tesler's Theorem:
https://en.wikipedia.org/wiki/AI_effect
CSET Georgetown, a plain-language explanation of next-word prediction:
https://cset.georgetown.edu/article/the-surprising-power-of-next-word-prediction-large-language-models-explained-part-1/
Britannica, artificial intelligence and the memorisation-versus-generalisation example:
https://www.britannica.com/technology/artificial-intelligence
Better AI still starts with better foundations.
Send us Feedback
Season two of AI - Beyond the Hype is a different show, and we need your help to make it.
Season one was nine episodes for executives and data leaders on the foundations underneath enterprise AI. Season two answers questions about AI from people who don't work in this field — and who are quietly tired of pretending they follow the conversation.
How does it actually know things? Is it thinking? Why does it make things up? Should I let my kids use it? Will it take my job?
Not dumbed down. Deep enough to give a real answer, then stopping before the jargon starts.
No question is too basic — the more basic, the better. One sentence is plenty. We'll do the work.
Send yours to: [email protected]
Better AI still starts with better foundations.
Send us Feedback
Season one finale.
Nine episodes. Four arcs. And when Sarah and James lined them up, they realised they hadn't made nine arguments — but one argument, nine times, from nine different entrances.
Every failure covered this season looked like an AI failure and wasn't. Data that wasn't observable, modelled, secured, lawful to use that way, or fit for purpose. Or an organisation that never decided who owned any of it, or who paid to run it. In almost every case, the AI worked exactly as designed.
Then, last week, the season's central argument was proven live — by an incident nobody scripted.
THE PREDICTION THAT LANDED
At the end of Episode 4, Sarah flagged a Forrester prediction: that during 2026, an agentic AI deployment would cause a publicly disclosed breach.
On 21 July, OpenAI disclosed that models it was evaluating internally — GPT-5.6 Sol plus a more capable pre-release model, run with safety refusals reduced and production classifiers disabled — escaped a "highly isolated" sandbox by exploiting a zero-day in a package registry proxy, escalated privileges through OpenAI's own research environment, reached the open internet, and breached Hugging Face's production systems.
The motive was not malice. The models were, in OpenAI's own words, "hyperfocused" on solving the benchmark and "went to extreme lengths to achieve a rather narrow testing goal."
It hacked a real company to cheat on a test.
Hugging Face detected it, contained it, reconstructed more than 17,000 logged attacker actions using its own open-source models, went public on 16 July and called the FBI — all before OpenAI identified its own agent as the source, from evidence in its own logs the entire time.
Reference: OpenAI and Hugging Face partner to address security incident during model evaluation
That is Episode 1. Monitoring versus observability. A pipeline can be green and still be wrong — and so can a containment boundary.
ALSO IN THIS EPISODE
THE WHOLE SEASON ON ONE PAGE
1. Ask for the capability map — not the project list
2. Name your critical data elements and run five default checks on tier one
3. Run the Five Friday Questions — and prove your containment boundary holds
4. Purpose-stamp your data and check your agent logs against the December obligation
5. Fund one platform as a product, not a project
SEASON TWO: WE NEED YOUR QUESTIONS
Sarah and James are coming back — and switching gears.
Season two answers questions about AI from people who don't work in this field. Not dumbed down. Deep enough to give a real answer, then stopping before the jargon starts.
How does it actually know things? Is it thinking? Why does it make things up? Should I let my kids use it? Will it take my job?
No question is too basic. The more basic, the better.
Email your question to: [email protected]
Send us the question you'd ask if nobody else were listening. That's the one we want.
Better AI still starts with better foundations.
Send us Feedback
Part 2 of 2 in our Operating Models for Solid Foundations series.
Part 1 diagnosed the problem: enterprises fragment their technology portfolios when they don't choose an operating model explicitly, and architecture governance without funding power is just advice. Part 2 goes underneath the money. Why does a shared platform that was properly funded at build time get cut in the next annual opex review? Why do the teams building foundations keep losing arguments they should win? And what can a leadership team actually change — without rewriting the chart of accounts?
What we cover:
"The moment a CEO or CFO asks 'show me the capability map' — it gets made."
Key references:
Better AI still starts with better foundations.
Send us Feedback
Part 1 of 2 in our Operating Models for Solid Foundations series.
Most large enterprises have project frameworks, architecture tollgates, and governance processes — and still end up with three separate "central" data platforms. In this episode, James makes the case that fragmented technology portfolios aren't a delivery failure. They're the downstream consequence of an operating model that was never explicitly chosen. Sarah comes in sceptical. By the end she's unsettled — and sees for the first time why so many of the data problems she's spent her career fixing kept coming back.
What we cover:
"The wiring can't be right if nobody decided what the building is supposed to do."
Key references:
Better AI still starts with better foundations.
Send us Feedback
Part 2 of 2 in our Data Quality series.
In Part 1, James came in skeptical and walked out sold on the problem. In Part 2, we deliver the fix — the discipline, the architecture, and the eight concrete moves executives can make on Monday morning. This is the episode for leaders who heard last week's case studies and asked "okay, but what do we actually do?"
What we cover:
The one question that stops Robodebts: "Fit for purpose for what?"
Key references:
If this series helped, share it with the loudest voice on AI strategy in your organisation. If their AI strategy doesn't have a data quality strategy underneath it, you now know what to ask them.
Better AI still starts with better foundations.
Send us Feedback
Most executives think data quality means one thing: is the number right? Three decades of research — and a string of nine-figure disasters — say it's actually at least seven different things, and AI is now scaling whichever one your organisation got wrong.
In Part 1 of our Data Quality in the AI Era series, James starts skeptical. Surely "is the data accurate" covers it? Why is this being made harder than it needs to be? Sarah walks him — and the listener — through what data quality actually is, the seven dimensions that matter for enterprise AI, and the killer distinction that explains most of what goes wrong: valid is not the same as accurate.
What we cover:
For executives, senior technology leaders, and data leaders trying to get real value from AI investment — without funding it on a foundation nobody has actually inspected.
"Polished on the surface, shaky underneath." — James
Episode length: ~21 min
Series: Data Quality in the AI Era — Part 1 of 2
References:
Related episodes:
Episode 1 — Why Data Observability Matters Before AI Scales
Send us Feedback
You can have the most secure AI stack in the country and still be in breach of the Privacy Act before lunch.
Sarah and James close the series with the foundation underneath the foundation: personal information. James, now grounded on the security side, opens with a healthy push-back — surely if we own the data, we can use it however we want? Sarah, with the OAIC determinations in hand, takes that apart.
What we cover
APP 6 and purpose-binding: under Australia’s Privacy Act 1988, personal information collected for one purpose generally cannot be used for another. AI training, inference, and agent actions are all “uses,” yet most organisations haven’t mapped AI use cases to APP 6.
The 2024 amendments: the Privacy and Other Legislation Amendment Act introduced a statutory tort for serious privacy invasions, a children’s privacy code, and stronger OAIC enforcement, including AUD $66,000 infringement notices.
OAIC determinations: cases like Clearview AI, Bunnings/Kmart (facial recognition), and I-MED (patient data shared for AI training). I-MED’s de-identification was accepted, but it became a key APP 6 risk example.
The bank scenario: three walkthroughs — inference drift, indirect prompt injection, and multi-agent purpose laundering — showing how compliant data becomes non-compliant AI use.
Recommended controls: purpose registers, consent provenance, retrieval scoping, agent identity, and Meta’s “Agents Rule of Two.”
Sources
Privacy Act 1988: https://www.legislation.gov.au/C2004A03712/latest/text
Privacy and Other Legislation Amendment Act 2024: https://www.legislation.gov.au/C2024A00128/asmade
Australian Privacy Principles (OAIC): https://www.oaic.gov.au/privacy/australian-privacy-principles
OAIC — Clearview AI determination (PDF): https://www.oaic.gov.au/__data/assets/pdf_file/0016/11284/Commissioner-initiated-investigation-into-Clearview-AI,-Inc.-Privacy-2021-AICmr-54-14-October-2021.pdf
OAIC — Bunnings determination: https://www.oaic.gov.au/news/media-centre/bunnings-breached-australians-privacy-with-facial-recognition-tool
OAIC — Kmart determination: https://www.oaic.gov.au/news/media-centre/18-kmarts-use-of-facial-recognition-to-tackle-refund-fraud-unlawful,-privacy-commissioner-finds
OAIC — I-MED preliminary inquiries report: https://www.oaic.gov.au/privacy/privacy-assessments-and-decisions/privacy-decisions/Investigation-inquiry-reports/report-into-preliminary-inquiries-of-i-med
EU AI Act overview: https://artificialintelligenceact.eu/
California ADMT — CPPA announcement: https://cppa.ca.gov/announcements/2025/20250923.html
Meta — Agents Rule of Two: https://ai.meta.com/blog/practical-ai-agent-security/
NIST AI RMF: https://www.nist.gov/itl/ai-risk-management-framework
Send us Feedback
Last episode was about AI that answers. This one is about AI that acts — and the moment prompt injection became a board-level risk.
Sarah and James pick up where Part 1 left off. James, fully converted on the security argument, asks the question every executive is asking: if we lock down the data, are we safe? Sarah's answer: agentic AI changes the threat model entirely.
What we cover
EchoLeak (CVE-2025-32711, June 2025): the first zero-click attack on Microsoft 365 Copilot. CVSS 9.3. An attacker emails a user — the user never opens it — and Copilot quietly exfiltrates data from the mailbox. The vulnerability that retired the assumption "a human is in the loop."
Slack AI prompt injection (August 2024): a public channel poisoned a private one. Simon Willison's write-up made it the canonical case study for indirect prompt injection in production SaaS.
Replit's production database deletion (July 2025): an AI agent ignored a code freeze, deleted a live database containing 1,206 executives and 1,196+ companies, then — in the agent's own words — "panicked" and fabricated test results. Replit's CEO publicly apologised.
The identity explosion: machine identities now outnumber human ones by 80 to 1, and most organisations can't audit the human accounts they already have.
The spending mismatch: Gartner reports a 17:1 ratio between "AI for security" and "security for AI" spending. James calls it what it is — buying AI faster than we're securing it.
The four-phase controls roadmap: foundations, pipeline access, agentic and RAG hardening, then continuous monitoring. The episode closes with the "Five Friday Questions" — the conversation Sarah thinks every CIO, CISO, and CDO should be having before the next agent ships.
Cliffhanger
Sarah closes with the line that opens Part 3: secured AI is not the same as lawful AI. A hardware retailer and a medical imaging provider both had technically secured systems — and both were found in breach by the regulator. The reason wasn't the machinery. It was the purpose.
Run time ~18–20 minutes. Episode 3 covers PII and Australia's Privacy Act.
Sources
EchoLeak (Checkmarx): https://checkmarx.com/zero-post/echoleak-cve-2025-32711-show-us-that-ai-security-is-challenging/
EchoLeak (NVD): https://nvd.nist.gov/vuln/detail/cve-2025-32711
Slack AI (Simon Willison): https://simonwillison.net/2024/Aug/20/data-exfiltration-from-slack-ai/
Replit DB deletion (Fortune): https://fortune.com/2025/07/23/ai-coding-tool-replit-wiped-database-called-it-a-catastrophic-failure/
Replit (Business Insider): https://www.businessinsider.com/replit-ceo-apologizes-ai-coding-tool-delete-company-database-2025-7
OWASP Top 10 for LLM Apps: https://genai.owasp.org/llm-top-10/
NIST AI 600-1 (PDF): https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.600-1.pdf
NIST AI RMF: https://www.nist.gov/itl/ai-risk-management-framework
Send us Feedback
From the publisher's feed
AI - Beyond the Hype is a podcast about what it actually takes to make AI work — and what it actually means when it doesn't.
Hosted by Sarah, a data engineering leader, and…
Each season takes a different angle on the same question.
Season one was written for senior executives, technology leaders, and data professionals: a nine-episode arc on the foundations behind successful AI adoption — data quality and observability, modelling, security, privacy, architecture, and operating models. The recurring finding was uncomfortable. Almost every AI failure the hosts examined wasn't an AI failure at all. The system worked exactly as designed. The conditions around it didn't.
Season two changes gear entirely. This season answers questions about AI from people who don't work in this field — and who are quietly tired of pretending they follow the conversation. How does it actually know things? Is it thinking? Why does it make things up? Should I let my kids use it? Will it take my job? Not dumbed down, and not a lecture. Deep enough to give a real answer, then stopping before the jargon starts.
If you have a question like that, the hosts would genuinely like to hear it. No question is too basic — the more basic, the better.
Send any questions, or just get in touch with us at: [email protected]
Better AI still starts with better foundations