AI accused hundreds of thousands of people of fraud without a single human review. Michigan's MiDAS system wrongly flagged nearly forty thousand unemployment claims, while Australia's Robodebt scheme used flawed income averaging to generate false debts tied to severe hardship and multi-billion-dollar settlements. This episode investigates how automated fraud detection erased the presumption of innocence, and why no one checked the algorithm's work. Is artificial intelligence dangerous when nobody reviews its accusations?
Episode notes at: https://aifreakyfacts.com/stories/
Topics Covered:
AI fraud detection systems, automated benefits algorithms, MiDAS unemployment fraud scandal, Robodebt income averaging failure, wrongful fraud accusations, data matching errors, welfare debt recovery automation, Medicaid AI fraud detection, loss of human review, presumption of innocence in AI systems
References:
1. TIME — States' Automated Systems Are Trapping Citizens in Bureaucratic Nightmares With Their Lives on the Line (May 28, 2020, updated 2026).
https://time.com/5840609/algorithm-unemployment/
2. The Markup — The Seven-Year Struggle to Hold an Out-of-Control Algorithm to Account (October 8, 2022).
https://themarkup.org/newsletter/hello-world/the-seven-year-struggle-to-hold-an-out-of-control-algorithm-to-account
3. IEEE Spectrum — Michigan's MiDAS Unemployment System: Algorithm Alchemy Created Lead, Not Gold (June 24, 2021).
https://spectrum.ieee.org/michigans-midas-unemployment-system-algorithm-alchemy-that-created-lead-not-gold
4. SBS News — Robodebt victims share in millions as Australia's largest-ever class action settlement approved (July 17, 2026).
https://www.sbs.com.au/news/article/robotdebt-victims-class-action-settlement-approved/sd5arll0g
5. Pedestrian.TV — The Robodebt Report Absolutely Skewered Our Politicians: Here's Your Explainer On Its Findings (July 10, 2023).
https://www.pedestrian.tv/news/robodebt-royal-comission-findings-explainer/
6. Gordon Legal — Robodebt Class Action Appeal Settlement, official settlement page (updated August 21, 2026).
https://gordonlegal.com.au/services/class-actions/robodebt-class-action-appeal/
7. TechTonic Justice — Inescapable AI: The Ways AI Decides How Low-Income People Work, Live, Learn, and Survive (report).
https://www.techtonicjustice.org/reports/inescapable-ai
8. The HIPAA Journal — HHS Issues RFI Seeking Input on AI Tools and Methodologies for Healthcare Fraud Prevention (February 27, 2026).
https://www.hipaajournal.com/hhs-rfi-ai-methodologies-healthcare-fraud-prevention/
9. FedScoop — With AI assist, CMS has "longer leash" to fight fraud now, official says (May 5, 2026).
https://fedscoop.com/cms-ai-fraud-detection-medicare-medicaid-programs/
10. Federal News Network — CMS's two-pronged approach to crushing fraud, waste, abuse (March 2026).
https://federalnewsnetwork.com/artificial-intelligence/2026/03/cmss-two-pronged-approach-to-crushing-fraud-waste-abuse/
Music Credits:
1. "Dark Pop Instrumental 05" (alanajordan)
https://pixabay.com/music/trap-dark-pop-instrumental-05-490588/
Free for use under the Pixabay license - https://pixabay.com/service/license-summary/
2. "Dark Ambient Emotions Music" (DeusLower)
https://pixabay.com/music/mystery-dark-ambient-emotions-music-259996/
Free for use under the Pixabay license - https://pixabay.com/service/license-summary/
3. "Background Ambient Documentary" (AKTASOK)
https://pixabay.com/music/corporate-background-ambient-documentary-173954/
Free for use under the Pixabay license - https://pixabay.com/service/license-summary/
4. "No One to Blame" (alanajordan)
https://pixabay.com/music/pop-no-one-to-blame-431324/
Free for use under the Pixabay license - https://pixabay.com/service/license-summary/
This podcast is narrated by the host's own voice, powered by AI.