The Safety of Work

Ep. 132: How much should we worry about the invasiveness of team support AI?


Listen Later

The findings reveal that invasiveness drives negative reactions more than the stated purpose of monitoring, with participants showing skepticism about AI's ability to accurately measure teamwork quality. The hosts emphasize that even well-intentioned monitoring systems introduce psychosocial hazards and stress, requiring organizations to carefully balance potential benefits against worker well-being impacts when implementing AI-powered team support systems.

 

Discussion Points:

  • (00:00) AI team monitoring invasiveness, AI workplace surveillance
  • (03:16) Research paper introduction and authors from Germany
  • (04:48) Previous research on electronic monitoring and employee reactions
  • (08:49) Study one methodology with invasiveness levels and video scenarios
  • (12:12) Study two simulation with teams designing fitness trackers
  • (17:46) Study one findings on invasiveness and fairness perceptions
  • (24:07) Study two results and participant skepticism about monitoring accuracy
  • (32:48) Practical takeaways on invasiveness levels and stakeholder management
  • (40:42) Final recommendations on balancing benefits and invasiveness
  • Like and follow, send us your comments and suggestions for future show topics!

 

Quotes:

Drew Rae: "The moment you divide it up and you just try to analyze the human behavior or analyze the automation, you lose the understanding of where the safety is coming from and what's necessary for it to be safe."

David Provan: "We actually don't think about that automation in the context of the overall system and all of the interfaces and everything like that. So we, we look at AI as AI and, you know, deploying. Introducing ai, but we don't do any kind of comprehensive analysis of, you know, what's gonna be all of the flow on implications and interfaces and potentially unintended consequences or the system, not necessarily just the technology or automation itself."

Drew Rae: People are going to have reactions. And those reactions are gonna have a big impact on their willingness for you to do this in the first place...You can't just force it onto them… All the things that you're trying to improve might actually get worse because of the monitoring.

David Provan: "But I think this paper makes a really good argument, which is actually our automated system should be far more flexible than that. So I might be able to adjust, you know, it's functioning. If I know, if I, if I know enough about how it's functioning and why it's functioning, and I realize that the automation can't understand context and situation, then I should be able to make adjustments."

Drew Rae: Most people don't mind if their car is giving them feedback on their driving, but most people don't like it if their car is phoning home to your boss, giving information about your driving.

 

Resources:

Intelligent automated systems to support human teamwork: perceived invasiveness impacts team members’ psychological reactions negatively

...more
View all episodesView all episodes
Download on the App Store

The Safety of WorkBy David Provan

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

21 ratings


More shows like The Safety of Work

View all
All In The Mind by ABC listen

All In The Mind

759 Listeners

Conversations by ABC listen

Conversations

891 Listeners

Rear Vision — How History Shaped Today by ABC listen

Rear Vision — How History Shaped Today

68 Listeners

PreAccident Investigation Podcast by Todd Conklin

PreAccident Investigation Podcast

169 Listeners

The Economy, Stupid by ABC listen

The Economy, Stupid

24 Listeners

This Working Life by ABC listen

This Working Life

20 Listeners

Ladies, We Need To Talk by ABC listen

Ladies, We Need To Talk

332 Listeners

If You're Listening by ABC listen

If You're Listening

325 Listeners

A Podcast of One's Own with Julia Gillard by A Podcast of One's Own with Julia Gillard

A Podcast of One's Own with Julia Gillard

102 Listeners

The HOP Nerd by Safety FM

The HOP Nerd

18 Listeners

HOP Into Action Podcast Series by Brent Sutton

HOP Into Action Podcast Series

2 Listeners

LEADING SAFELY with Georgina Poole by Georgina Poole

LEADING SAFELY with Georgina Poole

5 Listeners

Quick Smart by ABC listen

Quick Smart

8 Listeners

Punk Rock Safety by Ben Goodheart, David Provan, Ron Gantt

Punk Rock Safety

10 Listeners

Safe As Podcast by Ben Hutchinson

Safe As Podcast

3 Listeners