The Safety of Work

Ep. 132: How much should we worry about the invasiveness of team support AI?


Listen Later

The findings reveal that invasiveness drives negative reactions more than the stated purpose of monitoring, with participants showing skepticism about AI's ability to accurately measure teamwork quality. The hosts emphasize that even well-intentioned monitoring systems introduce psychosocial hazards and stress, requiring organizations to carefully balance potential benefits against worker well-being impacts when implementing AI-powered team support systems.

 

Discussion Points:

  • (00:00) AI team monitoring invasiveness, AI workplace surveillance
  • (03:16) Research paper introduction and authors from Germany
  • (04:48) Previous research on electronic monitoring and employee reactions
  • (08:49) Study one methodology with invasiveness levels and video scenarios
  • (12:12) Study two simulation with teams designing fitness trackers
  • (17:46) Study one findings on invasiveness and fairness perceptions
  • (24:07) Study two results and participant skepticism about monitoring accuracy
  • (32:48) Practical takeaways on invasiveness levels and stakeholder management
  • (40:42) Final recommendations on balancing benefits and invasiveness
  • Like and follow, send us your comments and suggestions for future show topics!

 

Quotes:

Drew Rae: "The moment you divide it up and you just try to analyze the human behavior or analyze the automation, you lose the understanding of where the safety is coming from and what's necessary for it to be safe."

David Provan: "We actually don't think about that automation in the context of the overall system and all of the interfaces and everything like that. So we, we look at AI as AI and, you know, deploying. Introducing ai, but we don't do any kind of comprehensive analysis of, you know, what's gonna be all of the flow on implications and interfaces and potentially unintended consequences or the system, not necessarily just the technology or automation itself."

Drew Rae: People are going to have reactions. And those reactions are gonna have a big impact on their willingness for you to do this in the first place...You can't just force it onto them… All the things that you're trying to improve might actually get worse because of the monitoring.

David Provan: "But I think this paper makes a really good argument, which is actually our automated system should be far more flexible than that. So I might be able to adjust, you know, it's functioning. If I know, if I, if I know enough about how it's functioning and why it's functioning, and I realize that the automation can't understand context and situation, then I should be able to make adjustments."

Drew Rae: Most people don't mind if their car is giving them feedback on their driving, but most people don't like it if their car is phoning home to your boss, giving information about your driving.

 

Resources:

Intelligent automated systems to support human teamwork: perceived invasiveness impacts team members’ psychological reactions negatively

...more
View all episodesView all episodes
Download on the App Store

The Safety of WorkBy David Provan

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

21 ratings


More shows like The Safety of Work

View all
Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,637 Listeners

PreAccident Investigation Podcast by Todd Conklin

PreAccident Investigation Podcast

171 Listeners

Safety on Tap by Andrew Barrett | Coach | Organisational Learning Enabler

Safety on Tap

4 Listeners

A Podcast of One's Own with Julia Gillard by A Podcast of One's Own with Julia Gillard

A Podcast of One's Own with Julia Gillard

82 Listeners

The Money Café with Alan Kohler by Intelligent Investor

The Money Café with Alan Kohler

28 Listeners

Short History Of... by NOISER

Short History Of...

2,818 Listeners

The Rest Is Politics by Goalhanger

The Rest Is Politics

3,145 Listeners

Ukraine: The Latest by The Telegraph

Ukraine: The Latest

1,869 Listeners

The Fin by Australian Financial Review

The Fin

17 Listeners

The Case Of by ABC

The Case Of

272 Listeners

The Rest Is Politics: US by Goalhanger

The Rest Is Politics: US

2,246 Listeners

LEADING SAFELY with Georgina Poole by Georgina Poole

LEADING SAFELY with Georgina Poole

5 Listeners

Punk Rock Safety by Ben Goodheart, David Provan, Ron Gantt

Punk Rock Safety

10 Listeners

Safety Labs by Safety Products Global by Safety Products Global

Safety Labs by Safety Products Global

7 Listeners

Safe As Podcast by Ben Hutchinson

Safe As Podcast

4 Listeners