Women in Data Science Worldwide

Karen Hao | Covering AI and Ethics Washing in the Tech Industry


Listen Later

Karen Hao trained as a mechanical engineer and then joined a Silicon Valley startup, thinking that technology was the best means to create social change. While surrounded by smart people who were also passionate about using technology for social change, she soon discovered there were no incentives or pathways to accomplish this. “When you're inside a technology company and you're thinking this is going to help change the world, you're often blind to unattended consequences of your work,” she says.

She decided to transition to a career in journalism where she could create social change by raising awareness about social impacts of technologies like AI, and how big tech companies engage in “ethics washing” to protect their profits. She is intrigued by the way that incentives shape the work that is done at a systemic level. She says every tech giant suffers from issues at the systemic level where there are people who deeply care about ethics within the organization, but it doesn't mean the company is willing to change the way their profitable technologies work. And employees are disincentivized to do this work because they could be fired.

A high-profile example was the ethical AI team at Google was doing great work critiquing some of Google’s practices and tried to get the paper published. Google refused to let them publish it, censored their research and then fired both of the team leads. It later came out that this was just one instance of academic censorship, but Google had told many other researchers to strike a positive tone when talking about technology being developed by Google.

For her article, How Facebook Got Addicted to Spreading Misinformationshe did a nine-month investigation into Facebook's responsible AI team that was supposed to be understanding and mitigating the unintended consequences of Facebook's algorithms. She found the team was focused on specific unintended consequences that are good for Facebook's growth like AI bias. It completely ignored the most important harms of Facebook's algorithms—misinformation, amplification, polarization, exacerbation, especially in the wake of the January 6 capital riots—because addressing them would undermine Facebook's growth. There have been times when Facebook was not only ignoring or negligent of the issues that its algorithms might be causing, but also purposely undermining some of the efforts to try and fix it because of this tension with the company's growth.

She was glad to see policymakers cite her article at a recent congressional hearing, and hopes Congress has the political will to regulate companies like Facebook. She says it’s also important for every new generation of Facebook employees to become educated about these issues so they will hold the company accountable. She thinks AI research has shifted a bit over the last five years to be more focused on taking responsibility for societal impacts and part of that evolution is being driven by people on the inside who raised awareness and advocated for change. 

One of Karen’s inspirations to go into journalism was Rachel Carson's book Silent Spring that sparked a widespread environmental movement. She strives to write stories that activate that same level of change, transforming both the cultural discussions and policy around important issues.

RELATED LINKS
Connect with Karen Hao on LinkedIN and Twitter
Find out more about Karen on her website
Find out more about MIT Technology Review
Connect with Margot Gerritsen on Twitter (@margootjeg) and LinkedIn
Find out more about Margot on her Stanford Profile

...more
View all episodesView all episodes
Download on the App Store

Women in Data Science WorldwideBy Professor Margot Gerritsen, Chisoo Lyons

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

46 ratings


More shows like Women in Data Science Worldwide

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,156 Listeners

The Daily by The New York Times

The Daily

112,617 Listeners

Crime Junkie by audiochuck

Crime Junkie

368,760 Listeners

Practical AI by Practical AI LLC

Practical AI

214 Listeners

Life Kit by NPR

Life Kit

4,489 Listeners

The Happiness Lab with Dr. Laurie Santos by Pushkin Industries

The Happiness Lab with Dr. Laurie Santos

14,397 Listeners

矽谷輕鬆談 Just Kidding Tech by 柯柯與肯吉在矽谷

矽谷輕鬆談 Just Kidding Tech

162 Listeners

Think Fast Talk Smart: Communication Techniques by Matt Abrahams, Think Fast Talk Smart

Think Fast Talk Smart: Communication Techniques

812 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

507 Listeners

Hard Fork by The New York Times

Hard Fork

5,468 Listeners

声动早咖啡 by 声动活泼

声动早咖啡

295 Listeners

Networth and Chill with Your Rich BFF by Vivian Tu

Networth and Chill with Your Rich BFF

1,738 Listeners