SlatorPod

#259 What Microsoft’s Misunderstood Copilot Study Actually Means for the Language Industry


Listen Later

Slator’s Head of Research Anna Wyndham joins Florian on the pod to discuss Microsoft’s research paper “Working with AI: Measuring the Occupational Implications of Generative AI”, a study that stirred significant debate across social media.

The paper, based on 200,000 anonymized Microsoft Copilot interactions, aims to understand what tasks people ask AI to perform and how effectively those tasks are completed. Pairing this with the US O*NET database of occupational tasks, researchers created an "AI applicability score" to assess overlap between AI-capable tasks and real-world job functions.

Anna emphasizes that the researchers distinguish between AI performing individual tasks and full jobs. Even the most affected roles, like interpreters and translators, show only partial overlap, around 50%, with activities AI can complete.

Florian and Anna stress that the research does not claim AI will replace top-ranked occupations. Rather, it shows where AI is most often helpful, with knowledge-based activities like writing, summarizing, and gathering information topping the list. 

The Microsoft researchers also acknowledge key limitations. For example, jobs are more than bundles of disconnected tasks; they involve context, judgment, and synthesis, often referred to as the "glue" that AI lacks. Additionally, Anna points out that Copilot’s integration into tools used by knowledge workers may bias the results in its favor.

Ultimately, the duo agree the paper validates what’s already known: AI is helpful for language-related tasks, but not transformational enough yet to supplant the people who perform them.

...more
View all episodesView all episodes
Download on the App Store

SlatorPodBy Slator

  • 4.3
  • 4.3
  • 4.3
  • 4.3
  • 4.3

4.3

6 ratings


More shows like SlatorPod

View all
This American Life by This American Life

This American Life

91,058 Listeners

Economist Podcasts by The Economist

Economist Podcasts

4,184 Listeners

Pod Save America by Crooked Media

Pod Save America

87,797 Listeners

The Daily by The New York Times

The Daily

112,920 Listeners

Up First from NPR by NPR

Up First from NPR

56,673 Listeners

Conan O’Brien Needs A Friend by Team Coco & Earwolf

Conan O’Brien Needs A Friend

59,245 Listeners

Fall of Civilizations Podcast by Fall of Civilizations Podcast

Fall of Civilizations Podcast

5,189 Listeners

Sh**ged Married Annoyed by Chris & Rosie Ramsey

Sh**ged Married Annoyed

1,197 Listeners

Americast by BBC News

Americast

754 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,888 Listeners

The Sales Management. Simplified. Podcast with Mike Weinberg by Mike Weinberg

The Sales Management. Simplified. Podcast with Mike Weinberg

258 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,062 Listeners

Localization Today by MultiLingual Media

Localization Today

0 Listeners