Scope Conditions Podcast

Randomizing Together (Part 2), with Tara Slough and Graeme Blair


Listen Later

Today’s episode is Part 2 of our conversation about metaketas with Dr. Tara Slough, an Assistant Professor of Politics at NYU, who co-led with Daniel Rubenson a metaketa on the governance of natural resources that was published this year in PNAS; and Dr. Graeme Blair, an Assistant Professor of Political Science at UCLA, who co-led a metaketa with Fotini Christia and Jeremy Weinstein testing the effects of community policing. The main paper from that project was just published last month in Science.

In Part 1, we learned what a metaketa is, how it’s typically organized, and what the benefits are of having coordinated teams experimentally test the same (or very similar) interventions across multiple contexts. We also talked about each of the two EGAP metaketas that Tara and Graeme co-led – the first on natural resource governance and the second on community policing. 

In today’s episode, we talk with Tara and Graeme about deeper conceptual issues, practical constraints, and equity considerations around metaketas. It’s fairly simple to interpret the results if we find the same effect across settings -- but what do we conclude if we see different treatment effects across the different sites? We also ask how far metaketas can get us toward generalizability: it’s one thing to compare results across 6 test sites, but can we extrapolate to other contexts outside of the metaketa?

And while metaketas are a powerful tool, we also learn from Tara and Graeme about their challenges and limitations. What was it like coordinating across six research teams, all with their own local constraints, timelines, and publication incentives? What are the equity concerns that come up when so many resources are allocated to a single question? And we talk about the professional considerations that scholars, particularly junior scholars, should keep in mind when signing up to participate in a metaketa.

As a reminder, we left off in Part 1 discussing how to pool estimates across study sites to get an average treatment effect. This is where we pick up the conversation. 

For references to all the academic works discussed in this episode, visit the episode webpage at https://www.scopeconditionspodcast.com/episodes/episode-24-randomizing-together-part-2-with-tara-slough-and-graeme-blair

...more
View all episodesView all episodes
Download on the App Store

Scope Conditions PodcastBy Alan Jacobs and Yang-Yang Zhou

  • 5
  • 5
  • 5
  • 5
  • 5

5

32 ratings


More shows like Scope Conditions Podcast

View all
Radiolab by WNYC Studios

Radiolab

43,821 Listeners

Planet Money by NPR

Planet Money

30,688 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,075 Listeners

99% Invisible by Roman Mars

99% Invisible

26,169 Listeners

New Books in Political Science by New Books Network

New Books in Political Science

62 Listeners

In Our Time: History by BBC Radio 4

In Our Time: History

1,871 Listeners

The Audio Long Read by The Guardian

The Audio Long Read

841 Listeners

Explain It to Me by Vox

Explain It to Me

7,838 Listeners

ChinaPower by CSIS | Center for Strategic and International Studies

ChinaPower

204 Listeners

The Playbook Podcast by POLITICO

The Playbook Podcast

668 Listeners

Lovett or Leave It by Crooked Media

Lovett or Leave It

25,046 Listeners

The Science of Politics by Niskanen Center

The Science of Politics

69 Listeners

The Indicator from Planet Money by NPR

The Indicator from Planet Money

9,510 Listeners

Ones and Tooze by Foreign  Policy

Ones and Tooze

328 Listeners

POLITICO Berlin Playbook by POLITICO

POLITICO Berlin Playbook

11 Listeners