If you want to understand why things go wrong in business, government, education, psychology, AI, and more, you need to know Goodhart's Law: "When a measure becomes a target, it ceases to become a good measure." In this episode, decision theorist David Manheim explains the dynamics behind Goodhart's Law and some potential solutions to it.

Rationally Speaking #240 - David Manheim on "Goodhart's Law and why metrics fail"

Rationally Speaking is the bi-weekly podcast of New York City Skeptics. Join host Julia Galef and guests as they explore the borderlands between reason and nonsense, likely from unlikely, and science from pseudoscience. Any topic is fair game as long as we can bring reason to bear upon it, with both a skeptical eye and a good dose of humor!
We agree with the Marquis de Condorcet, who said that in an open society we ought to devote ourselves to "the tracking down of prejudices in the hiding places where priests, the schools, the government, and all long-established institutions had gathered and protected them."Rationally Speaking was co-created with Massimo Pigliucci, is produced by Benny Pollak, and is recorded in the heart of New York City's Greenwich Village.

Society & Culture

Personal Journals

History

Philosophy

Places & Travel

Science

The idea of giving poor people cash, no strings attached, is "very unappealing" for most donors, admits economist Michael Faye -- but it's still one of the best ways to help the poor. Michael and Julia discuss the philosophy behind his organization (GiveDirectly), the evidence we have so far about cash transfers as an anti-poverty intervention, and the various concerns people have about it: How long-lasting are the effects? Does it make recipients less likely to work? Does it cause inflation?

Is cash the best way to help the poor? (Michael Faye)

 Humanity could thrive for millions of years -- unless our future is cut short by an existential catastrophe. Oxford philosopher Toby Ord explains the possible existential risks we face, including climate change, pandemics, and artificial intelligence. Toby and Julia discuss what led him to take existential risk more seriously, which risks he considers underrated vs. overrated, and how to estimate the probability of existential risk.

Humanity on the precipice (Toby Ord)

Kevin Esvelt, a scientist at MIT, argues that research intended to prevent pandemics is actually putting us in a lot more danger. Also discussed: Kevin's own research on engineering wild animal species. Are the risks worth the benefits?

Dangerous biological research - is it worth it? (Kevin Esvelt)

Ezra Klein explains how Republican and Democrats in the US became so different from each other, ideologically and demographically, and why that trend + our institutions =  political gridlock. Questions covered include: Is polarization necessarily bad? Has the left polarized more than the right? And what should we make of polls that seem to show Republicans and Democrats used to agree on immigration policy?

Why we're polarized (Ezra Klein)

Kathryn Paige Harden, author of “The Genetic Lottery: Why DNA Matters for Social Equality” explains what scientists have learned about how our genes affect our educational success. Why is this research so controversial? And is it worth doing anyway?

Rationally Speaking #240 - David Manheim on "Goodhart's Law and why metrics fail"

Download our free app to listen on your phone