The Nonprofit Fix

Impact Measurement 3.0: From Impossible RCTs to Automated Causal Modeling


Listen Later

Send us a text

What if nonprofits could measure their impact without breaking the bank or succumbing to funder demands for costly trials? Join us on "The Nonprofit Fix" as we unravel the complexities of impact measurement, challenging the dominance of randomized control trials (RCTs) and exploring more accessible alternatives. With three decades of experience in program evaluation, we dissect the limitations of RCTs and the pitfalls of non-experimental studies, which often inflate success rates without truly reflecting causality. Our conversation doesn't stop there—we navigate the promising terrain of AI and machine learning, which holds the potential to revolutionize evaluation methods by leveraging existing data for more accurate and cost-effective assessments.

We then examine the paradigm shift in nonprofit data management, advocating for a transition from compliance-driven collection to harnessing data for real-time insights and program enhancement. Imagine reducing evaluation lag time while simultaneously fostering a dynamic, responsive service delivery—technology makes this possible. By repurposing administrative data and adopting machine learning, nonprofits can create feedback loops that enhance decision-making and program effectiveness. This approach not only transforms service delivery but also generates a culture of continuous improvement that benefits both practitioners and beneficiaries.

Finally, we delve into the nuances of differentiating raw data from genuine impact within the nonprofit sector. With a critical eye, we address the challenges of using simplistic surveys and the role of sophisticated program administrative data systems. The conversation extends to the potential of machine learning to build comprehensive models that reflect true program efficacy. We explore key resources like Project Evident and training opportunities that open new horizons for nonprofits seeking to refine their impact measurement. As we wrap up, we offer a glimpse into our podcast's evolution and tease future discussions on the effects of changes in federal administration on nonprofits.

...more
View all episodesView all episodes
Download on the App Store

The Nonprofit FixBy Pete York & Ken Berger

  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

9 ratings


More shows like The Nonprofit Fix

View all
Fresh Air by NPR

Fresh Air

38,196 Listeners

Stuff You Should Know by iHeartPodcasts

Stuff You Should Know

77,471 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,040 Listeners

TED Radio Hour by NPR

TED Radio Hour

22,135 Listeners

Philosophize This! by Stephen West

Philosophize This!

15,030 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,324 Listeners

Pod Save America by Crooked Media

Pod Save America

86,102 Listeners

The Daily by The New York Times

The Daily

110,847 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,226 Listeners

On Purpose with Jay Shetty by iHeartPodcasts

On Purpose with Jay Shetty

27,078 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,321 Listeners

ReThinking by TED

ReThinking

611 Listeners

A Slight Change of Plans by Pushkin Industries

A Slight Change of Plans

2,037 Listeners

Nonprofit Nation with Julia Campbell by Julia Campbell

Nonprofit Nation with Julia Campbell

59 Listeners

I 501(c) You - The Podcast for NonProfit Board Members by The Corley Company, LLC

I 501(c) You - The Podcast for NonProfit Board Members

11 Listeners