Product Rising

Moritz Sudhof: Why Being a Skeptic Creates Better AI Outcomes


Listen Later

What separates people who achieve remarkable results with AI from those who struggle to get reliable, accurate, or useful outcomes from the exact same tools?

In this episode of Product Rising, host Shannon Peavey sits down with Stanford researcher and BigSpin AI founder Moritz Sudhof to explore one of the most overlooked challenges in AI adoption: the human factor.

Drawing on research conducted with Stanford professor and Bigspin co-founder Chris Potts, Moritz shares surprising findings from the analysis of tens of thousands of real-world AI conversations. Their work reveals that the difference between successful and unsuccessful AI use often has less to do with the model itself and more to do with how people interact with it.

Why do expert users encounter more AI failures than novices, yet achieve dramatically better outcomes? Why do so many users unknowingly accept flawed outputs? And what skills, behaviors, and product design choices can help close the growing divide between AI power users and everyone else?

This conversation explores the emerging field of AI fluency, the risks of treating AI like an oracle or a vending machine, and why the future of successful AI products depends on designing not just the model, but the interaction between humans and machines.

Moritz is part of our exclusive Product Rising series on AI Ethics, Safety & Responsibility, where host Shannon Peavey speaks with researchers, builders, policymakers, and practitioners working to shape a future where AI delivers meaningful value while preserving human judgment, agency, and trust.

Whether you're a product leader, founder, builder, manager, or everyday AI user, this episode offers practical insights into how to get better outcomes from AI and why your own behavior may be one of the most important variables in the equation.

CHAPTERS

00:00 Why Some People Get Better Results from AI

01:22 Moritz's Journey: From Language Research to AI Products

03:42 AI Is Not a Human Replacement

06:49 The Coaching Experiment That Changed Everything

09:14 Same AI, Different Outcomes

10:43 Designing User Behavior, Not Just AI Behavior

12:13 The Research Behind AI Fluency

15:14 The User Fluency Paradox

17:01 Why Expert Users See More Failures

19:18 Invisible Failures and Silent Mistakes

21:12 The Skills Every AI User Needs

21:55 Embrace the Skeptic Mindset

23:22 The Biggest Misconceptions About AI

25:42 The Vending Machine Problem

26:16 The Growing Divide Between AI Users

28:08 Introducing Bigspin

30:47 Bringing Product Builders Back Into the Room

32:33 Why AI Adoption Isn't a Tool Rollout

34:45 Passengers vs. Pilots

36:24 Improving Your AI Outcomes Today

37:49 What Product Builders Should Demand

40:16 Advice for Product Leaders Building AI Products

42:00 We're Designing Interactions Now

43:15 Final Thoughts and Where to Learn More

📚 Resources

  • Bigspin AI https://bigspin.ai/

  • Stanford University https://www.stanford.edu/

  • BetterUp https://www.betterup.com/

Where to find Moritz Sudhof:

  • Moritz Sudhof on LinkedIn https://www.linkedin.com/in/sudhof/

Where to find Chris Potts

- Chris Potts on LinkedIn https://www.linkedin.com/in/christopher-potts-505611321/ -Chris Potts at Stanford https://web.stanford.edu/~cgpotts/

Where to find the paper Chris and Moritz authored called “A Paradox on AI Fluency” - https://arxiv.org/abs/2604.25905 

Where to find our hosts:

  • Shannon Peavey https://www.linkedin.com/in/spmad/

  • Elizabeth Ames https://www.linkedin.com/in/elizabethames/

🙋🏻‍♀️Where to find Women in Product:

  • On LinkedIn https://www.linkedin.com/company/women-in-product/posts/ 

  • Website https://womenpm.org/

  • Join the Community https://womenpm.org/wip-community/

  • Product Rising on Apple Podcasts https://podcasts.apple.com/us/podcast/product-rising/id1584224561

  • Product Rising on Spotify https://open.spotify.com/show/7bcyVhpdhw0hbiRr6O4h1U

  • Product Rising on YouTube https://www.youtube.com/playlist?list=PLijcNLDj_QE2ge6Wqeh0MLx_qMKwot--9


...more
View all episodesView all episodes
Download on the App Store

Product RisingBy Women In Product

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

12 ratings


More shows like Product Rising

View all
Planet Money by NPR

Planet Money

30,666 Listeners

WSJ What’s News by The Wall Street Journal

WSJ What’s News

4,345 Listeners

The Daily by The New York Times

The Daily

111,948 Listeners

Up First from NPR by NPR

Up First from NPR

56,508 Listeners

The Indicator from Planet Money by NPR

The Indicator from Planet Money

9,532 Listeners

Crime Junkie by Audiochuck

Crime Junkie

370,110 Listeners

On Purpose with Jay Shetty by Perfect Strangers

On Purpose with Jay Shetty

27,775 Listeners

Park Predators by Audiochuck

Park Predators

18,053 Listeners

Anatomy of Murder by Audiochuck

Anatomy of Murder

19,045 Listeners

Product Thinking by Melissa Perri

Product Thinking

148 Listeners

Good Inside with Dr. Becky by Good Inside

Good Inside with Dr. Becky

4,480 Listeners

The Deck by Audiochuck

The Deck

11,682 Listeners

The Mel Robbins Podcast by Mel Robbins

The Mel Robbins Podcast

19,524 Listeners

Product Therapy by SVPG

Product Therapy

15 Listeners

Good Hang with Amy Poehler by The Ringer

Good Hang with Amy Poehler

12,143 Listeners