The Growth Podcast

How to Do AI-Powered Discovery (Step-by-Step with Live Demo) | Caitlin Sullivan


Listen Later

Today’s Episode

Discovery might be the most important core PM skill for building great products.

But most PMs are unprepared to do discovery in AI. PMs run surveys incorrectly, conduct interviews poorly, and end up with poor insights.

Today will give you the roadmap to avoid all those mistakes.

Caitlin Sullivan is a user research expert who runs courses teaching PMs how to do AI-powered discovery. And in today’s episode, she shows you exactly how she does it.

We’re talking live demos. Step-by-step workflows. Real survey data. Real interview transcripts.

This is a masterclass in discovery. The kind that moves the needle.

----

Brought to you by:

Maven: Get 15% off Caitlin’s courses with code AAKASHxMAVEN

Pendo: The #1 software experience management platform

Jira Product Discovery: Plan with purpose, ship with confidence

Kameleoon: AI experimentation platform

Amplitude: The market-leader in product analytics

----

Key Takeaways:

1. Replicate the human process - Good AI analysis mirrors how experienced researchers work: comb through data first, then synthesize. Never jump straight to "give me themes."2. Use multi-step prompting - Load context in one prompt, run per-participant analysis in the next, then verify. Cramming everything into one prompt degrades quality.3. Code before you count - For surveys, apply inductive coding labels to every response before asking for patterns. Skipping this step leads to miscategorized, unreliable results.4. Always audit AI's work - Force the model to re-check its own analysis. It catches contradictions, overexaggerated intensity ratings, and miscoded responses regularly.5. Claude wins on nuance, Gemini wins on frequency - Claude gives more thorough, complete analysis by default. Gemini surfaces top-frequency themes faster but misses smaller patterns.6. Define everything explicitly - Quotes, ratings, emotional intensity levels, contradiction types. If you assume the model shares your definitions, you'll get inconsistent results.7. Markdown files beat raw transcripts - Converting transcripts to structured markdown improves accuracy and helps you work around token limits on non-Max plans.8. Parallelize with Claude Code agents - Set up agent markdown files for interview and survey analysis, then run both simultaneously. Cuts total analysis time in half again.

----

Related Content

Newsletters:

How to Do Product Discovery Right

Advanced Techniques: Continuous Discovery

Customer Interviews: Advanced Techniques

Podcasts:

Teresa Torres’ Guide to AI Discovery

Complete Course: AI Product Discovery

Ultimate Guide to Knowing Your Users as a PM

----

PS. Please subscribe on YouTube and follow on Apple & Spotify. It helps!

If you want to advertise, email productgrowthppp at gmail.



This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.news.aakashg.com/subscribe
...more
View all episodesView all episodes
Download on the App Store

The Growth PodcastBy Aakash Gupta

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

34 ratings


More shows like The Growth Podcast

View all
The Tim Ferriss Show by Tim Ferriss: Bestselling Author, Human Guinea Pig

The Tim Ferriss Show

16,136 Listeners

This Week in Startups by Jason Calacanis

This Week in Startups

1,298 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

539 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,103 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

627 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

235 Listeners

Practical AI by Practical AI LLC

Practical AI

216 Listeners

My First Million by Hubspot Media

My First Million

2,667 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,213 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

211 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

99 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

228 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

668 Listeners

AI + a16z by a16z

AI + a16z

33 Listeners

How I AI by Claire Vo

How I AI

154 Listeners