Lenny's Podcast: Product | Career | Growth

The UX research reckoning is here | Judd Antin (Airbnb, Meta)


Listen Later

Judd Antin has spent 15 years leading research and design teams at companies like Yahoo, Meta, and Airbnb. His direct reports have gone on to lead user research at Figma, Notion, Slack, Robinhood, Duolingo, AllTrails, and more. In our conversation, we unpack the transformation that the user-research field is experiencing. Specifically:

• Where user research went wrong over the past decade

• The three types of research—macro, middle-range, and micro—and the purpose of each

• How to effectively integrate researchers into the product development process

• The “user-centered performance” phenomenon and why it’s a waste of time

• Common tropes about PMs, from researchers

• The ideal ratio of researchers in a company

• Why Judd says NPS is useless, and what to use instead

Brought to you by Teal—Your personal career growth platform | Vanta—Automate compliance. Simplify security | Ahrefs—Improve your website’s SEO for free

Find the full transcript at: https://www.lennysnewsletter.com/p/the-ux-research-reckoning-is-here

Where to find Judd Antin:

• LinkedIn: https://www.linkedin.com/in/juddantin/

• Website: https://juddantin.com/

• Blog: https://medium.com/onebigthought

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• X: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

In this episode, we cover:

(00:00) Judd’s background

(04:16) Critiques and responses to Judd’s post “The UX Research Reckoning Is Here”

(07:33) The state of user research

(08:53) Macro, middle-range, and micro research

(14:05) What teams get wrong when it comes to research

(15:46) The importance of integrating research from the beginning

(17:30) Traits of great researchers

(19:53) Advice for evaluating user researchers

(21:10) Balancing business and product focus

(23:55) User-centered performance

(26:42) The role of intuition in product development

(30:15) Checking your gut instincts

(32:54) Common tropes about PMs, from researchers

(41:02) A/B testing vs. user research

(43:15) Hindsight bias and narrative fallacy

(44:55) Making recommendations based on research

(47:26) Advice for teams on how to leverage researchers

(51:18) How product managers can be better partners to user researchers

(56:53) The ideal ratio of researchers in a company

(59:43) Empowering user researchers to drive impact

(01:03:39) The limitations of NPS as a metric

(01:06:48) The risks of dogfooding

(01:08:51) Lightning round

Referenced:

• Matt Gallivan on LinkedIn: https://www.linkedin.com/in/mattgallivan/

• Janna Bray on LinkedIn: https://www.linkedin.com/in/janna-bray-a4046a25/

• Celeste Ridlen on LinkedIn: https://www.linkedin.com/in/celesteridlen/

• Rebecca Gray on LinkedIn: https://www.linkedin.com/in/rebeccagray2/

• Hannah Pileggi on LinkedIn: https://www.linkedin.com/in/hannah-pileggi-43169314/

• Louise Beryl on LinkedIn: https://www.linkedin.com/in/louise-beryl-13225833/

• The UX Research Reckoning Is Here: https://medium.com/onebigthought/the-ux-research-reckoning-is-here-c63710ea4084

• The end of the “free money” era: https://www.theguardian.com/technology/2023/apr/11/techscape-zirp-tech-boom

• Cognitive biases: https://en.wikipedia.org/wiki/List_of_cognitive_biases

• IDEO design thinking: https://designthinking.ideo.com/

Everything Is Obvious: How Common Sense Fails Us: https://www.amazon.com/Everything-Obvious-Common-Sense-Fails/dp/0307951790

• Patrick Collison’s tweet: https://twitter.com/patrickc/status/1443215022029619200?lang=en

• Brian Chesky on LinkedIn: https://www.linkedin.com/in/brianchesky/

• Brian Chesky on Lenny’s Podcast: https://www.lennyspodcast.com/brian-cheskys-new-playbook/

• NPS: https://en.wikipedia.org/wiki/Net_promoter_score

• What is CSAT and how do you measure it?: https://www.qualtrics.com/experience-management/customer/what-is-csat/

• Michael Murakami on LinkedIn: https://www.linkedin.com/in/michaelhmurakami/

Bad Leadership: What It Is, How It Happens, Why It Matters: https://www.amazon.com/Bad-Leadership-Happens-Matters-Common/dp/1591391660

Demon Copperhead: https://www.amazon.com/Demon-Copperhead-Novel-Barbara-Kingsolver/dp/0063251922

All Systems Red: The Murderbot Diaries: https://www.amazon.com/All-Systems-Red-Murderbot-Diaries/dp/0765397536

The Last of Us on HBO: https://www.hbo.com/the-last-of-us

• Belay glasses: https://www.amazon.com/Belay-Glasses-Climbing-Comfortable-Sturdy/dp/B08GSBYDKQ/

• Epictetus: Control What You Can—Especially Yourself: https://www.shortform.com/blog/epictetus-control/

The 7 Habits of Highly Effective People: Powerful Lessons in Personal Change: https://www.amazon.com/Habits-Highly-Effective-People-Powerful/dp/0743269519

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email [email protected].

Lenny may be an investor in the companies discussed.



This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.lennysnewsletter.com/subscribe
...more
View all episodesView all episodes
Download on the App Store

Lenny's Podcast: Product | Career | GrowthBy Lenny Rachitsky

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

1,300 ratings


More shows like Lenny's Podcast: Product | Career | Growth

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,276 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,058 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

523 Listeners

The Knowledge Project with Shane Parrish by Shane Parrish

The Knowledge Project with Shane Parrish

2,665 Listeners

The Official SaaStr Podcast: SaaS | Founders | Investors by SaaStr

The Official SaaStr Podcast: SaaS | Founders | Investors

175 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,991 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

425 Listeners

Product Thinking by Melissa Perri

Product Thinking

144 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

127 Listeners

AI + a16z by a16z

AI + a16z

32 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

20 Listeners

Training Data by Sequoia Capital

Training Data

43 Listeners

Uncapped with Jack Altman by Alt Capital

Uncapped with Jack Altman

34 Listeners

How I AI by Claire Vo

How I AI

4 Listeners