The Product Experience

How to design AI products that users trust - Nina Olding (Gemini, Meta, Weights & Biases)


Listen Later

In this episode, Nina Olding, Staff Product Manager at Weights & Biases and formerly at Google DeepMind, working on trust and compliance for AI, joins Randy to explore the UX challenges of AI‑driven features. As AI becomes increasingly woven into digital products, the traditional UX cues and trust‑signals that users rely on are changing. Nina introduces her framework of the three “A’s” for AI UX: Awareness, Agency, and Assurance, and explains how product teams can build this into their AI‑enabled products without launching a massive transformation programme.

Key Takeaways
— As AI features proliferate, the UX challenge is less about the technology and more about how users perceive, understand and trust the interactions.
— Trust is based on three foundational dimensions for AI‑enabled products: Awareness, Agency, Assurance.
— Awareness: Make it clear when AI is involved (and when it isn’t). Invisible AI = risk of misunderstanding. Magical AI without context = disorientation.
— Agency: Give users control, or at least the option to opt‑out, define boundaries, choose defaults vs advanced settings.
— Assurance: Because AI can be non‑deterministic, you must design for confidence—indicators of reliability, transparency about limitations, ability to question or override outputs.

Chapters
00:00 – Intro: Why AI products are failing on trust
00:47 – Nina Old’s journey from Google DeepMind to Weights & Biases
03:20 – The UX of AI: It's not just a chat window
04:08 – Introducing the Three A’s framework: Awareness, Agency, Assurance
08:30 – Designing for Awareness: Visibility and user signals
14:40 – Agency: Giving users control and escape hatches
21:30 – Assurance: Transparency, confidence indicators, and humility
28:05 – Three key questions to assess AI UX
30:50 – The product case for trust: Compliance, loyalty, and retention
33:00 – Final thoughts: Building the trust muscle

Featured Links: Follow Nina on LinkedIn | Weights & Biases | Check out Nina's 'The hidden UX of AI' slides from Industry Conference Cleveland 2025

Our Hosts
Lily Smith
enjoys working as a consultant product manager with early-stage and growing startups and as a mentor to other product managers. She’s currently Chief Product Officer at BBC Maestro, and has spent 13 years in the tech industry working with startups in the SaaS and mobile space. She’s worked on a diverse range of products – leading the product teams through discovery, prototyping, testing and delivery. Lily also founded ProductTank Bristol and runs ProductCamp in Bristol and Bath.

Randy Silver is a Leadership & Product Coach and Consultant. He gets teams unstuck, helping you to supercharge your results. Randy's held interim CPO and Leadership roles at scale-ups and SMEs, advised start-ups, and been Head of Product at HSBC and Sainsbury’s. He participated in Silicon Valley Product Group’s Coaching the Coaches forum, and speaks frequently at conferences and events. You can join one of communities he runs for CPOs (CPO Circles), Product Managers (Product In the {A}ether) and Product Coaches. He’s the author of What Do We Do Now? A Product Manager’s Guide to Strategy in the Time of COVID-19. A recovering music journalist and editor, Randy also launched Amazon’s music stores in the US & UK.

...more
View all episodesView all episodes
Download on the App Store

The Product ExperienceBy Mind the Product

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

34 ratings


More shows like The Product Experience

View all
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

538 Listeners

a16z Show by Andreessen Horowitz

a16z Show

1,086 Listeners

The Digital Marketing Podcast by Daniel Rowles and Ciaran Rogers

The Digital Marketing Podcast

113 Listeners

Founders by David Senra

Founders

2,143 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,981 Listeners

Creative Confidence Podcast by IDEO U

Creative Confidence Podcast

128 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

REWORK by 37signals

REWORK

209 Listeners

Design Better by The Curiosity Department, sponsored by Wix Studio

Design Better

319 Listeners

Practical AI by Practical AI LLC

Practical AI

209 Listeners

NN/G UX Podcast by Nielsen Norman Group

NN/G UX Podcast

105 Listeners

Product Thinking by Melissa Perri

Product Thinking

147 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

206 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

595 Listeners

AI + a16z by a16z

AI + a16z

35 Listeners