This week we're revisiting one of Awkward Silences' most memorable episodes.

Much of the conversation around AI in UX involves how it will shape and change researchers' work. This episodes's guest, Jess Holbrook, who leads UX research for Microsoft AI, thinks a lot about how this technology can be improved with design and UX best practices. Jess has spent over a decade working on the UX of AI at companies like Meta and Google. He's also helped develop foundational principles for the ethical use of LLMs.

Jess joined Erin and Ben to reframe the AI conversation, focusing on how UXRs can and should adapt, what working on these systems has taught him about the UX discipline, and his philosophy for building teams that are ready to take on the innovative challenges of tomorrow.

Jess's recommendations: Matt Webb, Maggie Appleton, and the Pessimists Archive Newsletter.

Highlights

• 07:15 Human-Centered AI Evolution
• 17:53 Evolving AI Forecast Strategies
• 24:04 Diverse AI Team Building
• 33:27 Navigating Responsible AI Challenges
• 37:01 Qualitative Analysis with AI Tools
• 40:15 Optimism and Concerns About AI

About Jess
Senior Director of Research specializing in human-centered AI. Early stage investor in AI, AI hardware ecosystems, climate, and anything that seems like the world would be better with it in it. Currently leading UX research for Microsoft AI. Previously led the Generative AI team and supported all UX functions for the Responsible AI and data transparency teams at Meta. I also served on the Board of Forging Youth Resilience, a nonprofit that empowers young people to build physical and mental strength for life by providing access to a national network of community-based fitness programs and mentorship.

Resources

• The AI in UX Research Report
• 20+ Tools for Every Research Phase
• Using AI in UX: A Day-in-the-Life

Erin May sits down with Alec Levin, CEO and Co-Founder of Learners, to explore how researchers can navigate the rapid changes reshaping their field. Alec shares his vision for how AI and automation are creating unprecedented opportunities for research teams willing to step up and lead.

Alec argues that while AI can handle routine tasks like usability testing and surveys, researchers have a chance to focus on higher-value discovery work that includes prototyping and coding. He emphasizes that this is a critical moment for researchers to define their own future rather than letting executives decide their role. The conversation covers practical examples of AI-powered research workflows, the importance of cross-functional collaboration, and why researchers need to be more proactive in pitching their vision internally.

Highlights

• 03:40 Balance sheeting thinking for change
• 06:15 Connecting researchers through community
• 13:11 Discovery research importance 
• 15:02 Vision needed for researcher evolution
• 24:08 Automated research workflows emerging
• 31:16 Human elements AI can't replace

Resources

• AI for User Research 101 Workshop
• What is the New AI in Research Risk Cascade?
• Assessing the ROI of AI in UX Research Webinar
• AI Context Engineering for Research Course

This week we're revisiting one of Awkward Silences' most memorable episodes.

This episode welcomed Ruby Pryor, founder of Rex, a consulting firm specializing in UX research and strategic design.

This episode gets into what it means to demonstrate the "business value" of one's work, specifically how researchers can and should quantify their impact in terms that are tangible to the company. Ruby shared ways to score early wins, build momentum, and overcome communication frictions to find shared value.

Episode Highlights

• 03:14 - UX researcher impact: insights, optimization, prioritization, strategy
• 09:14 - Understanding organizational structures and strategy development collaboration
• 20:22 - Challenge of quantifying impact and strategic level
• 21:33 - Measuring strategy impact: challenges and indicators
• 30:04 - Prioritizing investments based on strong market indicators
• 38:51 - Stakeholders prioritize growth, revenue, and cost reduction

About Our Guest
Ruby Pryor is the founder of Rex, a service design and UX research consulting firm. Her previous roles include UX research at Grab, strategic design at Boston Consulting Group and management consulting at Nous Group. She has taught courses on increasing the impact of UX to learners from 5 continents and has spoken about design and UX at conferences in Asia and Europe.

Resources on UX Research Impact

• How to Track the Impact of Your UX Research
• Leading an Impactful User Research Team
• Use Stakeholder Interviews to Drive Impact

Erin May sits down with Sam Ladner, Senior Principal Researcher of Strategy at Workday, to explore the evolving role of AI in qualitative research. Sam brings a refreshingly balanced perspective on where AI can genuinely help researchers and where it fundamentally cannot replace human insight.

Sam explains how AI has transformed labor-intensive tasks like transcription and closed coding, freeing researchers to focus on the deeper work of sense-making and understanding outliers. She emphasizes that while AI excels at mathematical correlation hunting, qualitative research is about unriddling complex human experiences that require thinking, feeling, and imagination. The conversation covers practical applications like using MAXQDA for AI-assisted coding, the importance of explaining every outlier in qualitative work, and why emotional storytelling must remain exclusively human territory.

Highlights

• 03:09 Why machines can't replace human sense-making
• 08:47 Human moments AI cannot understand
• 12:00 Explaining outliers in qualitative coding
• 16:27 Building effective coding systems for AI
• 21:33 Getting AI to do closed coding properly
• 29:26 When to use AI for low stakes research
• 37:23 AI cannot substitute for qualitative research

About Sam
Sam Ladner (she/her) is a sociologist who helps teams innovate, design, and learn. She is the author of Practical Ethnography: A Guide to Doing Ethnography in The Private Sector and Mixed Methods: A Short Guide to Applied Mixed Methods Research. She has worked on dozens of advanced software projects at Microsoft, Amazon, and most recently Workday, where she worked as a Senior Principal Researcher studying the future of work. She is now an independent researcher and consultant, writing her third book, tentatively titled Practical Foresight: Strategic Foresight in Applied Settings. She received her PhD in sociology from York University and lives in Toronto, Ontario, Canada.

Resources

• Practical Ethnography: A Guide to Doing Ethnography in The Private Sector
• Mixed Methods: A Short Guide to Applied Mixed Methods Research
• Qual vs Quant vs Mixed-Methods Field Guide
• Qualitative Sample Size Calculator

This week we're revisiting one of Awkward Silences' most memorable episodes.

This episode welcomed George Whitfield, an expert in applying AI to the analysis of qualitative data. George discussed the intricate challenges of leveraging language models to interpret expansive open-ended data (like interview transcripts), and emphasized the importance of context and not just keyword or topic identification.

Episode Highlights

• 03:48 - Innovating consumer insights using AI
• 12:21 - Importance of human involvement in AI tools
• 20:04 - Enhance discussion sections with  AI tools
• 26:50 - AI-inspired insights provide inspiration, not guidance
• 34:12 - Interpretation beyond analyzing transcripts
• 36:46 - Applying engineering rigor to the process of building a business

About Our Guest
George Whitfield is an Entrepreneur-in-Residence at the Martin Trust Center for MIT Entrepreneurship, Lecturer at the MIT Sloan School of Management, and Software Engineer at Google. George holds 4 patents and has 3 degrees from MIT including a Bachelors in Electrical Engineering and Computer Science and a Masters and Ph.D. in Materials Science and Engineering.

Resources on Qual Data and AI

• Our AI in UX Report shares findings from a survey of over 1,000 researchers
• What does it mean to "code" qualitative data? This breakdown explains it all.
• Interested in trying an AI tool for your analysis? Here are 20 worth considering.

Erin May sits down with Aneta Kmiecik, founder of Be Your Own Design Team, to tackle one of the biggest questions facing designers today: how to position AI skills in portfolios and resumes. With 15 years in creative industries and a community of 200,000 followers, Aneta brings unique insights into navigating career strategy during this AI transformation.

Aneta reveals her Past Present Future framework for career positioning and explains why most companies aren't explicitly requiring AI skills yet, but smart candidates should still showcase them strategically. She discusses the three designer archetypes emerging at AI native companies and shares practical advice on standing out when AI can generate portfolios and case studies for everyone.

CHAPTERS

00:00 Intro

04:06 AI Skills in Job Descriptions Reality Check

06:52 Research Strategy for AI Portfolio Positioning

14:23 Audience Context Determines AI Skill Positioning
17:49 Past Present Future Portfolio Framework

27:10 Common Portfolio Mistakes in AI Era

35:46 Future of AI Skills in Applications

38:39 Favorite Research Interview Techniques

RESOURCES
Lenny’s Podcast featuring Jenny Wen, Design Lead for Claude - https://www.youtube.com/watch?v=eh8bcBIAAFo
2024 AI in User Research Report - https://www.userinterviews.com/ai-in-ux-research-report 

CONNECT WITH ANETA KMIECIK:

- LinkedIn: Aneta Kmiecik

- Instagram: @ux.aneta

- Newsletter: Be Your Own Design Team

- Portfolio Course: uxportfolio.co

Ben Wiedmaier sits down with user research consultant Nikki Anderson to explore how researchers can stay relevant when budgets are tight and stakeholders are stressed. Nikki runs Drop in Research where she helps teams conduct research, facilitate better meetings, and build research practices from the ground up. She shares how companies are increasingly coming to her with validation requests rather than discovery work, driven by pressure to ship fast and hit numbers. The conversation reveals practical strategies for mixed methods research, using facilitation to drive action from insights, and leveraging AI tools without compromising research quality.

Nikki explains why she creates forcing functions to slow stakeholders down when they want to rush into AI features without understanding the problem. She advocates for parallel convergent research design where surveys, interviews, and secondary research happen simultaneously to deliver insights faster. The discussion covers why synthesis remains a bridge too far for AI, how to turn research presentations into collaborative workshops, and specific ways researchers can demonstrate value through facilitation skills.

Highlights
00:00 Intro
05:20 Mixed Methods and Data Triangulation
10:07 Finding Small Tests When Teams Won't Wait
14:46 Stakeholder Stress Driving Validation Requests
23:30 Facilitation as Core Research Skill
40:03 Using AI for Research Planning
45:39 Demonstrating AI Skills to Stakeholders

Resources
- AI for User Research 101 Course
- 30+ Tools for every phase of UX Research
- AI Context Engineering for Research Course

Ben talks with Kristen DeLap, fractional COO at Econify, to explore how UX'ers can build influence without formal authority. Kristen brings a unique perspective, having evolved from interior design to leading product teams at Herman Miller and now working as an operations executive. She shares practical strategies for understanding decision-making processes, translating design work into business impact, and creating the conditions where teams do their best work.

They also cover essential skills for today's design professionals, including decision literacy, stakeholder translation, and the art of challenging assumptions diplomatically. Kristen emphasizes that while AI can generate design artifacts, it cannot create alignment across teams or orchestrate complex organizational dynamics. She offers concrete tactics like using customer stories to explain roadmaps, minimizing big presentation moments in favor of ongoing stakeholder engagement, and treating colleagues like users to better understand their motivations and constraints.

Highlights

• 11:08 Design Skills That Can't Be Replaced by AI
• 15:56 Decision Literacy in Organizations
• 21:42 Surprising Realities of Leadership Meetings
• 24:36 Building Influence Without Organizational Power
• 29:01 Storytelling via Roadmaps Exercise
• 35:47 What Trade Off Are You Most Uncomfortable Making

Resources

• A Framework for Decision-Driven Research
• Using Research Roadshows for Influence
• The UX Designer's Guide to Research

Erin and Ben chat with Laura Klein, Principal Experience Specialist at Nielsen Norman Group, about the practical realities of AI in user research. Laura teaches a class on AI for researchers and brings a refreshingly balanced perspective to cut through the hype. She explains why those "five simple prompts that will change your life" are mostly nonsense and shares where AI actually works well versus where researchers need to proceed with extreme caution.

Laura also shares her green, yellow, and red light framework for AI adoption. She champions AI for tasks like transcription and meta-analysis of old research data, while warning against using it for synthesis and insights generation without serious human oversight. The conversation explores how AI can help teams move faster without sacrificing quality, the importance of collaborative analysis sessions, and why junior researchers need extra guidance when using these tools.

This episode offers practical guidance for any researcher trying to separate AI reality from the marketing promises flooding their inbox.

Highlights

• 07:07 Green light, yellow light, red light framework
• 11:59 Framework for deciding when to use AI
• 21:06 Will AI change the researcher role
• 31:23 Focus on what AI makes possible
• 35:17 Skills for advocating against AI hype
• 42:07 AI makes things that look like insights

Resources

• Laura's NN/g AI Course
• The AI in UX Research Report
• Using AI Moderation for Research

Ben sits down with Basel Fakhoury, CEO and Co-founder of User Interviews, and Baran Erkel, Chief Strategy Officer at UserTesting, for a conversation about the research industry's evolution. With AI reshaping customer behaviors and business decisions, both executives emphasize how the need for customer insights has never been greater, even as budget pressures mount across organizations.

Basek and Baran share frameworks for executive decision making, explore how AI tools are moving beyond simply replacing human moderators toward creating entirely new research methodologies, and stress that as AI transforms products and experiences over the next few years, customer insights will be fundamental to shaping organizational cultures that keep customers at the center.

Highlights

• 05:15 How research influences corporate strategy
• 12:25 Building effective decision making cultures
• 19:07 Data formats that drive executive decisions
• 26:28 AI everywhere in research tooling landscape
• 29:30 Consolidating insights across teams and tools
• 36:45 Customer centric approach during acquisition integration

Resources

• Read more about the acquisition
• The State of User Research Report
• Visual Design for Research Workshop