Beyond The Prompt - How to use AI in your company

Chief of Staff for the Masses: How Meta’s Joshua To Designs Wearables with AI


Listen Later

In this episode, Joshua To, VP of Product Design at Meta, shares how AI is reshaping how—and where—we interact with technology. He walks us through Meta’s evolving approach to AR and wearables, why notifications are still the killer use case, and how AI is becoming the “brain behind empathy.”

We dig into what it means to build interfaces that understand you, why audio might be the future’s most underrated platform, and how designing for emotion changes everything—from form factor to function. Joshua also reflects on his path from launching a clothing brand to leading design at Google and Meta, and what those worlds taught him about craft, context, and human-centered systems.

This one’s for anyone designing AI into the real world—where every interface choice carries weight, and intelligence starts with listening.

Key takeaways: 

  • Empathy Is the Real Intelligence — Joshua flips the definition of smart tech. It’s not just about outputs—it’s about understanding you. Context, tone, emotion—that’s what great AI will sense and respond to.
  • Design for the Moment, Not the Feed — AR’s killer use case isn’t games—it’s restraint. Joshua shares why the best AI product might just be the one that knows not to ping you. Context-aware computing is the real unlock.
  • Audio Is the Interface to Watch — Forget screens. The most powerful interface might be your ears. From wearables to ambient signals, Joshua explains why audio design is the next big frontier for human-centered AI.
  • AR Isn’t a Feature—It’s a System of Consideration — Joshua reframes augmented reality as quiet, ambient infrastructure. The real power of AR isn’t spectacle—it’s subtlety. It helps you move through the world with less friction, not more.

LinkedIn: Joshua To | LinkedIn
Website: Home - Joshua To
Meta: Meta Careers

00:00 Intro: Fixing Notifications With AI
00:54 Meet Josh: VP of Product Design at Meta
02:06 From Hoodies to Hardware: Josh's Journey
03:53 The Google Experience: From Ads to Product Management
10:37 The Evolution of Google Glass and AR
19:12 The Role of AI in Josh's Career
22:25 Designing the Future: AR, VR, and Attention Management
32:49 Contextually Aware Suggestions
33:38 Leveraging Generative AI in Design
34:52 AI's Role in Concept Art and Storyboarding
41:24 AI Tools and Model Capabilities
45:54 The Future of AI and Wearables
51:58 Reflections and Takeaways

📜 Read the transcript for this episode: Transcript of Chief of Staff for the Masses: How Meta’s Joshua To Designs Wearables with AI

 

For more prompts, tips, and AI tools. Check out our website: https://www.beyondtheprompt.ai/ or follow Jeremy or Henrik on Linkedin:

Henrik: https://www.linkedin.com/in/werdelin
Jeremy: https://www.linkedin.com/in/jeremyutley

 

Show edited by Emma Cecilie Jensen. 

...more
View all episodesView all episodes
Download on the App Store

Beyond The Prompt - How to use AI in your companyBy Jeremy Utley & Henrik Werdelin

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

53 ratings


More shows like Beyond The Prompt - How to use AI in your company

View all
NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

341 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Me, Myself, and AI by MIT Sloan Management Review

Me, Myself, and AI

105 Listeners

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

150 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

209 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

557 Listeners

Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

Everyday AI Podcast – An AI and ChatGPT Podcast

105 Listeners

A Beginner's Guide to AI by Dietmar Fischer

A Beginner's Guide to AI

47 Listeners

AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

71 Listeners

The Next Wave - AI and The Future of Technology by Hubspot Media

The Next Wave - AI and The Future of Technology

60 Listeners

The TED AI Show by TED

The TED AI Show

45 Listeners

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic by Jaeden Schafer and Conor Grennan

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic

134 Listeners

Leveraging AI by Isar Meitis

Leveraging AI

59 Listeners

AI Explored by Michael Stelzner, Social Media Examiner—AI marketing

AI Explored

85 Listeners

Using AI at Work: AI in the Workplace & Generative AI for Business Leaders by Chris Daigle

Using AI at Work: AI in the Workplace & Generative AI for Business Leaders

18 Listeners