Experiencing Data w/ Brian T. O’Neill  (UX for AI Data Products, SAAS Analytics, Data Product Management)

125 - Human-Centered XAI: Moving from Algorithms to Explainable ML UX with Microsoft Researcher Vera Liao


Listen Later

Today I’m joined by Vera Liao, Principal Researcher at Microsoft. Vera is a part of the FATE (Fairness, Accountability, Transparency, and Ethics of AI) group, and her research centers around the ethics, explainability, and interpretability of AI products. She is particularly focused on how designers design for explainability. Throughout our conversation, we focus on the importance of taking a human-centered approach to rendering model explainability within a UI, and why incorporating users during the design process informs the data science work and leads to better outcomes. Vera also shares some research on why example-based explanations tend to out-perform [model] feature-based explanations, and why traditional XAI methods LIME and SHAP aren’t the solution to every explainability problem a user may have.

 

Highlights/ Skip to:

  • I introduce Vera, who is Principal Researcher at Microsoft and whose research mainly focuses on the ethics, explainability, and interpretability of AI (00:35)
  • Vera expands on her view that explainability should be at the core of ML applications (02:36)
  • An example of the non-human approach to explainability that Vera is advocating against (05:35)
  • Vera shares where practitioners can start the process of responsible AI (09:32)
  • Why Vera advocates for doing qualitative research in tandem with model work in order to improve outcomes (13:51)
  • I summarize the slides I saw in Vera’s deck on Human-Centered XAI and Vera expands on my understanding (16:06)
  • Vera’s success criteria for explainability (19:45)
  • The various applications of AI explainability that Vera has seen evolve over the years (21:52)
  • Why Vera is a proponent of example-based explanations over model feature ones (26:15)
  • Strategies Vera recommends for getting feedback from users to determine what the right explainability experience might be (32:07)
  • The research trends Vera would most like to see technical practitioners apply to their work (36:47)
  • Summary of the four-step process Vera outlines for Question-Driven XAI design (39:14)
  •  

    Links
    • “Human-Centered XAI: From Algorithms to User Experiences” Presentation
  • “Human-Centered XAI: From Algorithms to User Experiences” Slide Deck 
  • “Human-Centered AI Transparency in the Age of Large Language Models”
  • MSR Microsoft Research
  • Vera's Personal Website
  • ...more
    View all episodesView all episodes
    Download on the App Store

    Experiencing Data w/ Brian T. O’Neill  (UX for AI Data Products, SAAS Analytics, Data Product Management)By Brian T. O’Neill from Designing for Analytics

    • 5
    • 5
    • 5
    • 5
    • 5

    5

    39 ratings


    More shows like Experiencing Data w/ Brian T. O’Neill (UX for AI Data Products, SAAS Analytics, Data Product Management)

    View all
    Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

    Software Engineering Radio - the podcast for professional software developers

    273 Listeners

    HBR IdeaCast by Harvard Business Review

    HBR IdeaCast

    1,855 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,000 Listeners

    Data Skeptic by Kyle Polich

    Data Skeptic

    473 Listeners

    UI Breakfast: UI/UX Design and Product Strategy by Jane Portman

    UI Breakfast: UI/UX Design and Product Strategy

    133 Listeners

    Acquired by Ben Gilbert and David Rosenthal

    Acquired

    3,790 Listeners

    Odd Lots by Bloomberg

    Odd Lots

    1,768 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    438 Listeners

    Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

    Super Data Science: ML & AI Podcast with Jon Krohn

    297 Listeners

    Data Engineering Podcast by Tobias Macey

    Data Engineering Podcast

    138 Listeners

    Masters of Scale by WaitWhat

    Masters of Scale

    3,962 Listeners

    DataFramed by DataCamp

    DataFramed

    268 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    187 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    90 Listeners

    Product Thinking by Melissa Perri

    Product Thinking

    144 Listeners