Experiencing Data w/ Brian T. O’Neill  (UX for AI Data Products, SAAS Analytics, Data Product Management)

047 - How Yelp Integrates Data Science, Engineering, UX, and Product Management when Creating AI Products with Yelp’s Justin Norman


Listen Later

In part one of an excellent series on AI product management, LinkedIn Research Scientist Peter Skomoroch and O’Reilly VP of Content Strategy Mike Loukides explained the importance of aligning AI products with your business plans and strategies. In other words, they have to deliver value, and they have to be delivered on time. Unfortunately, this is much easier said than done. I was curious to learn more about what goes into the complex AI product development process, and so for answers I turned to Yelp VP of Data Science Justin Norman, who collaborated with Peter and Mike in the O’Reilly series of articles. Justin is a career data professional and data science leader with experience in multiple companies and industries, having served as director of research and data science at Cloudera Fast Forward Labs, head of applied machine learning at Fitbit, head of Cisco’s enterprise data science office, and as a big data systems engineer with Booz Allen Hamilton. He also served as a Marine Corps Officer with a focus in systems analytics. We covered:

  • Justin’s definition of a successful AI product
  • The two key components behind AI products
  • The lessons Justin learned building his first AI platform and what insights he applied when he went to Yelp.
  • Why AI projects often fail early on, and how teams can better align themselves for success.
  • Who or what Beaker and Bunsen are and how they enable Yelp to test over 700 experiments at any one time.
  • What Justin learned at an airline about approaching problems from a ML standpoint vs. a user experience standpoint—and what the cross-functional team changed as a result.
  • How Yelp incorporates designers, UX research, and product management with its technical teams
  • Why companies should analyze the AI, ML and data science stack and form a strategy that aligns with their needs.
  • The critical role of AI product management and what consideration Justin thinks is the most important when building a ML platform
  • How Justin would approach AI development if he was starting all over at a brand new company
  • Justin’s pros and cons about doing data science in the government vs. the private sector.
  • Quotes from Today’s Episode

    “[My non-traditional background] gave me a really broad understanding of the full stack [...] from the physical layer all the way through delivering information to a decision-maker without a lot of time, maybe in an imperfect form, but really packaged for what we're all hoping to have, which is that value-add information to be able to do something with.” - Justin

    “It's very possible to create incredible data science products that are able to provide useful intelligence, but they may not be fast enough; they may not be [...] put together enough to be useful. They may not be easy enough to use by a layperson.” -Justin

     

    “Just because we can do things in AI space, even if they're automated, doesn't mean that it's actually beneficial or a value-add.” - Justin

    “I think the most important thing to focus on there is to understand what you need to be able to test and deploy rapidly, and then build that framework.” - Justin

    “I think it's important to have a product management team that understands the maturity lifecycle of building out these capabilities and is able to interject and say, ‘Hey, it's time for us to make a different investment, either in parallel, once we've reached this milestone, or this next step in the product lifecycle.’” - Justin

    “...When we talk about product management, there are different audiences. I think [Yelp’s] internal AI product management role is really important because the same concepts of thinking about design, and how people are going to use the service, and making it useful — that can apply to employees just as much as it can to the digital experience that you put out to your end customers.” -Brian

    “You hear about these enterprise projects in particular, where the only thing that ever gets done is the infrastructure. And then by the time they get something ready, it’s like the business has moved on, the opportunity's gone, or some other challenge or the team gets replaced because they haven't shown anything, and the next personcomes in and wants to do it a different way.” - Brian

    Links
    • Yelp
  • O’Reilly three-part article:
    • Part 1
  • Part 2
  • Part 3
  • Bunsen Article (The Yelp AI Platform)
  • Twitter: @JustinJDN
  • Justin’s LinkedIn
  •  

    ...more
    View all episodesView all episodes
    Download on the App Store

    Experiencing Data w/ Brian T. O’Neill  (UX for AI Data Products, SAAS Analytics, Data Product Management)By Brian T. O’Neill from Designing for Analytics

    • 5
    • 5
    • 5
    • 5
    • 5

    5

    39 ratings


    More shows like Experiencing Data w/ Brian T. O’Neill (UX for AI Data Products, SAAS Analytics, Data Product Management)

    View all
    Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

    Software Engineering Radio - the podcast for professional software developers

    262 Listeners

    HBR IdeaCast by Harvard Business Review

    HBR IdeaCast

    254 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    999 Listeners

    Data Skeptic by Kyle Polich

    Data Skeptic

    474 Listeners

    UI Breakfast: UI/UX Design and Product Strategy by Jane Portman

    UI Breakfast: UI/UX Design and Product Strategy

    134 Listeners

    Acquired by Ben Gilbert and David Rosenthal

    Acquired

    3,665 Listeners

    Odd Lots by Bloomberg

    Odd Lots

    1,733 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    429 Listeners

    Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

    Super Data Science: ML & AI Podcast with Jon Krohn

    295 Listeners

    Data Engineering Podcast by Tobias Macey

    Data Engineering Podcast

    142 Listeners

    Masters of Scale by WaitWhat

    Masters of Scale

    3,970 Listeners

    DataFramed by DataCamp

    DataFramed

    267 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    196 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    90 Listeners

    Product Thinking by Melissa Perri

    Product Thinking

    143 Listeners