Tech for Non-Techies

102. When AI goes wrong - Zillow case study


Listen Later

Real estate marketplace Zillow took $500 million in write downs and fired 25% of its workforce in late 2021, largely because a pricing algorithm made a mistake. Learn what went wrong and how to avoid it.

Learning notes from this episode:

  • Zillow started life as an online marketplace for real-estate in 2005, and monetised via advertising. The company decided to diversity and get into the business of flipping houses. Zillow used an algorithm to find properties it believed were undervalued and bought them.
  • When the housing market turned, Zillow was left with massive losses, but its competitors were not.
  • Behind every algorithm is a set of assumptions made by humans. For example, factors like crime rates and commuting distances affect real estate prices and would go into a property pricing algorithm.
  • Machine learning models often assume that the past equals the future, but that is generally not the case in the real world. When the economy changed, the Zillow algorithm did not adjust.
  • Data scientist Prof Datta from Carnegie Mellon says that tools can be built to monitor whether an algorithm is accurate or not. In essence: create a tool to monitor another tool.
  • Non-technical leaders can also participate: ask your tech colleagues how the model is being updated when circumstances change. Simply asking: "the economy is changing. Have we adjusted our pricing algorithm for these changes? How have we done it?" is a good start.

Resources mentioned in this episode:

  • Tech for Non-Techies podcast: Intro to Algorithms and Big Data
  • Inside Big Data: The $500mm+ Debacle at Zillow Offers – What Went Wrong with the AI Models?
Sign up for How To SPEAK TECH for Leaders (FREE class)

-----

If you like learning about how tech products and profits get made, you'll like our newsletter.

It's funny too. Sign up here.

-----

There are 2 ways to apply this work to your goals:

For individuals, APPLY FOR A CONSULTATION CALL for Tech For Non-Techies membership.

For companies: If you want to increase productivity, innovation and diversity, then your non-technical teams need to learn how to collaborate with the techies.

BOOK A CALL to discuss bespoke training & consulting.

We love hearing from our readers and listeners. So if you have questions about the content or working with us, just get in touch on [email protected]

Say hi to Sophia on Twitter and follow her on LinkedIn.

Following us on Facebook, Instagram and TikTok will make you smarter.

...more
View all episodesView all episodes
Download on the App Store

Tech for Non-TechiesBy Sophia Matveeva

  • 5
  • 5
  • 5
  • 5
  • 5

5

23 ratings


More shows like Tech for Non-Techies

View all
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

531 Listeners

The Official SaaStr Podcast: SaaS | Founders | Investors by SaaStr

The Official SaaStr Podcast: SaaS | Founders | Investors

179 Listeners

The McKinsey Podcast by McKinsey & Company

The McKinsey Podcast

377 Listeners

The Knowledge Project by Shane Parrish

The Knowledge Project

2,706 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,096 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

627 Listeners

Invest Like the Best with Patrick O'Shaughnessy by Colossus | Investing & Business Podcasts

Invest Like the Best with Patrick O'Shaughnessy

2,358 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

346 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,995 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

Practical AI by Practical AI LLC

Practical AI

205 Listeners

Me, Myself, and AI by MIT Sloan Management Review

Me, Myself, and AI

110 Listeners

The So What from BCG by Boston Consulting Group BCG

The So What from BCG

219 Listeners

The Morgan Housel Podcast by Morgan Housel

The Morgan Housel Podcast

987 Listeners