DataTalks.Club

Large-Scale Entity Resolution - Sonal Goyal

Listen Later

We talked about:

  • Sonal’s background
  • How the idea for Zingg came about
  • What Zingg is
  • The difference between entity resolution and identity resolution
  • How duplicate detection relates to entity resolution
  • How Sonal decided to start working on Zingg
  • How Zingg works
  • What Zingg runs on
  • Switching from consultancy to working on a new open source solution
  • Why Zingg is open source
  • Open source licensing
  • Working on Zingg initially vs now
  • Zingg’s current and future team
  • Sonal’s biggest current challenge
  • Avoiding problems with entity/identity resolution through database design
  • Identity resolution vs basic joins, data fusions, and fuzzy joins
  • Deterministic matching vs probabilistic machine learning
  • Identity and entity resolution applications for fraud detection
  • Graph algorithms vs classic ML in entity resolution
  • Identity resolution success stories
  • What Sonal would do differently given the chance to start over with Zingg
  • Advice for those seeking to realize their own solution to a data problem
  • Reading suggestion from Sonal
  • Conclusion


    • Links:

    • Open-Source Spotlight demo "Zingg":https://www.youtube.com/watch?v=zOabyZxN9b0
    • Creative Selection: Inside Apple's Design Process During the Golden Age of Steve Jobs book: https://www.amazon.com/Creative-Selection-Inside-Apples-Process/dp/1250194466


      • ML Zoomcamp: https://github.com/alexeygrigorev/mlbookcamp-code/tree/master/course-zoomcamp

      Join DataTalks.Club: https://datatalks.club/slack.html

      Our events: https://datatalks.club/events.html

      ...more
      View all episodesView all episodes
      Download on the App Store
      DataTalks.ClubBy DataTalks.Club
      • 5
      • 5
      • 5
      • 5
      • 5

      5

      7 ratings

      More shows like DataTalks.Club

      View all
      Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

      Software Engineering Radio - the podcast for professional software developers

      272 Listeners

      TED Talks Daily by TED

      TED Talks Daily

      11,175 Listeners

      The Changelog: Software Development, Open Source by Changelog Media

      The Changelog: Software Development, Open Source

      285 Listeners

      Freakonomics Radio by Freakonomics Radio + Stitcher

      Freakonomics Radio

      31,914 Listeners

      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

      Super Data Science: ML & AI Podcast with Jon Krohn

      296 Listeners

      Machine Learning Guide by OCDevel

      Machine Learning Guide

      764 Listeners

      DataFramed by DataCamp

      DataFramed

      268 Listeners

      Learning Bayesian Statistics by Alexandre Andorra

      Learning Bayesian Statistics

      66 Listeners

      The Real Python Podcast by Real Python

      The Real Python Podcast

      138 Listeners

      声动早咖啡 by 声动活泼

      声动早咖啡

      263 Listeners