Snacks Weekly on Data Science

Ensuring Data Quality at Petabyte Scale [Glassdoor]


Listen Later

In this episode, we dive into how Glassdoor addresses the challenge of maintaining data quality at a petabyte scale. By treating data as a product, the engineering team built a centralized, scalable platform that enables proactive validation, continuous monitoring, and cross-team collaboration. From data contracts and static code analysis to LLM-based logic checks and anomaly detection, we unpack the key practices behind their approach.

For more details, you can refer to their published tech blog, linked here for your reference: https://medium.com/glassdoor-engineering/data-quality-at-petabyte-scale-building-trust-in-the-data-lifecycle-7052361307a4

...more
View all episodesView all episodes
Download on the App Store

Snacks Weekly on Data ScienceBy Pan Wu

  • 5
  • 5
  • 5
  • 5
  • 5

5

9 ratings


More shows like Snacks Weekly on Data Science

View all
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

537 Listeners

Acquired by Ben Gilbert and David Rosenthal

Acquired

4,631 Listeners

WSJ What’s News by The Wall Street Journal

WSJ What’s News

4,349 Listeners

The Daily by The New York Times

The Daily

112,408 Listeners

Think Fast Talk Smart: Communication Techniques by Matt Abrahams, Think Fast Talk Smart

Think Fast Talk Smart: Communication Techniques

800 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,927 Listeners