The Data Science Podcast with Fexingo: Analytics, Machine Learning, and Data-Driven Conversations

How Data Leakage Inflates Model Performance


Listen Later

In this episode of The Data Science Podcast, Lucas and Luna dive into one of the most common yet overlooked pitfalls in machine learning: data leakage. They break down how a seemingly innocent preprocessing misstep can cause models to appear 20% more accurate in training only to collapse in production. Using the real-world example of a medical diagnosis model that flagged patient IDs as a top predictor, they explain the three main types of leakage—target, time-series, and preprocessing—and share concrete techniques to prevent each. Lucas also introduces the concept of 'target leakage via feature engineering' where future information sneaks into training data, and Luna challenges the audience to audit their own pipelines. By the end, listeners learn to spot leakage symptoms like suspiciously high AUC scores and zero-error features, and walk away with a simple five-minute audit checklist to safeguard their models.

#DataLeakage #MachineLearning #ModelValidation #DataScience #MLPipelines #FeatureEngineering #TargetLeakage #TimeSeries #Preprocessing #AUCScore #ModelPerformance #HealthcareAI #DataSciencePodcast #FexingoBusiness #BusinessPodcast #Technology #Analytics #DataDriven

Keep every episode free: buymeacoffee.com/fexingo

...more
View all episodesView all episodes
Download on the App Store

The Data Science Podcast with Fexingo: Analytics, Machine Learning, and Data-Driven ConversationsBy Fexingo