Data Science at Home

How to handle imbalanced datasets


Listen Later

In machine learning and data science in general it is very common to deal at some point with imbalanced datasets and class distributions. This is the typical case where the number of observations that belong to one class is significantly lower than those belonging to the other classes.  Actually this happens all the time, in several domains, from finance, to healthcare to social media, just to name a few I have personally worked with.
Think about a bank detecting fraudulent transactions among millions or billions of daily operations, or equivalently in healthcare for the identification of rare disorders.
In genetics but also with clinical lab tests this is a normal scenario, in which, fortunately there are very few patients affected by a disorder and therefore very few cases wrt the large pool of healthy patients (or not affected).
There is no algorithm that can take into account the class distribution or the amount of observations in each class, if it is not explicitly designed to handle such situations.
In this episode I speak about some effective techniques to handle imbalanced datasets, advising the right method, or the most appropriate one to the right dataset or problem.


In this episode I explain how to deal with such common and challenging scenarios.

...more
View all episodesView all episodes
Download on the App Store

Data Science at HomeBy Francesco Gadaleta

  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

72 ratings


More shows like Data Science at Home

View all
More or Less by BBC Radio 4

More or Less

891 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,639 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

622 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

585 Listeners

BBC Inside Science by BBC Radio 4

BBC Inside Science

413 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

FT Tech Tonic by Financial Times

FT Tech Tonic

99 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,159 Listeners

Practical AI by Practical AI LLC

Practical AI

207 Listeners

Last Week in AI by Skynet Today

Last Week in AI

306 Listeners

Hard Fork by The New York Times

Hard Fork

5,509 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

227 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

611 Listeners

Unhedged by Financial Times & Pushkin Industries

Unhedged

181 Listeners

The Last Invention by Longview

The Last Invention

1,086 Listeners