Sign up to save your podcasts
Or
Share Data Science #18 - The k-nearest neighbors algorithm (1951)
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Data Science #18 - The k-nearest neighbors algorithm (1951)
In the 18th episode we go over the original k-nearest neighbors algorithm;
Fix, Evelyn; Hodges, Joseph L. (1951). Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties USAF School of Aviation Medicine, Randolph Field, Texas
They introduces a nonparametric method for classifying a new observation 𝑧 z as belonging to one of two distributions, 𝐹 F or 𝐺 G, without assuming specific parametric forms.
Using 𝑘 k-nearest neighbor density estimates, the paper implements a likelihood ratio test for classification and rigorously proves the method's consistency.
The work is a precursor to the modern 𝑘 k-Nearest Neighbors (KNN) algorithm and established nonparametric approaches as viable alternatives to parametric methods.
Its focus on consistency and data-driven learning influenced many modern machine learning techniques, including kernel density estimation and decision trees.
This paper's impact on data science is significant, introducing concepts like neighborhood-based learning and flexible discrimination.
These ideas underpin algorithms widely used today in healthcare, finance, and artificial intelligence, where robust and interpretable models are critical.
View all episodes
By Mike E
3
33 ratings
In the 18th episode we go over the original k-nearest neighbors algorithm;
Fix, Evelyn; Hodges, Joseph L. (1951). Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties USAF School of Aviation Medicine, Randolph Field, Texas
They introduces a nonparametric method for classifying a new observation 𝑧 z as belonging to one of two distributions, 𝐹 F or 𝐺 G, without assuming specific parametric forms.
Using 𝑘 k-nearest neighbor density estimates, the paper implements a likelihood ratio test for classification and rigorously proves the method's consistency.
The work is a precursor to the modern 𝑘 k-Nearest Neighbors (KNN) algorithm and established nonparametric approaches as viable alternatives to parametric methods.
Its focus on consistency and data-driven learning influenced many modern machine learning techniques, including kernel density estimation and decision trees.
This paper's impact on data science is significant, introducing concepts like neighborhood-based learning and flexible discrimination.
These ideas underpin algorithms widely used today in healthcare, finance, and artificial intelligence, where robust and interpretable models are critical.
More shows like Data Science Decoded
View all
Science Friday
6,046 Listeners
More or Less: Behind the Stats
868 Listeners
Quanta Science Podcast
456 Listeners
Hidden Brain
43,343 Listeners
Space Nuts: Astronomy Insights & Cosmic Discoveries
227 Listeners
Something You Should Know
4,228 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
295 Listeners
The Daily
112,758 Listeners
Practical AI
196 Listeners
The Origins Podcast with Lawrence Krauss
490 Listeners
The Supermassive Podcast
284 Listeners
Machine Learning Street Talk (MLST)
92 Listeners
The Ancients
2,801 Listeners
The Rest Is Politics
3,101 Listeners
The Bull - Il tuo podcast di finanza personale
18 Listeners