Sign up to save your podcasts
Or
Share Data Science #15 - The First Decision Tree Algorithm (1963)
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Data Science #15 - The First Decision Tree Algorithm (1963)
the 15th episode we went over the paper "Problems in the Analysis of Survey Data, and a Proposal" by James N. Morgan and John A. Sonquist from 1963.
It highlights seven key issues in analyzing complex survey data, such as high dimensionality, categorical variables, measurement errors, sample variability, intercorrelations, interaction effects, and causal chains.
These challenges complicate efforts to draw meaningful conclusions about relationships between factors like income, education, and occupation.
To address these problems, the authors propose a method that sequentially splits data by identifying features that reduce unexplained variance, much like modern decision trees.
The method focuses on maximizing explained variance (SSE), capturing interaction effects, and accounting for sample variability.
It handles both categorical and continuous variables while respecting logical causal priorities.
This paper has had a significant influence on modern data science and AI, laying the groundwork for decision trees, CART, random forests, and boosting algorithms.
Its method of splitting data to reduce error, handle interactions, and respect feature hierarchies is foundational in many machine learning models used today.
Link to full paper at our website:
https://datasciencedecodedpodcast.com/episode-15-the-first-decision-tree-algorithm-1963
View all episodes
By Mike E
3.8
55 ratings
the 15th episode we went over the paper "Problems in the Analysis of Survey Data, and a Proposal" by James N. Morgan and John A. Sonquist from 1963.
It highlights seven key issues in analyzing complex survey data, such as high dimensionality, categorical variables, measurement errors, sample variability, intercorrelations, interaction effects, and causal chains.
These challenges complicate efforts to draw meaningful conclusions about relationships between factors like income, education, and occupation.
To address these problems, the authors propose a method that sequentially splits data by identifying features that reduce unexplained variance, much like modern decision trees.
The method focuses on maximizing explained variance (SSE), capturing interaction effects, and accounting for sample variability.
It handles both categorical and continuous variables while respecting logical causal priorities.
This paper has had a significant influence on modern data science and AI, laying the groundwork for decision trees, CART, random forests, and boosting algorithms.
Its method of splitting data to reduce error, handle interactions, and respect feature hierarchies is foundational in many machine learning models used today.
Link to full paper at our website:
https://datasciencedecodedpodcast.com/episode-15-the-first-decision-tree-algorithm-1963
More shows like Data Science Decoded
View all
Freakonomics Radio
32,003 Listeners
The Joe Rogan Experience
229,169 Listeners
StarTalk Radio
14,322 Listeners
More or Less
890 Listeners
Talk Python To Me
585 Listeners
The Quanta Podcast
532 Listeners
Science Friday
6,401 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
302 Listeners
Pod Save America
87,348 Listeners
Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas
4,182 Listeners
Practical AI
211 Listeners
Machine Learning Street Talk (MLST)
95 Listeners
Hard Fork
5,512 Listeners
The Rest Is History
15,272 Listeners
The Astrophysics Podcast
54 Listeners