Sign up to save your podcasts
Or
Share Episode 58: There is physics in deep learning!
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Episode 58: There is physics in deep learning!
There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
In this episode I explain how all this works.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.
View all episodes
By Francesco Gadaleta
4.2
7272 ratings
There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
In this episode I explain how all this works.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.
More shows like Data Science at Home
View all
More or Less
890 Listeners
WSJ Tech News Briefing
1,640 Listeners
Software Engineering Daily
623 Listeners
Talk Python To Me
585 Listeners
BBC Inside Science
413 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
303 Listeners
FT Tech Tonic
99 Listeners
Worklife with Adam Grant
9,162 Listeners
Practical AI
207 Listeners
Last Week in AI
306 Listeners
Hard Fork
5,509 Listeners
This Day in AI Podcast
227 Listeners
The AI Daily Brief: Artificial Intelligence News and Analysis
608 Listeners
Unhedged
181 Listeners
The Last Invention
1,087 Listeners