Sign up to save your podcasts
Or
Share Episode 58: There is physics in deep learning!
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Episode 58: There is physics in deep learning!
There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
In this episode I explain how all this works.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.
View all episodes
By Francesco Gadaleta
4.2
7272 ratings
There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
In this episode I explain how all this works.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.
More shows like Data Science at Home
View all
On Point with Meghna Chakrabarti
4,022 Listeners
Making Sense with Sam Harris
26,380 Listeners
Nature Podcast
756 Listeners
Software Engineering Daily
626 Listeners
Science Vs
12,130 Listeners
Science Friday
6,467 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
306 Listeners
The Daily
113,121 Listeners
Up First from NPR
56,944 Listeners
The Atlantic Interview
14 Listeners
Modern Wisdom
4,025 Listeners
The Peter Attia Drive
8,043 Listeners
Practical AI
212 Listeners
Consider This from NPR
6,462 Listeners
The Ezra Klein Show
16,525 Listeners