
Sign up to save your podcasts
Or
There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.
4.2
7272 ratings
There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.
43,851 Listeners
11,267 Listeners
1,063 Listeners
77,233 Listeners
474 Listeners
584 Listeners
200 Listeners
295 Listeners
249 Listeners
267 Listeners
196 Listeners
2,537 Listeners
42 Listeners
2,820 Listeners
5,367 Listeners