
Sign up to save your podcasts
Or


There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.
By Francesco Gadaleta4.2
7272 ratings
There is a connection between gradient descent based optimizers and the dynamics of damped harmonic oscillators. What does that mean? We now have a better theory for optimization algorithms.
All the formulas I mention in the episode can be found in the post The physics of optimization algorithms
Enjoy the show.

31,983 Listeners

7,598 Listeners

1,706 Listeners

1,092 Listeners

622 Listeners

584 Listeners

823 Listeners

302 Listeners

98 Listeners

9,156 Listeners

205 Listeners

306 Listeners

5,509 Listeners

228 Listeners

1,107 Listeners