
Sign up to save your podcasts
Or
In this episode, we are focusing on Deep Learning Optimizers, the different Gradient Descent Variants from vanilla GD to RAdam and Ranger. Levente tells us the story of GD from the simplest ones to the newest ones. This is part 1.
Levente's Linkedin URL: https://www.linkedin.com/in/levente-szabados-76334728/
An overview of gradient descent optimization algorithms: https://arxiv.org/pdf/1609.04747.pdf
Lookahead optimizer algorithm: https://arxiv.org/pdf/1907.08610.pdf
Ranger optimizer by Less Wright: https://medium.com/@lessw/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d
---Copyright Info--- Music is from https://filmmusic.io, intro first part is by Miklos Toth and some free garage band loops. :) intro second part: "Aces High" by Kevin MacLeod, outro "Acid Trumpet" by Kevin MacLeod (https://incompetech.com), License: CC BY (http://creativecommons.org/licenses/by/4.0/)
5
33 ratings
In this episode, we are focusing on Deep Learning Optimizers, the different Gradient Descent Variants from vanilla GD to RAdam and Ranger. Levente tells us the story of GD from the simplest ones to the newest ones. This is part 1.
Levente's Linkedin URL: https://www.linkedin.com/in/levente-szabados-76334728/
An overview of gradient descent optimization algorithms: https://arxiv.org/pdf/1609.04747.pdf
Lookahead optimizer algorithm: https://arxiv.org/pdf/1907.08610.pdf
Ranger optimizer by Less Wright: https://medium.com/@lessw/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d
---Copyright Info--- Music is from https://filmmusic.io, intro first part is by Miklos Toth and some free garage band loops. :) intro second part: "Aces High" by Kevin MacLeod, outro "Acid Trumpet" by Kevin MacLeod (https://incompetech.com), License: CC BY (http://creativecommons.org/licenses/by/4.0/)
470 Listeners
477 Listeners
434 Listeners
296 Listeners
763 Listeners
269 Listeners
4,103 Listeners
190 Listeners
446 Listeners
65 Listeners
282 Listeners
101 Listeners
137 Listeners
190 Listeners
422 Listeners