Machine Learning Cafe

A New Deep Learning Optimizer called Ranger with Less Wright - 005


Listen Later

In this episode, we interview Less Wright, who has set 13 records on the fast.ai leaderboard, and we talk about one of his tricks is using cutting-edge optimizers, he also developed one, which is called Ranger. He talks also about different strategies of using Deep Learning optimizers, it is worth to take those into consideration. We also tested Ranger and in our case, it also outperformed Adam/RAdam variants. Co-host is Levente Szabados.

Less' LinkedIn: https://www.linkedin.com/in/less-wright-22b59017/

Ranger's article: https://medium.com/@lessw/how-we-beat-the-fastai-leaderboard-score-by-19-77-a-cbb2338fab5c

Less' medium articles: https://medium.com/@lessw His article about Mixnet he mentions: https://medium.com/@lessw/meet-mixnet-google-brains-new-state-of-the-art-mobile-ai-architecture-bd6c37abfa3a

His Github: https://github.com/lessw2020

Co-Host: Levente Szabados https://www.linkedin.com/in/levente-szabados-76334728/

---General Info---

Podcast's Website: http://machinelearningcafe.org/ Host's LinkedIn: https://www.linkedin.com/in/miklostoth/ Email of the host: [email protected]

---Copyright Info--- Music is from https://filmmusic.io, intro first part is by Miklos Toth and some free garage band loops. :) intro second part: "Aces High" by Kevin MacLeod, outro "Acid Trumpet" by Kevin MacLeod (https://incompetech.com), License: CC BY (http://creativecommons.org/licenses/by/4.0/)

...more
View all episodesView all episodes
Download on the App Store

Machine Learning CafeBy Miklos Zoltan Toth

  • 5
  • 5
  • 5
  • 5
  • 5

5

3 ratings


More shows like Machine Learning Cafe

View all
Data Skeptic by Kyle Polich

Data Skeptic

474 Listeners

Quanta Science Podcast by Quanta Magazine

Quanta Science Podcast

450 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

429 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

295 Listeners

Machine Learning Guide by OCDevel

Machine Learning Guide

755 Listeners

DataFramed by DataCamp

DataFramed

267 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,076 Listeners

Practical AI by Practical AI LLC

Practical AI

196 Listeners

The Numberphile Podcast by Brady Haran

The Numberphile Podcast

445 Listeners

Learning Bayesian Statistics by Alexandre Andorra

Learning Bayesian Statistics

65 Listeners

Last Week in AI by Skynet Today

Last Week in AI

275 Listeners

Me, Myself, and AI by MIT Sloan Management Review and Boston Consulting Group (BCG)

Me, Myself, and AI

97 Listeners

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

143 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

193 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

418 Listeners