Sign up to save your podcasts
Or
Share Activate deep learning neurons faster with Dynamic RELU (ep. 101)
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Activate deep learning neurons faster with Dynamic RELU (ep. 101)
In this episode I briefly explain the concept behind activation functions in deep learning. One of the most widely used activation function is the rectified linear unit (ReLU).
While there are several flavors of ReLU in the literature, in this episode I speak about a very interesting approach that keeps computational complexity low while improving performance quite consistently.
This episode is supported by pryml.io. At pryml we let companies share confidential data. Visit our website.
Don't forget to join us on discord channel to propose new episode or discuss the previous ones.
References
Dynamic ReLU https://arxiv.org/abs/2003.10027
View all episodes
By Francesco Gadaleta
4.2
7272 ratings
In this episode I briefly explain the concept behind activation functions in deep learning. One of the most widely used activation function is the rectified linear unit (ReLU).
While there are several flavors of ReLU in the literature, in this episode I speak about a very interesting approach that keeps computational complexity low while improving performance quite consistently.
This episode is supported by pryml.io. At pryml we let companies share confidential data. Visit our website.
Don't forget to join us on discord channel to propose new episode or discuss the previous ones.
References
Dynamic ReLU https://arxiv.org/abs/2003.10027
More shows like Data Science at Home
View all
On Point with Meghna Chakrabarti
4,026 Listeners
Making Sense with Sam Harris
26,380 Listeners
Nature Podcast
755 Listeners
Software Engineering Daily
628 Listeners
Science Vs
12,134 Listeners
Science Friday
6,461 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
305 Listeners
The Daily
113,219 Listeners
Up First from NPR
56,957 Listeners
The Atlantic Interview
14 Listeners
Modern Wisdom
4,024 Listeners
The Peter Attia Drive
8,036 Listeners
Practical AI
211 Listeners
Consider This from NPR
6,466 Listeners
The Ezra Klein Show
16,524 Listeners