Sign up to save your podcasts
Or
Share Activate deep learning neurons faster with Dynamic RELU (ep. 101)
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Activate deep learning neurons faster with Dynamic RELU (ep. 101)
In this episode I briefly explain the concept behind activation functions in deep learning. One of the most widely used activation function is the rectified linear unit (ReLU).
While there are several flavors of ReLU in the literature, in this episode I speak about a very interesting approach that keeps computational complexity low while improving performance quite consistently.
This episode is supported by pryml.io. At pryml we let companies share confidential data. Visit our website.
Don't forget to join us on discord channel to propose new episode or discuss the previous ones.
References
Dynamic ReLU https://arxiv.org/abs/2003.10027
View all episodes
By Francesco Gadaleta
4.2
7272 ratings
In this episode I briefly explain the concept behind activation functions in deep learning. One of the most widely used activation function is the rectified linear unit (ReLU).
While there are several flavors of ReLU in the literature, in this episode I speak about a very interesting approach that keeps computational complexity low while improving performance quite consistently.
This episode is supported by pryml.io. At pryml we let companies share confidential data. Visit our website.
Don't forget to join us on discord channel to propose new episode or discuss the previous ones.
References
Dynamic ReLU https://arxiv.org/abs/2003.10027
More shows like Data Science at Home
View all
On Point with Meghna Chakrabarti
4,022 Listeners
Making Sense with Sam Harris
26,380 Listeners
Nature Podcast
756 Listeners
Software Engineering Daily
626 Listeners
Science Vs
12,130 Listeners
Science Friday
6,467 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
306 Listeners
The Daily
113,121 Listeners
Up First from NPR
56,944 Listeners
The Atlantic Interview
14 Listeners
Modern Wisdom
4,025 Listeners
The Peter Attia Drive
8,043 Listeners
Practical AI
212 Listeners
Consider This from NPR
6,462 Listeners
The Ezra Klein Show
16,525 Listeners