Deep Learning - Plain Version

Deep Learning - Plain Version

By Prof. Dr.-Ing. Andreas MaierEducation
Download on the App Store

Deep Learning - Plain Version episodes

  • Deep Learning - Loss and Optimization Part 2

    Deep Learning - Loss and Optimization Part 2

    This video explains hinge loss and its relation to support vector machines. It enables to embed optimization constraints into loss functions.

    Further Reading:

    A gentle Introduction to Deep Learning
    User Loss

    18 min
  • Deep Learning - Loss and Optimization Part 3

    Deep Learning - Loss and Optimization Part 3

    This video discusses details on optimization and different options in gradient descent procedure such as momentum and ADAM.

    References

    [1] Christopher M. Bishop. Pattern Recognition and Machine Learning (Information Science and Statistics). Secaucus, NJ, USA: Springer-Verlag New York, Inc., 2006.

    [2] Anna Choromanska, Mikael Henaff, Michael Mathieu, et al. “The Loss Surfaces of Multilayer Networks.” In: AISTATS. 2015.
    [3] Yann N Dauphin, Razvan Pascanu, Caglar Gulcehre, et al. “Identifying and attacking the saddle point problem in high-dimensional non-convex optimization”. In: Advances in neural information processing systems. 2014, pp. 2933–2941.
    [4] Yichuan Tang. “Deep learning using linear support vector machines”. In: arXiv preprint arXiv:1306.0239 (2013).
    [5] Sashank J. Reddi, Satyen Kale, and Sanjiv Kumar. “On the Convergence of Adam and Beyond”. In: International Conference on Learning Representations. 2018.
    [6] Katarzyna Janocha and Wojciech Marian Czarnecki. “On Loss Functions for Deep Neural Networks in Classification”. In: arXiv preprint arXiv:1702.05659 (2017).
    [7] Jeffrey Dean, Greg Corrado, Rajat Monga, et al. “Large scale distributed deep networks”. In: Advances in neural information processing systems. 2012, pp. 1223–1231.
    [8] Maren Mahsereci and Philipp Hennig. “Probabilistic line searches for stochastic optimization”. In: Advances In Neural Information Processing Systems. 2015, pp. 181–189.
    [9] Jason Weston, Chris Watkins, et al. “Support vector machines for multi-class pattern recognition.” In: ESANN. Vol. 99. 1999, pp. 219–224.
    [10] Chiyuan Zhang, Samy Bengio, Moritz Hardt, et al. “Understanding deep learning requires rethinking generalization”. In: arXiv preprint arXiv:1611.03530 (2016).

    Further Reading:

    A gentle Introduction to Deep Learning

    23 min
  • Deep Learning - Activations, Convolutions, and Pooling Part 3

    Deep Learning - Activations, Convolutions, and Pooling Part 3

    This video presents convolutional layers including the concepts of strided and dilated convolutions and how to compute their gradient.

    Video References:

    Ministry of Silly Walks

    Further Reading:

    A gentle Introduction to Deep Learning

    16 min
  • Deep Learning - Activations, Convolutions, and Pooling Part 4

    Deep Learning - Activations, Convolutions, and Pooling Part 4

    This video presents max and average pooling, introduces the concept of fully convolutional networks, and hints on how this is used to build deep networks.

    References:

    [1] I. J. Goodfellow, D. Warde-Farley, M. Mirza, et al. “Maxout Networks”. In: ArXiv e-prints (Feb. 2013). arXiv: 1302.4389 [stat.ML].
    [2] Kaiming He, Xiangyu Zhang, Shaoqing Ren, et al. “Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification”. In: CoRR abs/1502.01852 (2015). arXiv: 1502.01852.
    [3] Günter Klambauer, Thomas Unterthiner, Andreas Mayr, et al. “Self-Normalizing Neural Networks”. In: Advances in Neural Information Processing Systems (NIPS). Vol. abs/1706.02515. 2017. arXiv: 1706.02515.
    [4] Min Lin, Qiang Chen, and Shuicheng Yan. “Network In Network”. In: CoRR abs/1312.4400 (2013). arXiv: 1312.4400.
    [5] Andrew L. Maas, Awni Y. Hannun, and Andrew Y. Ng. “Rectifier Nonlinearities Improve Neural Network Acoustic Models”. In: Proc. ICML. Vol. 30. 1. 2013.
    [6] Prajit Ramachandran, Barret Zoph, and Quoc V. Le. “Searching for Activation Functions”. In: CoRR abs/1710.05941 (2017). arXiv: 1710.05941.
    [7] Stefan Elfwing, Eiji Uchibe, and Kenji Doya. “Sigmoid-weighted linear units for neural network function approximation in reinforcement learning”. In: arXiv preprint arXiv:1702.03118 (2017).
    [8] Christian Szegedy, Wei Liu, Yangqing Jia, et al. “Going Deeper with Convolutions”. In: CoRR abs/1409.4842 (2014). arXiv: 1409.4842.

    Further Reading:

    A gentle Introduction to Deep Learning

    9 min
  • Deep Learning - Regularization Part 1

    Deep Learning - Regularization Part 1

    This video discusses the problem of over- and underfitting. In order to get a better understanding, we explore the bias-variance trade-off and look into the effects of training data size and number of parameters.

    Further Reading:

    A gentle Introduction to Deep Learning

    11 min

About Deep Learning - Plain Version

From the publisher's feed

 

More shows like Deep Learning - Plain Version

Public Theology - Religion - Education. Interreligious Perspectives by Prof. Dr. Manfred Pirner

Public Theology - Religion - Education. Interreligious Perspectives

0 Listeners

Lineare Algebra I by Prof. Dr. Peter Knabner

Lineare Algebra I

0 Listeners

Foundations of Quantum Mechanics by Prof. Dr. Florian Marquardt

Foundations of Quantum Mechanics

2 Listeners

Die deutsche Königswahl (1125-1411) by Prof. Dr. Stuart Jenks

Die deutsche Königswahl (1125-1411)

0 Listeners

Lectures on Quantum Theory (Elite Graduate Programme) 2015 -Measurements by Dr. Frederic P. Schuller

Lectures on Quantum Theory (Elite Graduate Programme) 2015 -Measurements

1 Listeners

Einführungsvorlesung Mittelalter by Prof. Dr. Stuart Jenks

Einführungsvorlesung Mittelalter

0 Listeners

Lectures on the Geometric Anatomy of Theoretical Physics by Dr. Frederic P. Schuller

Lectures on the Geometric Anatomy of Theoretical Physics

6 Listeners

Quantum Computing by Prof. Dr. Michael J. Hartmann

Quantum Computing

0 Listeners

Modern Optics 3: Quantum Optics by Prof. Dr. Maria Chekhova

Modern Optics 3: Quantum Optics

0 Listeners