Start / Data Skeptic / Mini the vanishing gradient

[MINI] The Vanishing Gradient

15 min • 30 juni 2017

This episode discusses the vanishing gradient - a problem that arises when training deep neural networks in which nearly all the gradients are very close to zero by the time back-propagation has reached the first hidden layer. This makes learning virtually impossible without some clever trick or improved methodology to help earlier layers begin to learn.

Senaste avsnitt

Network of Past Guests Collaborations

21 juli | 34 min

The Network Diversion Problem

6 juli | 46 min

Complex Dynamic in Networks

28 juni | 56 min

Github Network Analysis

22 juni | 37 min

Networks and Complexity

14 juni | 18 min

Podcastbild

00:00 -00:00

Podcastbild

00:00 -00:00