vanishing gradient problem
machine learning model training problem of greatly diverging gradient magnitudes between earlier and later layers encountered when training neural networks with backpropagation
Press Enter · cited answer in seconds
0 sources
vanishing gradient problem
Summary
vanishing gradient problem has Wikipedia articles in 11 language editions, a strong signal of global cultural recognition.[1]
Key Facts
- vanishing gradient problem is credited with the discovery of Sepp Hochreiter[2].
- vanishing gradient problem is a type of problem[3].
- vanishing gradient problem is the opposite of exploding gradient problem[4].
- vanishing gradient problem's time of discovery or invention is recorded as 1991[5].
- vanishing gradient problem's facet of is recorded as machine learning[6].
Body
Definition and Type
vanishing gradient problem is a type of problem[3]. It is the opposite of exploding gradient problem[4].
Why It Matters
vanishing gradient problem has Wikipedia articles in 11 language editions, a strong signal of global cultural recognition.[1]