add to docs
This commit is contained in:
parent
114f63a214
commit
d1ad8db625
|
@ -140,3 +140,16 @@ ExpDecay
|
||||||
InvDecay
|
InvDecay
|
||||||
WeightDecay
|
WeightDecay
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## Gradient Clipping
|
||||||
|
|
||||||
|
Gradient clipping is useful for training recurrent neural networks, which have a tendency to suffer from the exploding gradient problem. An example usage is
|
||||||
|
|
||||||
|
```julia
|
||||||
|
opt = Optimiser(ClipValue(1e-3), ADAM(1e-3))
|
||||||
|
```
|
||||||
|
|
||||||
|
```@docs
|
||||||
|
ClipValue
|
||||||
|
ClipNorm
|
||||||
|
```
|
Loading…
Reference in New Issue