add to docs

This commit is contained in:
Yao Lu 2020-05-09 16:40:26 +08:00
parent 114f63a214
commit d1ad8db625
1 changed files with 13 additions and 0 deletions

View File

@ -140,3 +140,16 @@ ExpDecay
InvDecay
WeightDecay
```
## Gradient Clipping
Gradient clipping is useful for training recurrent neural networks, which have a tendency to suffer from the exploding gradient problem. An example usage is
```julia
opt = Optimiser(ClipValue(1e-3), ADAM(1e-3))
```
```@docs
ClipValue
ClipNorm
```