adam eta default arg

This commit is contained in:
Mike J Innes 2017-10-18 17:44:21 +01:00
parent e5c8f6d835
commit 99a7697d13

View File

@ -51,7 +51,7 @@ RMSProp(ps, η = 0.001; ρ = 0.9, ϵ = 1e-8, decay = 0) =
[ADAM](https://arxiv.org/abs/1412.6980v8) optimiser.
"""
ADAM(ps; η = 0.001, β1 = 0.9, β2 = 0.999, ϵ = 1e-08, decay = 0) =
ADAM(ps, η = 0.001; β1 = 0.9, β2 = 0.999, ϵ = 1e-08, decay = 0) =
optimiser(ps, p -> adam(p; η = η, β1 = β1, β2 = β2, ϵ = ϵ), p -> invdecay(p, decay), p -> descent(p, 1))
"""