explicitly broadcast sigmoid

This commit is contained in:
Mike J Innes 2017-08-19 22:04:47 +01:00
parent 4a9dc40e7c
commit ad0e0ea5a7

View File

@ -1,6 +1,6 @@
# Activation Functions
σ(x) = 1 ./ (1 + exp.(-x))
σ(x) = 1 / (1 + exp(-x))
# back!(::typeof(σ), Δ, x) = Δ .* σ(x).*(1.-σ(x))
relu(x) = max(0, x)