explicitly broadcast sigmoid
This commit is contained in:
parent
4a9dc40e7c
commit
ad0e0ea5a7
@ -1,6 +1,6 @@
|
||||
# Activation Functions
|
||||
|
||||
σ(x) = 1 ./ (1 + exp.(-x))
|
||||
σ(x) = 1 / (1 + exp(-x))
|
||||
# back!(::typeof(σ), Δ, x) = Δ .* σ(x).*(1.-σ(x))
|
||||
|
||||
relu(x) = max(0, x)
|
||||
|
Loading…
Reference in New Issue
Block a user