batchnorm: leverage TrackedArray mean

This commit is contained in:
Iblis Lin 2017-11-02 14:20:34 +08:00
parent 88bd8a8fbd
commit 6c7613e02b

View File

@ -95,7 +95,7 @@ function (BN::BatchNorm)(x)
ϵ = T(BN.ϵ)
m = size(x, 2) # batch size
μ = sum(x, 2) ./ m
μ = mean(x, 2)
σ = sqrt.(sum((x .- μ).^2, 2) ./ m .+ ϵ)
# update moving mean/std