From ba5259a269f93b0dcf65dfca43b29b219bf81415 Mon Sep 17 00:00:00 2001 From: Kyle Daruwalla Date: Tue, 25 Feb 2020 13:53:49 -0600 Subject: [PATCH] Added docs on testmode! --- docs/src/models/layers.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/src/models/layers.md b/docs/src/models/layers.md index 5f2ab3ce..763fbf8c 100644 --- a/docs/src/models/layers.md +++ b/docs/src/models/layers.md @@ -66,6 +66,14 @@ LayerNorm GroupNorm ``` +### Testmode + +Many normalisation layers behave differently under training and inference (testing). By default, Flux will automatically determine when a layer evaluation is part of training or inference. Still, depending on your use case, it may be helpful to manually specify when these layers should be treated as being trained or not. For this, Flux provides `testmode!`. When called on a model (e.g. a layer or chain of layers), this function will place the model into the mode specified. + +```@docs +testmode! +``` + ## Cost Functions ```@docs mse