Added docs on testmode!

This commit is contained in:
Kyle Daruwalla 2020-02-25 13:53:49 -06:00
parent 924b8f49ec
commit ba5259a269
1 changed files with 8 additions and 0 deletions

View File

@ -66,6 +66,14 @@ LayerNorm
GroupNorm
```
### Testmode
Many normalisation layers behave differently under training and inference (testing). By default, Flux will automatically determine when a layer evaluation is part of training or inference. Still, depending on your use case, it may be helpful to manually specify when these layers should be treated as being trained or not. For this, Flux provides `testmode!`. When called on a model (e.g. a layer or chain of layers), this function will place the model into the mode specified.
```@docs
testmode!
```
## Cost Functions
```@docs
mse