clarity
This commit is contained in:
parent
83cc77c860
commit
32c8698869
@ -25,7 +25,7 @@ Information stored in `h` is preserved for the next prediction, allowing it to f
|
|||||||
|
|
||||||
(This might be important if, for example, each `x` represents one word of a sentence; the model's interpretation of the word "bank" should change if the previous input was "river" rather than "investment".)
|
(This might be important if, for example, each `x` represents one word of a sentence; the model's interpretation of the word "bank" should change if the previous input was "river" rather than "investment".)
|
||||||
|
|
||||||
Flux's RNN support closely follows this mathematical perspective. The most basic RNN is as close as possible to a standard `Dense` layer, and the output and hidden state are the same. By convention, the hidden state is the first input and output.
|
Flux's RNN support closely follows this mathematical perspective. The most basic RNN is as close as possible to a standard `Dense` layer, and the output is also the hidden state.
|
||||||
|
|
||||||
```julia
|
```julia
|
||||||
Wxh = randn(5, 10)
|
Wxh = randn(5, 10)
|
||||||
|
Loading…
Reference in New Issue
Block a user