Iblis Lin
|
6c7613e02b
|
batchnorm: leverage TrackedArray mean
|
2017-11-02 14:20:34 +08:00 |
|
Iblis Lin
|
88bd8a8fbd
|
batchnorm: make CuArrays happy
|
2017-11-02 14:02:41 +08:00 |
|
Iblis Lin
|
477da75428
|
batchnorm: fix mapchildren
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
7f5ba594a9
|
batchnorm: more test cases
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
5253841acc
|
batchnorm: update docs
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
ce46843459
|
batchnorm: add test cases
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
b3356cc6bb
|
batchnorm: batch σ correct coefficient
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
e0201be770
|
batchnorm: parameterize momentum and epsilon
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
669273b008
|
layer: implement BatchNorm layer
See [Batch Normalization: Accelerating Deep Network Training by Reducing
Internal Covariate Shift](https://arxiv.org/pdf/1502.03167.pdf)
|
2017-11-02 13:32:12 +08:00 |
|
Mike J Innes
|
e7a510da9a
|
add cmudict dataset
|
2017-11-01 16:01:55 +00:00 |
|
Mike J Innes
|
0f8ba87dc6
|
treelike tuples
|
2017-10-31 16:37:41 +00:00 |
|
Mike J Innes
|
e943a39ee7
|
combine special cases
|
2017-10-31 16:37:33 +00:00 |
|
Iblis Lin
|
3d8b7250ae
|
add scalar mean
|
2017-10-31 10:42:32 +00:00 |
|
Mike J Innes
|
1186170542
|
Merge pull request #99 from iblis17/mean
TrackedArray: implement `mean`
|
2017-10-30 16:37:08 +00:00 |
|
Iblis Lin
|
c43bda019b
|
TrackedArray: implement mean
```julia
julia> p
Tracked 2×3 Array{Float64,2}:
1.0 3.0 5.0
2.0 4.0 6.0
```
Before
```julia
julia> @benchmark Flux.Tracker.back!(sum($p, 2) ./ size($p, 2), ones(2, 1))
BenchmarkTools.Trial:
memory estimate: 3.44 KiB
allocs estimate: 75
--------------
minimum time: 20.438 μs (0.00% GC)
median time: 21.239 μs (0.00% GC)
mean time: 22.354 μs (1.68% GC)
maximum time: 3.811 ms (98.51% GC)
--------------
samples: 10000
evals/sample: 1
```
After
```julia
julia> @benchmark Flux.Tracker.back!(mean($p, 2), ones(2, 1))
BenchmarkTools.Trial:
memory estimate: 1008 bytes
allocs estimate: 21
--------------
minimum time: 5.973 μs (0.00% GC)
median time: 6.310 μs (0.00% GC)
mean time: 6.630 μs (1.96% GC)
maximum time: 680.709 μs (97.28% GC)
--------------
samples: 10000
evals/sample: 6
```
|
2017-10-30 16:21:02 +08:00 |
|
Mike J Innes
|
4c1b1eb18c
|
Merge pull request #92 from CarloLucibello/drop
add Dropout layer
|
2017-10-26 12:07:28 +01:00 |
|
Mike J Innes
|
84efbbcc84
|
tracker predicate tweaks
|
2017-10-26 12:06:29 +01:00 |
|
Mike J Innes
|
cf6b930f63
|
reorganise
|
2017-10-26 11:46:12 +01:00 |
|
Mike J Innes
|
0df300299f
|
clearer error message, fixes #93
|
2017-10-26 11:15:14 +01:00 |
|
CarloLucibello
|
711ea09d99
|
address comments
|
2017-10-25 02:35:27 +02:00 |
|
CarloLucibello
|
536ab3861d
|
setmode! -> testmode!
|
2017-10-23 16:23:29 +02:00 |
|
Mike J Innes
|
6768afda29
|
minor wording
|
2017-10-23 13:07:07 +01:00 |
|
CarloLucibello
|
00a9e5f01f
|
construct TrackedScalar with params(1)
|
2017-10-23 10:49:45 +01:00 |
|
CarloLucibello
|
86c7c9246e
|
add == and < for tracked arrays
|
2017-10-23 11:41:08 +02:00 |
|
CarloLucibello
|
2e1ed4c3fc
|
add dropout
|
2017-10-23 10:12:53 +02:00 |
|
Mike J Innes
|
2a66545ef8
|
rnn state reset
|
2017-10-19 17:21:08 +01:00 |
|
Mike J Innes
|
99a7697d13
|
adam eta default arg
|
2017-10-19 14:31:34 +01:00 |
|
Mike J Innes
|
e5c8f6d835
|
only export known good optimisers
|
2017-10-19 11:26:11 +01:00 |
|
Mike J Innes
|
5b6a5667ed
|
tracked array restructure
|
2017-10-18 22:54:58 +01:00 |
|
Mike J Innes
|
c8d4844da4
|
chunk util
|
2017-10-18 17:07:58 +01:00 |
|
Mike J Innes
|
07ad7cfa40
|
learning rate as default arg
|
2017-10-18 17:07:49 +01:00 |
|
Mike J Innes
|
e82428bb83
|
batching docs
|
2017-10-18 16:40:14 +01:00 |
|
Mike J Innes
|
b817ce632c
|
syntax highlighting
|
2017-10-18 15:44:06 +01:00 |
|
Mike J Innes
|
fd249b773e
|
rnn docs
|
2017-10-18 15:30:05 +01:00 |
|
Mike J Innes
|
897f812055
|
remove this until nnlib release
|
2017-10-18 14:52:48 +01:00 |
|
Mike J Innes
|
190f48a709
|
nnlib docs
|
2017-10-18 14:40:58 +01:00 |
|
Mike J Innes
|
12944ae125
|
nnlib exports
|
2017-10-18 12:56:58 +01:00 |
|
Mike J Innes
|
0fbc8dff61
|
typoe
|
2017-10-18 12:48:58 +01:00 |
|
Mike J Innes
|
d6dd27dae5
|
dense layer example
|
2017-10-18 12:47:45 +01:00 |
|
Mike J Innes
|
92f65f91c5
|
update community page
|
2017-10-18 12:39:58 +01:00 |
|
Mike J Innes
|
55ba236da6
|
model layers note
|
2017-10-18 12:31:06 +01:00 |
|
Mike J Innes
|
c4166fd725
|
optimiser clarity
|
2017-10-18 12:22:45 +01:00 |
|
Mike J Innes
|
7426faf37d
|
optimiser docs
|
2017-10-18 12:09:48 +01:00 |
|
Mike J Innes
|
b26f77489e
|
don't need this
|
2017-10-18 10:22:35 +01:00 |
|
CarloLucibello
|
041079237e
|
add docsting to train!
|
2017-10-17 21:04:18 +01:00 |
|
CarloLucibello
|
6d3a2a2210
|
change argument name for better clarity
|
2017-10-17 21:04:18 +01:00 |
|
Mike J Innes
|
23674b2555
|
logitcrossentropy tweaks
|
2017-10-17 17:58:32 +01:00 |
|
pevnak
|
4aa7741ba9
|
logit cross entropy
|
2017-10-17 17:57:46 +01:00 |
|
Mike J Innes
|
6dff8ca8d3
|
rename crossentropy loss
|
2017-10-17 17:36:18 +01:00 |
|
Mike J Innes
|
1800c8f523
|
deprecate mapparams
|
2017-10-17 17:35:30 +01:00 |
|