Mike J Innes
|
ccdc046546
|
fixes #79
|
2017-11-09 14:52:28 +00:00 |
|
Mike J Innes
|
752a9e2808
|
tree utilities
|
2017-11-08 22:19:01 +00:00 |
|
Mike J Innes
|
6eb2ec154b
|
sentiment treebank loader
|
2017-11-08 22:19:01 +00:00 |
|
Mike J Innes
|
8777362eee
|
exports
|
2017-11-08 22:19:01 +00:00 |
|
Mike J Innes
|
8b05317895
|
basic tree
|
2017-11-08 22:19:01 +00:00 |
|
Mike J Innes
|
7e9468d8f8
|
treebank skeleton
|
2017-11-08 22:19:01 +00:00 |
|
Mike J Innes
|
bdf02e42ae
|
test tweaks
|
2017-11-08 22:18:45 +00:00 |
|
Mike J Innes
|
fcd091e8f0
|
Ac_mul_B derivatives
|
2017-11-08 22:18:45 +00:00 |
|
Mike J Innes
|
d4229c4815
|
useful params method
|
2017-11-08 22:18:45 +00:00 |
|
Mike J Innes
|
d6423eefe5
|
matrix-vector fast path
|
2017-11-08 22:18:45 +00:00 |
|
Fredrik Bagge Carlson
|
97244e0a68
|
Allow array of optimisers to train!
This allows an array of optimisers to be sent to `train!`
|
2017-11-04 13:27:32 +01:00 |
|
Mike J Innes
|
efa51f02e7
|
basic batch type
|
2017-11-02 11:49:42 +00:00 |
|
Mike J Innes
|
21ea93ffcd
|
rename treelike
|
2017-11-02 11:47:34 +00:00 |
|
Iblis Lin
|
6c7613e02b
|
batchnorm: leverage TrackedArray mean
|
2017-11-02 14:20:34 +08:00 |
|
Iblis Lin
|
88bd8a8fbd
|
batchnorm: make CuArrays happy
|
2017-11-02 14:02:41 +08:00 |
|
Iblis Lin
|
477da75428
|
batchnorm: fix mapchildren
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
7f5ba594a9
|
batchnorm: more test cases
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
5253841acc
|
batchnorm: update docs
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
ce46843459
|
batchnorm: add test cases
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
b3356cc6bb
|
batchnorm: batch σ correct coefficient
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
e0201be770
|
batchnorm: parameterize momentum and epsilon
|
2017-11-02 13:32:12 +08:00 |
|
Iblis Lin
|
669273b008
|
layer: implement BatchNorm layer
See [Batch Normalization: Accelerating Deep Network Training by Reducing
Internal Covariate Shift](https://arxiv.org/pdf/1502.03167.pdf)
|
2017-11-02 13:32:12 +08:00 |
|
Mike J Innes
|
e7a510da9a
|
add cmudict dataset
|
2017-11-01 16:01:55 +00:00 |
|
Mike J Innes
|
0f8ba87dc6
|
treelike tuples
|
2017-10-31 16:37:41 +00:00 |
|
Mike J Innes
|
e943a39ee7
|
combine special cases
|
2017-10-31 16:37:33 +00:00 |
|
Iblis Lin
|
3d8b7250ae
|
add scalar mean
|
2017-10-31 10:42:32 +00:00 |
|
Mike J Innes
|
1186170542
|
Merge pull request #99 from iblis17/mean
TrackedArray: implement `mean`
|
2017-10-30 16:37:08 +00:00 |
|
Iblis Lin
|
c43bda019b
|
TrackedArray: implement mean
```julia
julia> p
Tracked 2×3 Array{Float64,2}:
1.0 3.0 5.0
2.0 4.0 6.0
```
Before
```julia
julia> @benchmark Flux.Tracker.back!(sum($p, 2) ./ size($p, 2), ones(2, 1))
BenchmarkTools.Trial:
memory estimate: 3.44 KiB
allocs estimate: 75
--------------
minimum time: 20.438 μs (0.00% GC)
median time: 21.239 μs (0.00% GC)
mean time: 22.354 μs (1.68% GC)
maximum time: 3.811 ms (98.51% GC)
--------------
samples: 10000
evals/sample: 1
```
After
```julia
julia> @benchmark Flux.Tracker.back!(mean($p, 2), ones(2, 1))
BenchmarkTools.Trial:
memory estimate: 1008 bytes
allocs estimate: 21
--------------
minimum time: 5.973 μs (0.00% GC)
median time: 6.310 μs (0.00% GC)
mean time: 6.630 μs (1.96% GC)
maximum time: 680.709 μs (97.28% GC)
--------------
samples: 10000
evals/sample: 6
```
|
2017-10-30 16:21:02 +08:00 |
|
Mike J Innes
|
4c1b1eb18c
|
Merge pull request #92 from CarloLucibello/drop
add Dropout layer
|
2017-10-26 12:07:28 +01:00 |
|
Mike J Innes
|
84efbbcc84
|
tracker predicate tweaks
|
2017-10-26 12:06:29 +01:00 |
|
Mike J Innes
|
cf6b930f63
|
reorganise
|
2017-10-26 11:46:12 +01:00 |
|
Mike J Innes
|
0df300299f
|
clearer error message, fixes #93
|
2017-10-26 11:15:14 +01:00 |
|
GenaBitu
|
df06c3351d
|
Merge branch 'master' into cat-fix
|
2017-10-26 00:52:29 +02:00 |
|
CarloLucibello
|
711ea09d99
|
address comments
|
2017-10-25 02:35:27 +02:00 |
|
CarloLucibello
|
536ab3861d
|
setmode! -> testmode!
|
2017-10-23 16:23:29 +02:00 |
|
Mike J Innes
|
6768afda29
|
minor wording
|
2017-10-23 13:07:07 +01:00 |
|
CarloLucibello
|
00a9e5f01f
|
construct TrackedScalar with params(1)
|
2017-10-23 10:49:45 +01:00 |
|
CarloLucibello
|
86c7c9246e
|
add == and < for tracked arrays
|
2017-10-23 11:41:08 +02:00 |
|
CarloLucibello
|
2e1ed4c3fc
|
add dropout
|
2017-10-23 10:12:53 +02:00 |
|
Mike J Innes
|
2a66545ef8
|
rnn state reset
|
2017-10-19 17:21:08 +01:00 |
|
Mike J Innes
|
99a7697d13
|
adam eta default arg
|
2017-10-19 14:31:34 +01:00 |
|
Mike J Innes
|
e5c8f6d835
|
only export known good optimisers
|
2017-10-19 11:26:11 +01:00 |
|
Mike J Innes
|
5b6a5667ed
|
tracked array restructure
|
2017-10-18 22:54:58 +01:00 |
|
Mike J Innes
|
c8d4844da4
|
chunk util
|
2017-10-18 17:07:58 +01:00 |
|
Mike J Innes
|
07ad7cfa40
|
learning rate as default arg
|
2017-10-18 17:07:49 +01:00 |
|
Mike J Innes
|
e82428bb83
|
batching docs
|
2017-10-18 16:40:14 +01:00 |
|
Mike J Innes
|
b817ce632c
|
syntax highlighting
|
2017-10-18 15:44:06 +01:00 |
|
Mike J Innes
|
fd249b773e
|
rnn docs
|
2017-10-18 15:30:05 +01:00 |
|
Mike J Innes
|
897f812055
|
remove this until nnlib release
|
2017-10-18 14:52:48 +01:00 |
|
Mike J Innes
|
190f48a709
|
nnlib docs
|
2017-10-18 14:40:58 +01:00 |
|