Mike J Innes
9a7e6e9c5c
hold off on some things
2018-05-01 12:18:56 +01:00
CarloLucibello
e186b958dd
more exports
2018-05-01 12:13:14 +01:00
Mike J Innes
ee89a7797e
Merge pull request #245 from freeboson/adamax
...
Add AdaMax optimizer
2018-05-01 11:28:07 +01:00
Mike J Innes
5efbaddb97
Merge pull request #249 from ninjin/nin/minimum
...
[RFC] Backpropagation for `maximum` and `minimum`
2018-04-30 18:40:42 +01:00
Mike J Innes
73a51400b6
better error message
2018-04-30 12:09:15 +01:00
Pontus Stenetorp
cfd29b9c76
Backpropagation for maximum and minimum
2018-04-29 13:52:54 +01:00
Sujeet Akula
8c042bd522
element wise max()
2018-04-26 21:12:31 +10:00
Sujeet Akula
5e5f255f81
export typo
2018-04-26 17:42:04 +10:00
Sujeet Akula
4586bda5ab
export/test adamax
2018-04-26 17:40:11 +10:00
Sujeet Akula
b6508e2416
add adamax
2018-04-26 17:37:24 +10:00
Mike J Innes
baff20514d
gpu broadcast fix
2018-04-17 18:05:58 +01:00
Mike J Innes
8f73dc6e14
fix gpu cross entropy
2018-04-17 17:56:47 +01:00
tejank10
2ef25775c6
removed extra expand and fixed bug
2018-04-16 01:18:26 +05:30
Mike Innes
d12fb98f2a
nicer batchnorm shape error
2018-04-15 20:29:25 +01:00
tejank10
2f5473d435
added expand in conv constructor
2018-04-16 00:59:11 +05:30
Mike J Innes
8f29968c32
Merge pull request #207 from safnuk/pull-request/07b0f95d
...
BatchNorm for convolutions
2018-04-15 20:10:33 +01:00
Mike J Innes
683a73fed3
download info
2018-04-15 20:09:30 +01:00
Mike J Innes
5fd240f525
interface tweaks
2018-04-15 20:04:42 +01:00
Mike J Innes
73a0be3e04
Merge branch 'master' into pull-request/07b0f95d
2018-04-15 17:10:29 +01:00
Mike J Innes
642543808e
Merge pull request #226 from CarloLucibello/reshape
...
fix reshape
2018-04-15 16:53:21 +01:00
tejank10
b080f5c82e
Scalar pad and stride
2018-04-15 20:32:40 +05:30
Mike J Innes
cb3ae8df6a
rename normalise.jl
2018-04-15 15:45:46 +01:00
Mike J Innes
b05e755068
rm jit from cuda
2018-04-15 15:08:58 +01:00
tejank10
5cc681317a
added stride for pooling in tracker
2018-04-15 15:07:04 +01:00
tejank10
f6097d58d6
Scalar pad/stride for Conv constructor
2018-04-15 12:15:41 +05:30
Mike Innes
9d7164f15f
we'll do this differently
2018-04-14 02:09:35 +01:00
tejank10
65847bb745
moved epsilon into sqrt
2018-04-04 15:25:20 +05:30
tejank10
3ead662987
Update rule fixed
2018-04-04 15:18:44 +05:30
CarloLucibello
b415333233
fix reshape
2018-04-02 16:09:57 -04:00
tejank10
ea9b5471fa
NADAM optimizer
2018-04-03 01:27:22 +05:30
Brad Safnuk
b9a66c679d
Fix error in initialization of σ.
2018-03-22 22:20:21 -04:00
Brad Safnuk
35299d4621
Fix type instability when loading onto a gpu.
...
Also fixes Issue #216 .
2018-03-22 21:32:32 -04:00
Mike J Innes
4320738d87
fix
2018-03-21 11:25:47 +00:00
Mike Innes
1c5f8e3534
ndims for shapes
2018-03-16 14:42:08 +00:00
Brad Safnuk
db2d9efb72
Update BatchNorm documentation
2018-03-15 21:59:38 -04:00
Brad Safnuk
6653ec86d9
Allow multidimensional inputs to batchnorm.
...
Can be used in conjunction with convolutional layers, in addition
to dense layers, with the same api.
2018-03-15 21:48:59 -04:00
Mike J Innes
e931552f7d
Merge pull request #200 from chengchingwen/repmat
...
implement `back` of `repmat`
2018-03-15 15:18:48 +00:00
Mike J Innes
5d7edb5aaa
Merge pull request #197 from chengchingwen/master
...
Implement `prod` for `TrackedArray`
2018-03-15 15:17:24 +00:00
boathit
2ec37790be
eliminate ambiguity
2018-03-13 10:50:56 +08:00
boathit
ff2caf032c
eliminate ambiguous
2018-03-12 22:48:16 +08:00
Mike J Innes
9ccbac8b80
jit gpu support
2018-03-07 19:18:27 +00:00
chengchingwen
43af3895b0
change prod implementation to avoid small xs
2018-03-07 21:03:13 +08:00
chengchingwen
c00f7f850f
implement back of repmat
2018-03-07 20:43:59 +08:00
chengchingwen
7c721475c6
add gradient check for prod and fix dims in back(::typeof(prod),...)
2018-03-07 16:24:44 +08:00
Mike Innes
d21c313ea7
tweaks
2018-03-06 19:58:47 +00:00
Mike Innes
36baa7ec2c
convnet primitives
2018-03-06 19:58:05 +00:00
Mike Innes
0802b4d5cf
closes #198
2018-03-06 16:56:01 +00:00
Elliot Saba
6445295318
Better download detection
2018-03-06 08:45:45 -08:00
Elliot Saba
19f691d342
Use cache.julialang.org to store ML models
...
It's annoying that when third party servers go down our tests break.
Let's at least make sure that if our tests break due to server outages
it's our fault.
2018-03-06 08:03:21 -08:00
Mike Innes
3babeeb440
scalar hashing
2018-03-06 13:49:05 +00:00
chengchingwen
86d782a5ce
implement prod for TrackedArray
2018-03-06 18:01:19 +08:00
Mike Innes
c95a97f6ae
make epochs available
2018-03-06 03:01:56 +00:00
Mike Innes
432b9c3222
loadparams!
2018-03-06 02:45:31 +00:00
Mike Innes
65ed95190a
fix
2018-03-05 23:44:25 +00:00
Mike Innes
bfd6a4c0ec
cleaner interrupts
2018-03-05 23:05:45 +00:00
Mike Innes
5153cde847
move epochs
2018-03-05 22:56:22 +00:00
Mike J Innes
662439c164
closes #177
2018-03-05 17:24:46 +00:00
Elliot Saba
36295799ee
Add permutedims() for tracked arrays
2018-03-02 10:22:28 -08:00
Mike J Innes
8019f789f8
use normal log
2018-03-01 16:35:49 +00:00
Mike J Innes
ac57fc3c26
use @ fix in a few places
2018-03-01 16:31:20 +00:00
Mike J Innes
c2fea2acf6
revert this
2018-02-28 23:06:53 +00:00
Mike J Innes
2eb38eedbf
update gpu api
2018-02-28 22:51:08 +00:00
Mike J Innes
ccef9f4dd4
jit softmax
2018-02-28 22:07:35 +00:00
Mike J Innes
7606b1a399
single-batch convolution
2018-02-28 14:25:32 +00:00
Mike J Innes
6bdc2b37a9
inline call
2018-02-28 13:47:14 +00:00
Mike J Innes
a401f08cda
compile layers
2018-02-27 22:40:51 +00:00
Mike J Innes
5a32976cbf
basic compile step
2018-02-27 21:43:41 +00:00
Mike J Innes
bdb8aae107
move cache logic
2018-02-27 21:41:03 +00:00
Mike J Innes
2c74976602
more general
2018-02-27 01:25:40 +00:00
Mike J Innes
466b5c501a
cpu/gpu conveniences
2018-02-26 23:10:59 +00:00
Mike J Innes
15d1d3256b
conv api updates
2018-02-26 22:43:07 +00:00
Mike J Innes
54919b8dca
rm deprecation
2018-02-22 00:23:02 +00:00
Mike J Innes
491785a681
ignore state in mapleaves
2018-02-22 00:22:51 +00:00
Mike J Innes
ec65e2cec7
fix printing
2018-02-22 00:21:48 +00:00
Mike J Innes
af2e6b7e1d
fix
2018-02-22 00:15:38 +00:00
Mike J Innes
99b739cf00
fixes #176
2018-02-21 23:21:20 +00:00
Mike J Innes
e3b4b16e01
Merge pull request #178 from schmrlng/pull-request/e6f55641
...
Convert OneHot CuArrays to dense CuArrays before passing to CUDNN methods
2018-02-21 22:34:11 +00:00
Mike J Innes
6bdd283fbd
no longer necessary
2018-02-21 22:29:31 +00:00
Iblis Lin
043fedde3c
introduce Reexport
...
- Reexporting NNlib
fix #180
2018-02-21 16:55:20 +08:00
Ed Schmerling
e6f556411a
Convert OneHot CuArrays to dense CuArrays before passing to CUDNN methods
2018-02-19 17:32:15 -08:00
Mike J Innes
4035745f6e
may help numerical tests
2018-02-19 12:51:02 +00:00
Mike J Innes
989adcdc7d
gpu fix
2018-02-17 12:41:53 +00:00
Mike J Innes
11511982a4
numerical stability
2018-02-17 11:56:03 +00:00
Mike J Innes
e5791bc5f6
frequencies utility
2018-02-17 11:19:51 +00:00
Mike J Innes
e3b31b9b87
Merge pull request #169 from jessebett/jessechanges
...
Reshape with Tuple Dimensions and Kronecker Product
2018-02-16 14:16:42 +00:00
Mike J Innes
60f21d3ff2
don't override base method
2018-02-16 14:15:40 +00:00
Mike J Innes
5e861101f3
epochs util
2018-02-16 11:17:57 +00:00
Mike J Innes
7aa6854c64
more correct
2018-02-16 00:06:15 +00:00
Mike J Innes
ee3784964e
fix for external modules
2018-02-15 22:27:00 +00:00
Mike J Innes
63862c2324
easier initialisation with weights
2018-02-15 20:52:29 +00:00
Mike J Innes
01c31e7fcc
conv bias
2018-02-15 20:15:41 +00:00
Mike J Innes
bdd07a8bc6
fix
2018-02-14 22:34:11 +00:00
Mike J Innes
1b8b1cd7b1
check params by identity
2018-02-14 21:00:50 +00:00
Mike J Innes
5ea0ef6764
tracker fix
2018-02-13 16:15:36 +00:00
Mike J Innes
1baa7227e3
reorganise batches
2018-02-13 16:05:07 +00:00
Mike J Innes
34217b1fa2
Merge branch 'treebank'
2018-02-13 15:44:27 +00:00
Mike J Innes
49584fb72b
rm logsigmoid
2018-02-13 14:52:29 +00:00
Mike J Innes
2f29733888
Merge branch 'master' into HEAD
2018-02-13 14:45:37 +00:00
Mike J Innes
8432d8db06
batchnorm fix
2018-02-13 14:02:35 +00:00
Mike J Innes
820cd3ae42
fixes #164
2018-02-13 13:31:35 +00:00
Mike J Innes
066cb45a38
remove old accuracy fn
2018-02-13 11:12:21 +00:00
Mike J Innes
236edbffec
fixes #111
2018-02-13 10:20:38 +00:00
Mike J Innes
f22cfb5b43
re-enable printf
2018-02-12 15:05:09 +00:00
Mike J Innes
334ae9e1cb
fixes #171
2018-02-12 12:31:15 +00:00
Mike J Innes
0b3c02fe8d
document regularisation, fixes #160
2018-02-09 19:00:26 +00:00
Mike J Innes
0e0057b0c4
basics
2018-02-09 13:51:07 +00:00
jessebett
f84ee8eab0
reshape with tupled dimensions and kronecker product
2018-02-08 14:27:57 -05:00
Mike J Innes
70fbbf48fa
humble beginnings of compiler
2018-02-08 18:11:26 +00:00
Mike J Innes
fc157a8c59
TrackedNumber -> TrackedReal
2018-02-08 17:18:40 +00:00
Mike J Innes
d1c56ca768
number fix
2018-02-08 17:04:48 +00:00
Mike J Innes
0f7a1ec022
test params funct
2018-02-08 16:13:20 +00:00
Mike J Innes
961de2ba44
Merge pull request #161 from FluxML/curnn
...
WIP: CUDNN RNNs
2018-02-08 13:06:52 +00:00
Iblis Lin
f7fdfbe3a9
fix params
2018-02-08 12:56:10 +00:00
Mike J Innes
fcbdc49d6b
fix reserve usage
2018-02-08 10:27:26 +00:00
Mike J Innes
bc452fcd81
rewrite tests
2018-02-08 02:37:55 +00:00
Mike J Innes
d592f4e327
batch support
2018-02-08 01:45:48 +00:00
Mike J Innes
b8f148b012
hook up backward passes
2018-02-08 00:49:39 +00:00
Mike J Innes
a1d1930097
Merge branch 'master' into curnn
2018-02-07 23:23:02 +00:00
Mike J Innes
4511936a87
fixes #116
2018-02-07 23:21:04 +00:00
Mike J Innes
0ac924e8e1
fixups
2018-02-07 22:52:46 +00:00
Mike J Innes
39f7f8fdf3
tracked tuples
2018-02-07 22:21:42 +00:00
Mike J Innes
79e4e25fea
seperate number type
2018-02-07 20:39:36 +00:00
Mike J Innes
282889970d
seperate tracking infrastructure from array wrapper
2018-02-07 17:43:25 +00:00
Mike J Innes
30b3437c56
backward passes
2018-02-06 18:56:17 +00:00
Mike J Innes
f866fbe575
nullable c refactor
2018-02-06 15:01:48 +00:00
Mike J Innes
07e1b1e0a9
avoid val
2018-02-06 12:44:18 +00:00
boathit
7e37a96c6f
Register back! for logsigmoid and implement (logit)binarycrossentropy
2018-02-06 19:36:16 +08:00
boathit
6e65789828
Register back! for logsigmoid and implement (logit)binarycrossentropy
2018-02-06 19:32:46 +08:00
Mike J Innes
a4bf5936b0
diagm
2018-02-05 18:29:35 +00:00
Mike J Innes
2fec75005d
Merge pull request #123 from GenaBitu/cat-fix
...
Added vcat for multiple TrackedVectors
2018-02-05 18:10:48 +00:00
Mike J Innes
47cebab26e
test multiple inputs/dims
2018-02-05 18:09:54 +00:00
Mike J Innes
2a2475a9c2
get tracker graph
2018-02-05 17:40:07 +00:00
Mike J Innes
14086b8c2d
train forward pass
2018-02-02 17:48:08 +00:00
Mike J Innes
9a6fcf057b
hook up interface
2018-02-02 16:42:18 +00:00
Mike J Innes
b1c5786012
Merge branch 'master' into curnn
2018-02-02 15:56:44 +00:00
Mike J Innes
49e1e78f67
make data/value available
2018-02-02 15:56:04 +00:00
Mike J Innes
0f1e7b5578
update rnn structure
2018-02-01 20:57:39 +00:00
Mike J Innes
106502a75d
typo
2018-01-31 21:57:04 +00:00
Mike J Innes
af3ccf85ff
coagulate gates
2018-01-31 16:56:27 +00:00
Mike J Innes
4bfb603da6
gru forward
2018-01-31 13:46:55 +00:00
Mike J Innes
b1bb05403c
basic forward pass
2018-01-30 18:18:37 +00:00
Mike J Innes
0b886507dc
param offsets
2018-01-30 14:43:39 +00:00
Mike J Innes
af0c5523ff
rnnTrainingReserveSize
2018-01-30 14:43:39 +00:00
Mike J Innes
3fb83d642d
rnnWorkspaceSize
2018-01-30 14:43:39 +00:00
Mike J Innes
6b4e114d5d
rnnParamSize
2018-01-30 14:43:39 +00:00
Mike J Innes
ee6c3e18a9
basic RNNDesc
2018-01-30 14:43:39 +00:00
Mike J Innes
842bf03051
typo
2018-01-30 14:43:05 +00:00
Mike J Innes
0c9549c469
rm lazy
2018-01-24 13:28:52 +00:00
Mike J Innes
5118ef9163
remove batching work for now
2018-01-24 13:12:38 +00:00
boathit
374d7a5f1e
Registering backward function for logsoftmax
2018-01-21 15:20:59 +08:00
Mike J Innes
72eabde373
load data
2018-01-17 16:39:55 +00:00
Mike J Innes
bd57359535
docstrings
2018-01-17 16:12:12 +00:00
Mike J Innes
8cca7accf2
mnist
2018-01-17 15:55:37 +00:00
Mike J Innes
4207fb98f2
basic GPU tests
2018-01-16 17:58:14 +00:00
GenaBitu
bc8a32bc56
Merge branch 'master' into cat-fix
2018-01-16 11:01:31 +01:00
Mike J Innes
1beb30e19a
closes #118
2018-01-15 17:00:47 +00:00
Mike J Innes
8f8589a7f4
fix initialisation
2018-01-10 14:11:52 +00:00
Mike J Innes
b44237468e
Merge branch 'master' into gru
2018-01-10 13:59:33 +00:00
Mike J Innes
805cb9178f
fixes #146
2018-01-10 12:48:50 +00:00
Mehul Tikekar
2fef799109
fix typo in conv.jl ( fixes #133 )
2018-01-08 16:46:58 -05:00
Mike J Innes
468f641f66
use Adapt
2018-01-08 16:34:22 +00:00
Mike J Innes
98b362729d
pool padding
2017-12-18 18:18:14 +00:00
Mike J Innes
e3577d759c
conv docs
2017-12-18 18:05:48 +00:00
Mike J Innes
269d8f36b9
conv padding
2017-12-18 18:05:38 +00:00
Mike J Innes
51f93d9f0e
conv polish
2017-12-15 16:24:45 +00:00
Mike J Innes
386eafc443
reshape
2017-12-15 16:18:16 +00:00
Mike J Innes
73ae25289d
remove old util
2017-12-15 16:18:01 +00:00
Mike J Innes
6890a61587
todo
2017-12-15 16:17:45 +00:00
Mike J Innes
9b833a4345
more onehot indexing
2017-12-15 16:17:39 +00:00
Mike J Innes
9d0dd9fb7e
layer wip
2017-12-15 13:22:57 +00:00
Mike J Innes
0bf22dfb8e
pool gradients
2017-12-15 02:29:14 +00:00
Mike J Innes
d949b31aa5
conv gradient
2017-12-15 02:24:32 +00:00
Mike J Innes
5b97d2ba04
closes #127
2017-12-13 18:24:56 +00:00
Mike J Innes
95d1287455
Merge branch 'master' into jacobian
2017-12-13 17:06:23 +00:00
Mike J Innes
27d896943e
Merge pull request #120 from staticfloat/sf/dense_initialization
...
Better default initialization for Dense layers
2017-12-13 16:18:02 +00:00
Mike J Innes
e3a688e706
use kwarg
2017-12-13 15:27:15 +00:00
Mike J Innes
128725cefd
Merge branch 'master' into sf/weighted_crossentropy
2017-12-13 15:14:47 +00:00
Mike J Innes
29787eba45
fixes #114
2017-12-12 17:23:15 +00:00
Mike J Innes
b7b6c975bc
fixes #110
2017-12-12 17:07:39 +00:00
Mike J Innes
403cc26327
Merge branch 'master' into gru
2017-12-12 16:54:00 +00:00
Mike J Innes
86097e76fd
tweak batchnorm example
2017-12-08 19:34:34 +00:00
Mike J Innes
6f997e798a
Merge branch 'master' into batchnorm
2017-12-08 19:31:50 +00:00
Mike J Innes
1d916c81b5
Merge branch 'master' into HEAD
2017-12-08 18:31:55 +00:00
Mike J Innes
24a6569589
Merge branch 'master' into amsgrad
2017-12-08 18:20:53 +00:00
Mike J Innes
f82dbf4798
Merge branch 'master' into HEAD
2017-12-08 17:00:31 +00:00
Mike J Innes
951c21366a
fix regex
2017-12-08 16:42:30 +00:00
GenaBitu
7e51418679
Added back for multi-parameter vcat
2017-12-08 16:10:09 +01:00
baggepinnen
385dee9d16
Add jacobian function
2017-12-08 14:46:12 +01:00
GenaBitu
41f3eedc39
Proper multi-variable vcat
2017-12-07 17:50:18 +01:00
Elliot Saba
41446d547f
Add weighted_crossentropy for imbalanced classification problems
2017-12-05 17:09:05 -08:00
Elliot Saba
c59b820bed
Add glorot (Xavier) initialization
...
Set default `Dense` and `RNN` inits to `glorot_uniform()` for `W`, `zeros` for `b`.
2017-12-05 14:24:48 -08:00
GenaBitu
62b3600eca
Merge branch 'master' into cat-fix
2017-12-05 11:13:29 +01:00
baggepinnen
41febee9c1
Export and indent
2017-12-04 09:34:27 +01:00
baggepinnen
36001d085a
Implement AMSGrad optimiser
2017-12-04 09:17:05 +01:00
Mike J Innes
cab235a578
gpu compat
2017-11-30 13:51:31 +00:00
Mike J Innes
19039f4881
export sigmoid
2017-11-30 13:37:38 +00:00
Mike J Innes
2d33f19346
onehot unk arg
2017-11-29 16:45:50 +00:00
baggepinnen
fa718c7475
Implement Gated Recurrent Unit
2017-11-24 14:33:06 +01:00
CarloLucibello
13b934c250
improve optimizers
2017-11-24 12:12:20 +01:00
Mike J Innes
dc1f08a709
Merge pull request #98 from FluxML/log
...
GPU-ready log function
2017-11-23 17:17:39 +00:00
