Mike J Innes
3d41dca338
immutable chain
2018-11-16 12:22:15 +00:00
Mike J Innes
43c5f90d93
Merge pull request #379 from dhairyagandhi96/master
...
New optimisers interface
2018-10-31 16:38:40 +00:00
Mike J Innes
4a54d30cbf
correct SGD deprecation
2018-10-31 15:30:30 +00:00
Mike J Innes
bffaceee02
tweaks
2018-10-31 14:58:55 +00:00
Avik Pal
ec2c00783d
Add missing export for DepthwiseConv
2018-10-24 22:18:26 +05:30
Dhairya Gandhi
fe8c147f72
fixed weight decay definition
2018-10-11 10:07:16 +05:30
Dhairya Gandhi
6665189ff1
added remaining optimizers and tests
2018-09-16 17:34:51 +05:30
Dhairya Gandhi
d933f2079b
pulled tracker from upstream
2018-09-11 18:30:24 +05:30
Dhairya Gandhi
0b440f16ff
Merge branch 'master' of https://github.com/FluxML/Flux.jl
2018-09-06 22:48:03 +06:00
Mike J Innes
1e0fd07b09
use expand
2018-09-04 14:30:02 +01:00
Mike J Innes
a2d2d068aa
initial sketch
2018-08-28 17:55:59 +05:30
Mike Innes
5a023a9ccc
WIP 1.0 support
...
closes #353
2018-08-20 13:08:04 +01:00
femtocleaner[bot]
2d80f68087
Fix deprecations
2018-08-14 16:46:23 +00:00
pevnak
926411a449
removed most error, the only one in Fallbacks test persits
2018-08-03 15:14:25 +01:00
pevnak
3510c837a8
zeros replaced by zero
2018-08-03 15:14:25 +01:00
Mike J Innes
70718e7a64
update treelike
2018-08-03 13:02:47 +01:00
Mike J Innes
7057ca739e
fix std usage
2018-08-03 12:56:27 +01:00
Mike J Innes
b18b51656c
requires update
2018-08-03 12:54:24 +01:00
Jarvist Moore Frost
344a750770
Merge branch 'master' of github.com:jarvist/Flux.jl into HEAD
2018-07-03 11:15:43 +01:00
Jarvist Moore Frost
aee4a83c55
Add ADAMW weight-decay.
...
See http://www.fast.ai/2018/07/02/adam-weight-decay/ and the original
paper https://arxiv.org/abs/1711.05101.pdf for context.
I don't know what I'm doing, and this is quite possibly wrong - but on
a simple Char-RNN I have lying around on my harddisk, this seems to
improve the rate of learning consistently for different hyperparameters
vs. standard ADAM with the same decay constant.
2018-07-03 11:11:32 +01:00
Tejan Karmali
4a24b69976
Merge branch 'master' into nadam-opt
2018-06-08 16:54:41 +05:30
Mike Innes
b59161a41e
export Tracker again
2018-05-05 17:15:18 +01:00
Mike J Innes
9a7e6e9c5c
hold off on some things
2018-05-01 12:18:56 +01:00
CarloLucibello
e186b958dd
more exports
2018-05-01 12:13:14 +01:00
Mike J Innes
cb3ae8df6a
rename normalise.jl
2018-04-15 15:45:46 +01:00
Mike Innes
9d7164f15f
we'll do this differently
2018-04-14 02:09:35 +01:00
tejank10
ea9b5471fa
NADAM optimizer
2018-04-03 01:27:22 +05:30
Mike Innes
c95a97f6ae
make epochs available
2018-03-06 03:01:56 +00:00
Mike J Innes
ac57fc3c26
use @ fix in a few places
2018-03-01 16:31:20 +00:00
Mike J Innes
466b5c501a
cpu/gpu conveniences
2018-02-26 23:10:59 +00:00
Mike J Innes
15d1d3256b
conv api updates
2018-02-26 22:43:07 +00:00
Iblis Lin
043fedde3c
introduce Reexport
...
- Reexporting NNlib
fix #180
2018-02-21 16:55:20 +08:00
Mike J Innes
1baa7227e3
reorganise batches
2018-02-13 16:05:07 +00:00
Mike J Innes
34217b1fa2
Merge branch 'treebank'
2018-02-13 15:44:27 +00:00
Mike J Innes
2f29733888
Merge branch 'master' into HEAD
2018-02-13 14:45:37 +00:00
Mike J Innes
70fbbf48fa
humble beginnings of compiler
2018-02-08 18:11:26 +00:00
Mike J Innes
a1d1930097
Merge branch 'master' into curnn
2018-02-07 23:23:02 +00:00
Mike J Innes
282889970d
seperate tracking infrastructure from array wrapper
2018-02-07 17:43:25 +00:00
boathit
7e37a96c6f
Register back! for logsigmoid and implement (logit)binarycrossentropy
2018-02-06 19:36:16 +08:00
boathit
6e65789828
Register back! for logsigmoid and implement (logit)binarycrossentropy
2018-02-06 19:32:46 +08:00
Mike J Innes
2a2475a9c2
get tracker graph
2018-02-05 17:40:07 +00:00
Mike J Innes
b1c5786012
Merge branch 'master' into curnn
2018-02-02 15:56:44 +00:00
Mike J Innes
49e1e78f67
make data/value available
2018-02-02 15:56:04 +00:00
Mike J Innes
ee6c3e18a9
basic RNNDesc
2018-01-30 14:43:39 +00:00
Mike J Innes
842bf03051
typo
2018-01-30 14:43:05 +00:00
Mike J Innes
0c9549c469
rm lazy
2018-01-24 13:28:52 +00:00
Mike J Innes
5118ef9163
remove batching work for now
2018-01-24 13:12:38 +00:00
boathit
374d7a5f1e
Registering backward function for logsoftmax
2018-01-21 15:20:59 +08:00
Mike J Innes
b44237468e
Merge branch 'master' into gru
2018-01-10 13:59:33 +00:00
Mike J Innes
9d0dd9fb7e
layer wip
2017-12-15 13:22:57 +00:00