Avik Pal
5db7a3a3ad
Fix Optimizers
2018-08-11 18:23:47 +05:30
Avik Pal
355091b9d1
Merge removing conflicts
2018-08-11 18:01:27 +05:30
Josh Christie
837e03613f
Updates for julia 1.0
2018-08-11 13:23:02 +01:00
Avik Pal
d3c78a80be
Fix layers errors
2018-08-11 17:20:27 +05:30
Josh Christie
5186e3ba18
Updates for julia 1.0
2018-08-11 10:51:07 +01:00
Mike J Innes
62d594af43
out of place gradients for collect
2018-08-07 22:09:20 +01:00
Mike J Innes
7103a0ed7d
tweaks
2018-08-03 15:19:10 +01:00
pevnak
926411a449
removed most error, the only one in Fallbacks test persits
2018-08-03 15:14:25 +01:00
pevnak
c657d4e47f
fixed the sum as suggested by mike
2018-08-03 15:14:25 +01:00
Simon Mandlik
02f343d44d
fixed more dep warns, also in tests, but maximum, minimum and size in array.jl still need to be updated. As a result, some more tests may not pass for the time being
2018-08-03 15:14:25 +01:00
Simon Mandlik
0471c489e6
depwarns
2018-08-03 15:14:25 +01:00
pevnak
3510c837a8
zeros replaced by zero
2018-08-03 15:14:25 +01:00
pevnak
ea38c7dbea
some more changes
2018-08-03 15:14:25 +01:00
pevnak
d6f5baee39
fixed fixes proposed by Carlo
2018-08-03 15:14:25 +01:00
pevnak
8ab209126d
removed zeros fix
2018-08-03 15:14:25 +01:00
pevnak
e98538673a
updated sum to be compliant with latest beta. Removed some depwarns
2018-08-03 15:14:25 +01:00
Mike J Innes
e5b3d27016
track_kw should be unnecessary
2018-08-03 15:14:10 +01:00
Mike Innes
f5c9361617
matmul fix
2018-08-03 13:02:47 +01:00
Mike Innes
4cf6bac0c1
fix hook
2018-08-03 13:02:47 +01:00
Mike J Innes
70718e7a64
update treelike
2018-08-03 13:02:47 +01:00
Mike J Innes
d782b33701
syntax
2018-08-03 13:02:47 +01:00
Mike J Innes
85fd77d70a
linalg deprecations
2018-08-03 13:02:47 +01:00
Mike J Innes
89872c5a8b
val deprecations
2018-08-03 13:02:47 +01:00
Mike J Innes
474f578517
ObjectIdDict -> IdDict
2018-08-03 13:02:47 +01:00
Mike J Innes
aa209ee137
no longer needed
2018-08-03 13:02:47 +01:00
Mike J Innes
00cfe24d66
fix cat
2018-08-03 13:02:47 +01:00
Mike J Innes
adc216f182
fix broadcasting
2018-08-03 12:56:32 +01:00
Mike J Innes
e486c50610
fix data
2018-08-03 12:56:31 +01:00
Mike J Innes
fb8a220659
fix matmul
2018-08-03 12:56:31 +01:00
Mike J Innes
7057ca739e
fix std usage
2018-08-03 12:56:27 +01:00
Mike J Innes
88a265154c
deprecations
2018-08-03 12:54:31 +01:00
Mike J Innes
b18b51656c
requires update
2018-08-03 12:54:24 +01:00
Mike J Innes
a49e2eae41
deprecated Void
2018-08-03 12:53:52 +01:00
Mike J Innes
1fd49c2a90
fix array show
2018-08-03 12:53:52 +01:00
Mike J Innes
a8ccc79f61
perf hacks
2018-07-30 20:08:44 +01:00
Mike J Innes
a0fd91b866
Merge pull request #307 from jarvist/master
...
Add ADAMW "Fixing Weight Decay Regularization in Adam"
2018-07-11 19:12:58 +01:00
Mike J Innes
dda51a0140
update docs
2018-07-11 15:31:22 +01:00
Mike Innes
10a169bb77
update cudnn rnn
2018-07-10 18:16:37 +01:00
Mike J Innes
70b5efeb4e
basic nested AD
2018-07-10 09:03:09 +01:00
Mike J Innes
80af9a3830
broadcast efficiency
2018-07-09 23:40:07 +01:00
Mike J Innes
e763c342ee
shave some memory
2018-07-09 19:44:14 +01:00
Mike J Innes
1430053b69
checkpoints
2018-07-09 17:52:34 +01:00
Mike J Innes
7778d17884
functional API
2018-07-09 16:57:44 +01:00
Mike J Innes
5e319c7395
fix gradient definitions
2018-07-09 13:39:10 +01:00
Mike J Innes
41b9412439
new grad api
2018-07-09 13:36:46 +01:00
Jarvist Moore Frost
344a750770
Merge branch 'master' of github.com:jarvist/Flux.jl into HEAD
2018-07-03 11:15:43 +01:00
Jarvist Moore Frost
aee4a83c55
Add ADAMW weight-decay.
...
See http://www.fast.ai/2018/07/02/adam-weight-decay/ and the original
paper https://arxiv.org/abs/1711.05101.pdf for context.
I don't know what I'm doing, and this is quite possibly wrong - but on
a simple Char-RNN I have lying around on my harddisk, this seems to
improve the rate of learning consistently for different hyperparameters
vs. standard ADAM with the same decay constant.
2018-07-03 11:11:32 +01:00
Mike J Innes
ce88273880
gradient hook
2018-07-02 13:19:13 +01:00
Mike Innes
5d8b63dc65
avoid implementation details in docs
2018-06-29 13:53:50 +01:00
Matthew Kelley
864d72eef5
Overload Base.eps() for TrackedReal
2018-06-26 23:55:43 -06:00
