Commit Graph

517 Commits

Author SHA1 Message Date
Elliot Saba 0fdcc00923 Give `NNPACK` a bit of numerical leeway 2019-12-23 01:31:26 -08:00
bors[bot] 90a38a3201
Merge #937
937: Fix Glorot initialization, add He initialization r=MikeInnes a=Sleort

Should fix #442 .
Adds He weight initialization as a bonus :-)

Co-authored-by: Troels Arnfred Bojesen <tr-ab@online.no>
2019-11-26 16:17:06 +00:00
bors[bot] fb4a48f970
Merge #943
943: Fixes #900 r=MikeInnes a=dhairyagandhi96

Thoughts on the test?

cc @MikeInnes

Co-authored-by: Dhairya Gandhi <dhairya@juliacopmuting.com>
2019-11-26 15:09:27 +00:00
Dhairya Gandhi c031ae1a94 correct channel value 2019-11-24 13:31:31 +05:30
Dhairya Gandhi 5f21238d1a no grad dims helper 2019-11-24 13:25:02 +05:30
matsueushi a0314ce682 Fix logitbinarycrossentropy on CuArrays 2019-11-22 05:23:24 +00:00
Troels Arnfred Bojesen af96a197c1 Fix Glorot initialization
Should fix #442
2019-11-20 13:20:42 +09:00
Troels Arnfred Bojesen 2b80573248 Fix Glorot initialization, add He initialization
Should fix #442 .
Adds He weight initialization as a bonus :-)
2019-11-19 18:16:29 +09:00
Troels Arnfred Bojesen 4530ac65c7 Fix Glorot initialization, add He initialization
Should fix the issue reported at https://github.com/FluxML/Flux.jl/issues/442 .
Adds He weight initialization as a bonus :-)
2019-11-19 16:50:40 +09:00
dsweber2 dea29532ef Merge branch 'master' into activations 2019-11-15 17:19:43 -08:00
bors[bot] 7eb6a0c98c
Merge #932
932: Travis: test on 1.0 r=MikeInnes a=MikeInnes



Co-authored-by: Mike J Innes <mike.j.innes@gmail.com>
Co-authored-by: Mike Innes <mike.j.innes@gmail.com>
2019-11-15 16:21:30 +00:00
Mike Innes e24215ca98 guard test on 1.0 2019-11-15 15:59:42 +00:00
dsweber2 58c794702d simpler test 2019-11-14 14:05:53 -08:00
dsweber2 db92b0e3ce super simple test 2019-11-14 13:40:52 -08:00
janEbert a00d8d94ec Add test for CUDA binarycrossentropy 2019-11-08 17:28:54 +01:00
Tim Besard 33d276cdb7 Fix GPU-less tests. 2019-11-04 15:51:33 +01:00
Tim Besard 39ab740fb7 Check for CUDA availability at run time. 2019-11-02 11:18:06 +01:00
Katharine Hyatt 8913c9c741 Make the vector of weights test pass on GPU 2019-10-23 09:53:09 -04:00
Katharine Hyatt f7ce717aaa Add tests 2019-10-23 09:22:22 -04:00
Mike Innes b90b02872f Merge branch 'master' into tb/cuarrays_dnn 2019-09-27 14:58:32 +01:00
Mike Innes 691a29cf32 cudnn bug is fixed 2019-09-27 14:15:58 +01:00
bors[bot] acb6a89245
Merge #865
865: Functor r=MikeInnes a=MikeInnes

This refactors our current `@treelike` infrastructure. It somewhat formalises what we're doing around the idea of a Flux model as a functor, i.e. something that can be mapped over.

This is much more flexible than what we had before, and avoids some issues. It allows layers to have state that isn't mappable; it allows for dispatch when walking the tree, which means layers like `BatchNorm` can have non-trainable parameters; and it also allows for zipped mapping like `fmap(+, xs, ys)`, which isn't implemented yet but will be useful for the new optimisers work.

The main downside is that the term `functor` has been previously used in the Julia community as a malapropism for "thing that behaves like a function"; but hopefully this can start to reduce that usage.

Co-authored-by: Mike Innes <mike.j.innes@gmail.com>
2019-09-24 16:36:10 +00:00
Dhairya Gandhi 822288d63d merge conflicts 2019-09-24 00:31:44 +05:30
Mike Innes b60df53ba1 pkg up 2019-09-19 18:33:33 +01:00
Mike Innes cabb81e30b internal rename 2019-09-19 15:53:31 +01:00
Mike Innes b951377426 fix normalisation layer params 2019-09-19 15:33:24 +01:00
Mike Innes f8d5d3b5fc broken normalisation layer params 2019-09-19 14:12:11 +01:00
Mike Innes c5e56b7e04 move setweights and copy_transpose 2019-09-17 17:22:35 +01:00
Mike Innes b348b20452 cudnn rnns + implicit gradients 2019-09-17 15:41:42 +01:00
Mike Innes fe57215b7e test fillarray gradients 2019-09-17 15:21:03 +01:00
Dhairya Gandhi b8d872d842 update to Flux 0.9+ 2019-09-11 21:11:02 +05:30
Mike Innes 250aef5a5a normalise test fixes 2019-09-10 16:19:55 +01:00
Mike Innes 877415be10 rm gradient checks 2019-09-10 15:35:52 +01:00
Mike Innes 221313c977 formatting changed on 1.1 2019-09-10 15:26:51 +01:00
Mike Innes c8d460ff84 doctests passing 2019-09-10 15:02:43 +01:00
Mike J Innes 67c38b3099 Merge branch 'master' into zygote 2019-09-06 15:18:58 +01:00
Mike J Innes 3c1ac84676
Merge pull request #842 from baggepinnen/patch-4
Add RADAM optimizer
2019-09-02 14:36:40 +01:00
Mike J Innes 61a8cfd6ee libcudnn check fix 2019-08-27 15:41:23 +01:00
Tim Besard 6ad3cdd138 Replace Requires with direct CuArrays dependency. 2019-08-27 09:33:15 +02:00
Mike Innes ee74f1a311 pkg up 2019-08-22 13:02:59 +01:00
Mike Innes 487000ac31 fix cuda code and tests 2019-08-19 16:56:48 +01:00
Mike Innes 2f7ad895aa test cleanups 2019-08-19 15:22:50 +01:00
Mike Innes 9590aa63e3 rm last uses of param/data 2019-08-19 15:14:42 +01:00
Fredrik Bagge Carlson 304b433daa
Add RADAM to tests 2019-08-19 13:01:14 +08:00
thebhatman a128a7718d gradients test updated in cudnn 2019-07-16 17:27:35 +05:30
Manjunath Bhat 4ef5ec0005
brackets corrected 2019-07-12 21:03:57 +05:30
thebhatman 8d6028e27a tests with gradients 2019-07-12 20:47:43 +05:30
Mike Innes e2bf46b7fd gpu test fixes 2019-07-12 14:52:01 +01:00
Manjunath Bhat 2b379d0ec0
Allow scalar indexing or onehotbatch tests will fail 2019-07-12 17:56:47 +05:30
DrChainsaw 9b96a3d69b Change to array due to "type definition not allowed inside a local scope" 2019-07-09 01:15:55 +02:00