Dhairya Gandhi
4477dd8d54
reviews
2019-10-10 20:27:11 +05:30
Dhairya Gandhi
f19066ee29
more docstrings
2019-10-10 16:48:12 +05:30
Dhairya Gandhi
fe52689cfe
in depth docstrings
2019-10-09 16:16:11 +05:30
Dhairya Gandhi
b503741651
expanded docstrings
2019-10-04 14:46:03 +05:30
Dhairya Gandhi
8013c728b1
clearer optimiser docstrings
2019-09-28 16:09:00 +05:30
Dhairya Gandhi
0175485a80
fixup
2019-09-27 22:08:25 +05:30
Dhairya Gandhi
8bb0db7d0c
opt docstrings
2019-09-27 22:04:53 +05:30
Michael Abbott
806e0c5c57
line
2019-09-25 15:20:13 +02:00
Michael Abbott
4245d9acad
eg
2019-09-25 15:18:40 +02:00
Michael Abbott
2de84ce79f
simplify
2019-09-25 13:59:32 +02:00
Michael Abbott
1a1a96571a
+Chain
2019-09-25 13:47:29 +02:00
Michael Abbott
19830c71b1
fix printing of SkipConnection
2019-09-25 13:37:01 +02:00
bors[bot]
acb6a89245
Merge #865
...
865: Functor r=MikeInnes a=MikeInnes
This refactors our current `@treelike` infrastructure. It somewhat formalises what we're doing around the idea of a Flux model as a functor, i.e. something that can be mapped over.
This is much more flexible than what we had before, and avoids some issues. It allows layers to have state that isn't mappable; it allows for dispatch when walking the tree, which means layers like `BatchNorm` can have non-trainable parameters; and it also allows for zipped mapping like `fmap(+, xs, ys)`, which isn't implemented yet but will be useful for the new optimisers work.
The main downside is that the term `functor` has been previously used in the Julia community as a malapropism for "thing that behaves like a function"; but hopefully this can start to reduce that usage.
Co-authored-by: Mike Innes <mike.j.innes@gmail.com>
2019-09-24 16:36:10 +00:00
Dhairya Gandhi
822288d63d
merge conflicts
2019-09-24 00:31:44 +05:30
Dhairya Gandhi
6846551f57
fix cuda init
2019-09-22 22:02:05 +05:30
Mike Innes
b60df53ba1
pkg up
2019-09-19 18:33:33 +01:00
Mike Innes
cabb81e30b
internal rename
2019-09-19 15:53:31 +01:00
Mike Innes
b951377426
fix normalisation layer params
2019-09-19 15:33:24 +01:00
Mike Innes
6529dbcbe6
functor refactor
2019-09-19 15:22:11 +01:00
Mike Innes
2c71fc282b
rename functor.jl
2019-09-19 14:15:28 +01:00
Mike Innes
368b1f53b4
tuple support
2019-09-17 15:49:39 +01:00
Mike Innes
b348b20452
cudnn rnns + implicit gradients
2019-09-17 15:41:42 +01:00
Mike Innes
fe57215b7e
test fillarray gradients
2019-09-17 15:21:03 +01:00
Mike Innes
de2049450b
docs mostly fixed
2019-09-10 15:17:07 +01:00
Mike Innes
c8d460ff84
doctests passing
2019-09-10 15:02:43 +01:00
Mike J Innes
67c38b3099
Merge branch 'master' into zygote
2019-09-06 15:18:58 +01:00
thebhatman
ecc9ce9d64
Gradient on AlphaDropout now working
2019-09-06 16:34:19 +05:30
Mike J Innes
3c1ac84676
Merge pull request #842 from baggepinnen/patch-4
...
Add RADAM optimizer
2019-09-02 14:36:40 +01:00
Manjunath Bhat
c3cc4bf966
Remove double docstring
2019-08-31 01:35:40 +05:30
thebhatman
2f1a187665
Update AlphaDropout
2019-08-31 01:28:58 +05:30
Fredrik Bagge Carlson
cb3bfd72f3
Export RADAM from Optimise
2019-08-29 07:46:45 +08:00
Mike J Innes
9cd97f06f7
define has_cuarrays when no cuda
2019-08-27 15:06:04 +01:00
Tim Besard
4fef9d8508
Don't depend on unreleased CuArrays.
2019-08-27 09:40:22 +02:00
Tim Besard
6ad3cdd138
Replace Requires with direct CuArrays dependency.
2019-08-27 09:33:15 +02:00
janEbert
dec1b37e8e
Merge remote-tracking branch 'origin/master' into HEAD
2019-08-24 12:23:10 +02:00
janEbert
978d7bf195
Fix CuArrays.libcudnn imports
2019-08-24 02:21:54 +02:00
Mike Innes
487000ac31
fix cuda code and tests
2019-08-19 16:56:48 +01:00
Mike Innes
6c67404398
update cleanup
2019-08-19 15:44:51 +01:00
Mike Innes
447fd9d604
conv docstring formatting
2019-08-19 15:30:59 +01:00
Mike Innes
2f7ad895aa
test cleanups
2019-08-19 15:22:50 +01:00
Mike Innes
9590aa63e3
rm last uses of param/data
2019-08-19 15:14:42 +01:00
thebhatman
a76e4d128b
Remove param from crosscor
2019-08-19 19:19:53 +05:30
Manjunath Bhat
8456b7ba45
Remove param from groupnorm
2019-08-19 19:16:21 +05:30
Mike Innes
3ecca436e4
formatting fix
2019-08-19 14:42:07 +01:00
Mike Innes
49044dff7c
avoid adjoint on abstract type
2019-08-19 14:39:09 +01:00
Mike Innes
b8fabad337
deprecate param/data
2019-08-19 14:35:48 +01:00
Fredrik Bagge Carlson
3287cf23db
Add RADAM export
2019-08-19 13:07:39 +08:00
Fredrik Bagge Carlson
ebbad0d135
Add RADAM optimizer
2019-08-19 12:22:32 +08:00
Miguel Madrid Mencía
14affbc91b
Use CuArrays.ones instead cuones which is deprecated
2019-08-11 13:38:44 +02:00
Mike J Innes
7c111e7cde
fixes #645
...
fixes #831
2019-08-09 13:53:11 +01:00
