Dhairya Gandhi
f3904b4e04
add ZeroType back
2019-10-08 17:17:36 +05:30
Dhairya Gandhi
a1e826b888
fixes
2019-10-06 05:10:56 +05:30
Dhairya Gandhi
214f71f492
add N
2019-10-06 04:55:33 +05:30
Dhairya Gandhi
2ae3ad3b31
doc fixes
2019-10-06 04:46:13 +05:30
Dhairya Gandhi
d00f833c17
rm ZeroType
2019-10-06 04:44:50 +05:30
Dhairya Gandhi
e97d61f257
fixes
2019-10-06 04:42:26 +05:30
Dhairya Gandhi
48a305bd21
ditto remaining layers
2019-10-06 04:41:06 +05:30
Dhairya Gandhi
55ef7c1aba
add weight and bias kwargs
2019-10-06 04:25:23 +05:30
Dhairya Gandhi
1fe321781b
add to docs
2019-10-01 21:29:18 +05:30
Dhairya Gandhi
dced8c04e5
use ZeroType
2019-10-01 21:25:07 +05:30
Dhairya Gandhi
a801fcb9e7
docstrings
2019-09-27 12:07:55 +05:30
Dhairya Gandhi
9f2ac8fdef
ditto remaining conv layers
2019-09-27 12:04:27 +05:30
Dhairya Gandhi
5ea6a33f44
make bias optional
2019-09-27 11:48:12 +05:30
Michael Abbott
806e0c5c57
line
2019-09-25 15:20:13 +02:00
Michael Abbott
4245d9acad
eg
2019-09-25 15:18:40 +02:00
Michael Abbott
2de84ce79f
simplify
2019-09-25 13:59:32 +02:00
Michael Abbott
1a1a96571a
+Chain
2019-09-25 13:47:29 +02:00
Michael Abbott
19830c71b1
fix printing of SkipConnection
2019-09-25 13:37:01 +02:00
bors[bot]
acb6a89245
Merge #865
...
865: Functor r=MikeInnes a=MikeInnes
This refactors our current `@treelike` infrastructure. It somewhat formalises what we're doing around the idea of a Flux model as a functor, i.e. something that can be mapped over.
This is much more flexible than what we had before, and avoids some issues. It allows layers to have state that isn't mappable; it allows for dispatch when walking the tree, which means layers like `BatchNorm` can have non-trainable parameters; and it also allows for zipped mapping like `fmap(+, xs, ys)`, which isn't implemented yet but will be useful for the new optimisers work.
The main downside is that the term `functor` has been previously used in the Julia community as a malapropism for "thing that behaves like a function"; but hopefully this can start to reduce that usage.
Co-authored-by: Mike Innes <mike.j.innes@gmail.com>
2019-09-24 16:36:10 +00:00
Dhairya Gandhi
822288d63d
merge conflicts
2019-09-24 00:31:44 +05:30
Dhairya Gandhi
6846551f57
fix cuda init
2019-09-22 22:02:05 +05:30
Mike Innes
b60df53ba1
pkg up
2019-09-19 18:33:33 +01:00
Mike Innes
cabb81e30b
internal rename
2019-09-19 15:53:31 +01:00
Mike Innes
b951377426
fix normalisation layer params
2019-09-19 15:33:24 +01:00
Mike Innes
6529dbcbe6
functor refactor
2019-09-19 15:22:11 +01:00
Mike Innes
2c71fc282b
rename functor.jl
2019-09-19 14:15:28 +01:00
Mike Innes
368b1f53b4
tuple support
2019-09-17 15:49:39 +01:00
Mike Innes
b348b20452
cudnn rnns + implicit gradients
2019-09-17 15:41:42 +01:00
Mike Innes
fe57215b7e
test fillarray gradients
2019-09-17 15:21:03 +01:00
Mike Innes
de2049450b
docs mostly fixed
2019-09-10 15:17:07 +01:00
Mike Innes
c8d460ff84
doctests passing
2019-09-10 15:02:43 +01:00
Mike J Innes
67c38b3099
Merge branch 'master' into zygote
2019-09-06 15:18:58 +01:00
thebhatman
ecc9ce9d64
Gradient on AlphaDropout now working
2019-09-06 16:34:19 +05:30
Mike J Innes
3c1ac84676
Merge pull request #842 from baggepinnen/patch-4
...
Add RADAM optimizer
2019-09-02 14:36:40 +01:00
Manjunath Bhat
c3cc4bf966
Remove double docstring
2019-08-31 01:35:40 +05:30
thebhatman
2f1a187665
Update AlphaDropout
2019-08-31 01:28:58 +05:30
Fredrik Bagge Carlson
cb3bfd72f3
Export RADAM from Optimise
2019-08-29 07:46:45 +08:00
Mike J Innes
9cd97f06f7
define has_cuarrays when no cuda
2019-08-27 15:06:04 +01:00
Tim Besard
4fef9d8508
Don't depend on unreleased CuArrays.
2019-08-27 09:40:22 +02:00
Tim Besard
6ad3cdd138
Replace Requires with direct CuArrays dependency.
2019-08-27 09:33:15 +02:00
janEbert
dec1b37e8e
Merge remote-tracking branch 'origin/master' into HEAD
2019-08-24 12:23:10 +02:00
janEbert
978d7bf195
Fix CuArrays.libcudnn imports
2019-08-24 02:21:54 +02:00
Mike Innes
487000ac31
fix cuda code and tests
2019-08-19 16:56:48 +01:00
Mike Innes
6c67404398
update cleanup
2019-08-19 15:44:51 +01:00
Mike Innes
447fd9d604
conv docstring formatting
2019-08-19 15:30:59 +01:00
Mike Innes
2f7ad895aa
test cleanups
2019-08-19 15:22:50 +01:00
Mike Innes
9590aa63e3
rm last uses of param/data
2019-08-19 15:14:42 +01:00
thebhatman
a76e4d128b
Remove param from crosscor
2019-08-19 19:19:53 +05:30
Manjunath Bhat
8456b7ba45
Remove param from groupnorm
2019-08-19 19:16:21 +05:30
Mike Innes
3ecca436e4
formatting fix
2019-08-19 14:42:07 +01:00
