bors[bot]
acb6a89245
Merge #865
...
865: Functor r=MikeInnes a=MikeInnes
This refactors our current `@treelike` infrastructure. It somewhat formalises what we're doing around the idea of a Flux model as a functor, i.e. something that can be mapped over.
This is much more flexible than what we had before, and avoids some issues. It allows layers to have state that isn't mappable; it allows for dispatch when walking the tree, which means layers like `BatchNorm` can have non-trainable parameters; and it also allows for zipped mapping like `fmap(+, xs, ys)`, which isn't implemented yet but will be useful for the new optimisers work.
The main downside is that the term `functor` has been previously used in the Julia community as a malapropism for "thing that behaves like a function"; but hopefully this can start to reduce that usage.
Co-authored-by: Mike Innes <mike.j.innes@gmail.com>
2019-09-24 16:36:10 +00:00
bors[bot]
d57636fd48
Merge #861
...
861: GPU CI maintainance r=dhairyagandhi96 a=dhairyagandhi96
Co-authored-by: Dhairya Gandhi <dhairya@juliacopmuting.com>
2019-09-24 16:06:13 +00:00
Dhairya Gandhi
ce910da948
compat julia v1.0
2019-09-24 17:04:13 +05:30
Dhairya Gandhi
cf593a5744
revert to custom target
2019-09-24 16:43:48 +05:30
Dhairya Gandhi
fe4ecc5880
trying out extending directly
2019-09-24 16:15:48 +05:30
Dhairya Gandhi
928b5dcc2a
fix Zygote
2019-09-24 00:51:35 +05:30
Dhairya Gandhi
822288d63d
merge conflicts
2019-09-24 00:31:44 +05:30
Dhairya Gandhi
d8a069b304
fix env
2019-09-24 00:28:52 +05:30
Dhairya Gandhi
98308a85ea
add gitlab common yaml
2019-09-23 16:55:53 +05:30
Dhairya Gandhi
783ae137e1
remove targets and env
2019-09-23 16:51:11 +05:30
Dhairya Gandhi
6846551f57
fix cuda init
2019-09-22 22:02:05 +05:30
Dhairya Gandhi
787097f9ea
use CuArrays#stable
2019-09-21 00:20:54 +05:30
Mike Innes
b60df53ba1
pkg up
2019-09-19 18:33:33 +01:00
Mike Innes
cabb81e30b
internal rename
2019-09-19 15:53:31 +01:00
Mike Innes
b951377426
fix normalisation layer params
2019-09-19 15:33:24 +01:00
Mike Innes
6529dbcbe6
functor refactor
2019-09-19 15:22:11 +01:00
Mike Innes
2c71fc282b
rename functor.jl
2019-09-19 14:15:28 +01:00
Mike Innes
f8d5d3b5fc
broken normalisation layer params
2019-09-19 14:12:11 +01:00
Dhairya Gandhi
99b6fe57e9
extend test template
2019-09-18 12:32:11 +05:30
Dhairya Gandhi
37fe91d54d
remove branch restrictions
2019-09-18 12:05:31 +05:30
Mike Innes
fc9db7ee74
pkg up
2019-09-17 15:49:48 +01:00
Mike Innes
368b1f53b4
tuple support
2019-09-17 15:49:39 +01:00
Mike Innes
b348b20452
cudnn rnns + implicit gradients
2019-09-17 15:41:42 +01:00
Mike Innes
fe57215b7e
test fillarray gradients
2019-09-17 15:21:03 +01:00
Dhairya Gandhi
29eae312b8
Merge pull request #863 from Naba7/fix_typo
...
removed extra parenthesis
2019-09-14 11:43:20 +05:30
Naba7
a600a9ceed
removed extra parenthesis
2019-09-14 10:56:17 +05:30
Dhairya Gandhi
b8d872d842
update to Flux 0.9+
2019-09-11 21:11:02 +05:30
Dhairya Gandhi
7ebb2cfac5
test on julia 1.2
2019-09-11 21:10:12 +05:30
Mike J Innes
bdeb9c6d58
Merge pull request #669 from FluxML/zygote
...
using Zygote
2019-09-11 16:22:26 +01:00
Dhairya Gandhi
e0276139e1
Update docs/src/training/optimisers.md
...
Co-Authored-By: Mike J Innes <mike.j.innes@gmail.com>
2019-09-11 19:21:15 +05:30
Dhairya Gandhi
b6926f07a5
cleanup
2019-09-11 19:18:50 +05:30
Dhairya Gandhi
b08c949b99
fixes to saving
2019-09-11 14:25:46 +05:30
Dhairya Gandhi
6fd66fd3b5
Merge branch 'zygote' of https://github.com/FluxML/Flux.jl into zygote
2019-09-10 21:20:35 +05:30
Dhairya Gandhi
a9d1cbf07c
added decays
2019-09-10 21:20:05 +05:30
Mike Innes
250aef5a5a
normalise test fixes
2019-09-10 16:19:55 +01:00
Dhairya Gandhi
b6c8312796
optimiser docs
2019-09-10 20:49:15 +05:30
Mike Innes
877415be10
rm gradient checks
2019-09-10 15:35:52 +01:00
Mike Innes
221313c977
formatting changed on 1.1
2019-09-10 15:26:51 +01:00
Mike Innes
de2049450b
docs mostly fixed
2019-09-10 15:17:07 +01:00
Mike Innes
ddf06af0b9
remove tracker docs
2019-09-10 15:03:08 +01:00
Mike Innes
c8d460ff84
doctests passing
2019-09-10 15:02:43 +01:00
Mike J Innes
b8e06ef3b7
Merge pull request #857 from giordano/linguist-ignore-citation
...
Restore purity
2019-09-09 15:30:18 +01:00
Mosè Giordano
83b998c39d
Restore purity
2019-09-08 16:15:35 +01:00
Mike J Innes
67c38b3099
Merge branch 'master' into zygote
2019-09-06 15:18:58 +01:00
thebhatman
ecc9ce9d64
Gradient on AlphaDropout now working
2019-09-06 16:34:19 +05:30
Mike J Innes
4ca320444e
pkg up
2019-09-06 11:50:01 +01:00
Mike J Innes
3c1ac84676
Merge pull request #842 from baggepinnen/patch-4
...
Add RADAM optimizer
2019-09-02 14:36:40 +01:00
Manjunath Bhat
c3cc4bf966
Remove double docstring
2019-08-31 01:35:40 +05:30
thebhatman
2f1a187665
Update AlphaDropout
2019-08-31 01:28:58 +05:30
Fredrik Bagge Carlson
fe2e3c3e6b
Add RADAM news entry
2019-08-30 17:08:16 +08:00
