TastyPancakes/Flux.jl
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,198 Commits 104 Branches 42 Tags 5.8 MiB
55ef7c1aba
Commit Graph

2198 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Dhairya Gandhi
55ef7c1aba add weight and bias kwargs 2019-10-06 04:25:23 +05:30
Dhairya Gandhi
1fe321781b add to docs 2019-10-01 21:29:18 +05:30
Dhairya Gandhi
dced8c04e5 use ZeroType 2019-10-01 21:25:07 +05:30
Dhairya Gandhi
a801fcb9e7 docstrings 2019-09-27 12:07:55 +05:30
Dhairya Gandhi
9f2ac8fdef ditto remaining conv layers 2019-09-27 12:04:27 +05:30
Dhairya Gandhi
5ea6a33f44 make bias optional 2019-09-27 11:48:12 +05:30
bors[bot]
12bc06136d
Merge #870 
870: Fix printing of SkipConnection r=MikeInnes a=mcabbott

Before:
```
julia> SkipConnection(Dense(2,2),+)
SkipConnection(Error showing value of type SkipConnection:
ERROR: MethodError: no method matching iterate(::Dense{typeof(identity),TrackedArray{…,Array{Float32,2}},TrackedArray{…,Array{Float32,1}}})

julia> SkipConnection(Chain(Dense(2,3), Dense(3,2), LayerNorm(2)),+)
SkipConnection(Dense(2, 3), Dense(3, 2), LayerNorm(2))

julia> SkipConnection(Dense(2, 3), Dense(3, 2), LayerNorm(2))
ERROR: MethodError: no method matching SkipConnection(::Dense{typeof(identity),TrackedArray{…,Array{Float32,2}},TrackedArray{…,Array{Float32,1}}}, ::Dense{typeof(identity),TrackedArray{…,Array{Float32,2}},TrackedArray{…,Array{Float32,1}}}, ::LayerNorm{TrackedArray{…,Array{Float32,1}}})
```
After:
```
julia> SkipConnection(Dense(2,2),+)
SkipConnection(Dense(2, 2), +)

julia> SkipConnection(Chain(Dense(2,3), Dense(3,2), LayerNorm(2)),+)
SkipConnection(Chain(Dense(2, 3), Dense(3, 2), LayerNorm(2)), +)

julia> SkipConnection(Dense(2,2), (a,b) -> a .+ b./2)
SkipConnection(Dense(2, 2), #9)
```

Co-authored-by: Michael Abbott <32575566+mcabbott@users.noreply.github.com>
 2019-09-25 14:09:28 +00:00
Michael Abbott
806e0c5c57 line 2019-09-25 15:20:13 +02:00
Michael Abbott
4245d9acad eg 2019-09-25 15:18:40 +02:00
Michael Abbott
2de84ce79f simplify 2019-09-25 13:59:32 +02:00
Michael Abbott
1a1a96571a +Chain 2019-09-25 13:47:29 +02:00
Michael Abbott
19830c71b1 fix printing of SkipConnection 2019-09-25 13:37:01 +02:00
bors[bot]
acb6a89245
Merge #865 
865: Functor r=MikeInnes a=MikeInnes

This refactors our current `@treelike` infrastructure. It somewhat formalises what we're doing around the idea of a Flux model as a functor, i.e. something that can be mapped over.

This is much more flexible than what we had before, and avoids some issues. It allows layers to have state that isn't mappable; it allows for dispatch when walking the tree, which means layers like `BatchNorm` can have non-trainable parameters; and it also allows for zipped mapping like `fmap(+, xs, ys)`, which isn't implemented yet but will be useful for the new optimisers work.

The main downside is that the term `functor` has been previously used in the Julia community as a malapropism for "thing that behaves like a function"; but hopefully this can start to reduce that usage.

Co-authored-by: Mike Innes <mike.j.innes@gmail.com>
 2019-09-24 16:36:10 +00:00
bors[bot]
d57636fd48
Merge #861 
861: GPU CI maintainance  r=dhairyagandhi96 a=dhairyagandhi96



Co-authored-by: Dhairya Gandhi <dhairya@juliacopmuting.com>
 2019-09-24 16:06:13 +00:00
Dhairya Gandhi
ce910da948 compat julia v1.0 2019-09-24 17:04:13 +05:30
Dhairya Gandhi
cf593a5744 revert to custom target 2019-09-24 16:43:48 +05:30
Dhairya Gandhi
fe4ecc5880 trying out extending directly 2019-09-24 16:15:48 +05:30
Dhairya Gandhi
928b5dcc2a fix Zygote 2019-09-24 00:51:35 +05:30
Dhairya Gandhi
822288d63d merge conflicts 2019-09-24 00:31:44 +05:30
Dhairya Gandhi
d8a069b304 fix env 2019-09-24 00:28:52 +05:30
Dhairya Gandhi
98308a85ea add gitlab common yaml 2019-09-23 16:55:53 +05:30
Dhairya Gandhi
783ae137e1 remove targets and env 2019-09-23 16:51:11 +05:30
Dhairya Gandhi
6846551f57 fix cuda init 2019-09-22 22:02:05 +05:30
Dhairya Gandhi
787097f9ea use CuArrays#stable 2019-09-21 00:20:54 +05:30
Mike Innes
b60df53ba1 pkg up 2019-09-19 18:33:33 +01:00
Mike Innes
cabb81e30b internal rename 2019-09-19 15:53:31 +01:00
Mike Innes
b951377426 fix normalisation layer params 2019-09-19 15:33:24 +01:00
Mike Innes
6529dbcbe6 functor refactor 2019-09-19 15:22:11 +01:00
Mike Innes
2c71fc282b rename functor.jl 2019-09-19 14:15:28 +01:00
Mike Innes
f8d5d3b5fc broken normalisation layer params 2019-09-19 14:12:11 +01:00
Dhairya Gandhi
99b6fe57e9 extend test template 2019-09-18 12:32:11 +05:30
Dhairya Gandhi
37fe91d54d remove branch restrictions 2019-09-18 12:05:31 +05:30
Mike Innes
fc9db7ee74 pkg up 2019-09-17 15:49:48 +01:00
Mike Innes
368b1f53b4 tuple support 2019-09-17 15:49:39 +01:00
Mike Innes
b348b20452 cudnn rnns + implicit gradients 2019-09-17 15:41:42 +01:00
Mike Innes
fe57215b7e test fillarray gradients 2019-09-17 15:21:03 +01:00
Dhairya Gandhi
29eae312b8
Merge pull request #863 from Naba7/fix_typo 
removed extra parenthesis
 2019-09-14 11:43:20 +05:30
Naba7
a600a9ceed removed extra parenthesis 2019-09-14 10:56:17 +05:30
Dhairya Gandhi
b8d872d842 update to Flux 0.9+ 2019-09-11 21:11:02 +05:30
Dhairya Gandhi
7ebb2cfac5 test on julia 1.2 2019-09-11 21:10:12 +05:30
Mike J Innes
bdeb9c6d58
Merge pull request #669 from FluxML/zygote 
using Zygote
 2019-09-11 16:22:26 +01:00
Dhairya Gandhi
e0276139e1
Update docs/src/training/optimisers.md 
Co-Authored-By: Mike J Innes <mike.j.innes@gmail.com>
 2019-09-11 19:21:15 +05:30
Dhairya Gandhi
b6926f07a5 cleanup 2019-09-11 19:18:50 +05:30
Dhairya Gandhi
b08c949b99 fixes to saving 2019-09-11 14:25:46 +05:30
Dhairya Gandhi
6fd66fd3b5 Merge branch 'zygote' of https://github.com/FluxML/Flux.jl into zygote 2019-09-10 21:20:35 +05:30
Dhairya Gandhi
a9d1cbf07c added decays 2019-09-10 21:20:05 +05:30
Mike Innes
250aef5a5a normalise test fixes 2019-09-10 16:19:55 +01:00
Dhairya Gandhi
b6c8312796 optimiser docs 2019-09-10 20:49:15 +05:30
Mike Innes
877415be10 rm gradient checks 2019-09-10 15:35:52 +01:00
Mike Innes
221313c977 formatting changed on 1.1 2019-09-10 15:26:51 +01:00