Commit Graph

1751 Commits

Author SHA1 Message Date
Keno Fischer
d55f742533 Add higher order autodiff for getindex
This fixed higher order autodiff or getindex (and by extension vcat, since
it's backward pass uses getindex). This makes tracker able to handle
the third order derivatives needed to implement [1].

[1] Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations. https://arxiv.org/abs/1811.02033
2019-02-05 23:49:48 -05:00
Mike J Innes
0469394715
Merge pull request #576 from mcabbott/patch-1
PermutedDimsArray
2019-01-29 14:55:55 +00:00
Mike J Innes
dd95416a45
Merge pull request #579 from asbisen/master
add tests for stack and unstack
2019-01-29 14:30:23 +00:00
Mike J Innes
490fdd6400 update diffrules 2019-01-29 11:13:50 +00:00
Anand Bisen
3670fabbe6 add tests for stack and unstack 2019-01-29 01:41:15 -08:00
Mike J Innes
66ca92cd03 test against manifest 2019-01-29 09:07:46 +00:00
Mike J Innes
9e553adbf7 add hessian 2019-01-29 08:37:30 +00:00
Michael Abbott
55a7359f67
PermutedDimsArray test 2019-01-28 18:19:06 +01:00
Michael Abbott
031d1b3d57
PermutedDimsArray like permutedims
e.g. PermutedDimsArray(rand(2,3) |> param, (2,1))
2019-01-28 18:15:32 +01:00
Mike J Innes
8386a49bf9
Merge pull request #575 from FluxML/mji/update
Clean up parameter update API
2019-01-28 15:26:57 +00:00
Mike J Innes
e1cac76a34 params update 2019-01-28 14:14:41 +00:00
Mike J Innes
0f8a4a48c6 extend update! with an optimiser 2019-01-28 14:10:09 +00:00
Mike J Innes
0f2975d905 update -> apply 2019-01-28 13:59:23 +00:00
Mike J Innes
bf0b5c5cef
Merge pull request #535 from asbisen/master
fixed stack/unstack function - in utils.jl for v1.0
2019-01-28 12:23:07 +00:00
Mike Innes
af8fdcc7af fix #573 2019-01-28 10:54:58 +00:00
Mike J Innes
013b421b08
Merge pull request #570 from avik-pal/ap/batchnorm_fixes
Patches for default initializers
2019-01-28 10:40:55 +00:00
Mike J Innes
bb2210f552
Merge pull request #553 from xiaodaigh/patch-2
Updated with more detailed instructions for installing CuArrays
2019-01-28 10:36:27 +00:00
Mike Innes
1c3a63c42f fixes #574 2019-01-28 10:11:07 +00:00
susabi
5930ac1730
simplified instructions 2019-01-26 12:26:48 +11:00
Mike J Innes
58ac415f6b forward mode 2019-01-25 16:14:24 +00:00
Mike J Innes
962ce88c0d
Merge pull request #572 from FluxML/precision
Numeric precision utilities
2019-01-25 10:45:13 +00:00
Mike J Innes
2b1a3e92da mapparams 2019-01-25 10:11:46 +00:00
Mike J Innes
791939709b numeric precision utilities 2019-01-25 10:06:37 +00:00
Mike J Innes
1cf37ab9eb rm some old deprecations 2019-01-25 09:54:32 +00:00
Mike J Innes
a9064cad14
Merge pull request #571 from arnaudmgh/patch-1
Adding `nest = true` option in `Tracker.gradient`
2019-01-25 09:47:48 +00:00
Arnaud Amzallag
3cc3c463a3
Adding nest = true option in Tracker.gradient
otherwise fails and returns an error. Note that option has to be added in both `df` and `d2f`.
2019-01-24 19:29:29 -05:00
Avik Pal
2f3ad56166 Add test for Depthwise Conv 2019-01-24 18:53:04 +05:30
Avik Pal
733879681e Change initializer to glorot_uniform 2019-01-24 18:48:30 +05:30
Avik Pal
bb72c528e1 Change initializers to Float32 2019-01-24 18:43:39 +05:30
Avik Pal
73c1485927 Merge branch 'master' of https://github.com/FluxML/Flux.jl 2019-01-24 18:42:28 +05:30
Mike Innes
ca1c73ed35 fixup 2019-01-24 11:15:57 +00:00
Mike Innes
0142d89943 test onecold-of-tracked-gpu-vector
see #556
2019-01-24 10:40:52 +00:00
Mike J Innes
62d780c77f onecold fix 2019-01-24 10:16:41 +00:00
Mike J Innes
1eee724054
Merge pull request #567 from ayan-b/upd-docs
docs/basics.md: Add `using Flux`
2019-01-24 10:01:39 +00:00
Ayan Banerjee
bc68dfbd75
docs/basics.md: Add using Flux
In order to import sigmoid function.
2019-01-23 19:20:10 +05:30
Mike J Innes
f5acf442f5
Merge pull request #565 from ayan-b/upd-docs
docs/basics.md: Add `tracked` after 1.0
2019-01-23 12:55:47 +00:00
Ayan Banerjee
236b103b73
docs/basics.md: Add tracked after 1.0 2019-01-22 23:37:34 +05:30
Dhairya Gandhi
4be08fe194 remove debug statement 2019-01-22 17:29:12 +05:30
Mike J Innes
152ce4a164 conversions for dual numbers 2019-01-22 10:07:42 +00:00
Mike J Innes
496dbfabd2 make chain collectable 2019-01-22 00:31:55 +00:00
Mike Innes
db3f477e15 update 2019-01-21 10:55:30 +00:00
Mike J Innes
f6397e7358
Merge pull request #517 from FluxML/fix_adamw
Fix decay argument in ADAMW
2019-01-18 10:06:23 +00:00
Mike J Innes
058b4dc7fb
Merge pull request #557 from dhairyagandhi96/dg/transpose
fix transpose/ adjoint gradient
2019-01-16 15:46:44 +00:00
Mike J Innes
347678344e
Merge pull request #550 from KristofferC/kc/docs
modernize documentation
2019-01-16 10:31:53 +00:00
Mike J Innes
9d56807bcd cuarrays version check 2019-01-15 11:43:57 -05:00
Mike J Innes
c667423681 package updates 2019-01-15 11:43:23 -05:00
Dhairya Gandhi
0060cc3453 fixes transpose/ adjoint gradient 2019-01-15 21:59:32 +05:30
Mike J Innes
4d79f499bf fixes #549 2019-01-15 15:49:37 +00:00
Mike J Innes
a3e0de1ee5 fixes #516 2019-01-15 15:49:18 +00:00
Mike J Innes
67d9016319
Merge pull request #538 from KristofferC/kc/promote
fix promotion by avoiding integer division in mse and crossentropy
2019-01-15 13:20:46 +00:00