Keno Fischer
16369769ab
Handle various cases of multiplying transpose-wrapped matrices
...
See test cases. I hit these while taking third-order derivatives of
matrix multiplies (whose gradient definitions use transpose).
2019-02-06 10:41:32 -05:00
Keno Fischer
d36d7879df
Add higher order autodiff for getindex
...
This fixed higher order autodiff or getindex (and by extension vcat, since
it's backward pass uses getindex). This makes tracker able to handle
the third order derivatives needed to implement [1].
[1] Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations. https://arxiv.org/abs/1811.02033
2019-02-06 10:41:23 -05:00
Mike J Innes
ecc55ec9e1
Revert "Fix OneHotVector/Matrix performance on GPU"
2019-02-06 14:31:15 +00:00
Mike J Innes
e8b2ec6f67
Merge pull request #311 from tejank10/conv_transpose
...
2D Conv transpose support
2019-02-06 14:14:14 +00:00
Moksh Jain
046f7b4eae
fix std arguments in normalise
2019-02-05 18:36:04 +05:30
Moksh Jain
c6409d7686
add support for n-dimensional input to normalise layer
2019-02-05 17:09:22 +05:30
Mike J Innes
940b1e6dbf
Merge pull request #587 from KristofferC/patch-2
...
use uncorrected standard deviation in normalise
2019-02-04 14:35:25 +00:00
Mike J Innes
7fc920240d
Merge pull request #591 from dhairyagandhi96/onehot
...
Fix OneHotVector/Matrix performance on GPU
2019-02-04 13:53:55 +00:00
Mike J Innes
17f33b4a6a
Merge pull request #583 from KristofferC/kc/small_fixes
...
clarify docs on single batch image to conv
2019-02-04 12:33:34 +00:00
Mike J Innes
e774053126
Merge pull request #590 from oxinabox/patch-2
...
Default to zero'ed initial state for all RNN
2019-02-04 12:28:38 +00:00
Mike J Innes
329c8f8f95
Merge pull request #585 from KristofferC/kc/verify_download
...
add hash verification to datasets
2019-02-04 11:20:53 +00:00
Mike J Innes
cfe6859186
auto-collect in forward
2019-02-04 10:37:02 +00:00
Mike J Innes
838070968e
vcat with scalars
2019-02-04 00:05:16 +00:00
Dhairya Gandhi
30aa814c4d
fixes #582
2019-02-03 18:43:16 +05:30
Dhairya Gandhi
e243950e28
comment fix
2019-02-03 04:00:08 +05:30
Dhairya Gandhi
bd6158d7f9
onehotvector/matrix behaviour
2019-02-03 03:57:41 +05:30
Lyndon White
26550dacda
Default to zero'ed initial state
2019-02-02 20:01:28 +00:00
Tejan Karmali
84eabcd2ae
fixed DepthwiseConv dilation
2019-02-02 12:19:35 +05:30
Tejan Karmali
e54df2de06
Merge branch 'master' into conv_transpose
2019-02-02 10:20:45 +05:30
Kristoffer Carlsson
fd0f1c7a82
use uncorrected standard deviation in normalise
...
fixes https://github.com/FluxML/Flux.jl/issues/529
2019-01-30 17:42:19 +01:00
Kristoffer Carlsson
f60079d07c
add hash verification to datasets
2019-01-30 13:11:26 +01:00
Mike J Innes
0469394715
Merge pull request #576 from mcabbott/patch-1
...
PermutedDimsArray
2019-01-29 14:55:55 +00:00
Mike J Innes
9e553adbf7
add hessian
2019-01-29 08:37:30 +00:00
Michael Abbott
031d1b3d57
PermutedDimsArray like permutedims
...
e.g. PermutedDimsArray(rand(2,3) |> param, (2,1))
2019-01-28 18:15:32 +01:00
Mike J Innes
0f8a4a48c6
extend update! with an optimiser
2019-01-28 14:10:09 +00:00
Mike J Innes
0f2975d905
update -> apply
2019-01-28 13:59:23 +00:00
Mike J Innes
bf0b5c5cef
Merge pull request #535 from asbisen/master
...
fixed stack/unstack function - in utils.jl for v1.0
2019-01-28 12:23:07 +00:00
Mike Innes
af8fdcc7af
fix #573
2019-01-28 10:54:58 +00:00
Mike J Innes
013b421b08
Merge pull request #570 from avik-pal/ap/batchnorm_fixes
...
Patches for default initializers
2019-01-28 10:40:55 +00:00
Mike Innes
1c3a63c42f
fixes #574
2019-01-28 10:11:07 +00:00
Mike J Innes
58ac415f6b
forward mode
2019-01-25 16:14:24 +00:00
Mike J Innes
2b1a3e92da
mapparams
2019-01-25 10:11:46 +00:00
Mike J Innes
791939709b
numeric precision utilities
2019-01-25 10:06:37 +00:00
Mike J Innes
1cf37ab9eb
rm some old deprecations
2019-01-25 09:54:32 +00:00
Avik Pal
733879681e
Change initializer to glorot_uniform
2019-01-24 18:48:30 +05:30
Avik Pal
bb72c528e1
Change initializers to Float32
2019-01-24 18:43:39 +05:30
Mike Innes
ca1c73ed35
fixup
2019-01-24 11:15:57 +00:00
Kristoffer Carlsson
325e3a4f70
clarify docs on single batch image to conv
...
fixes #309
2019-01-24 11:24:10 +01:00
Mike J Innes
62d780c77f
onecold fix
2019-01-24 10:16:41 +00:00
Dhairya Gandhi
4be08fe194
remove debug statement
2019-01-22 17:29:12 +05:30
Mike J Innes
152ce4a164
conversions for dual numbers
2019-01-22 10:07:42 +00:00
Mike J Innes
496dbfabd2
make chain collectable
2019-01-22 00:31:55 +00:00
Mike J Innes
f6397e7358
Merge pull request #517 from FluxML/fix_adamw
...
Fix decay argument in ADAMW
2019-01-18 10:06:23 +00:00
Mike J Innes
058b4dc7fb
Merge pull request #557 from dhairyagandhi96/dg/transpose
...
fix transpose/ adjoint gradient
2019-01-16 15:46:44 +00:00
Mike J Innes
9d56807bcd
cuarrays version check
2019-01-15 11:43:57 -05:00
Dhairya Gandhi
0060cc3453
fixes transpose/ adjoint gradient
2019-01-15 21:59:32 +05:30
Mike J Innes
a3e0de1ee5
fixes #516
2019-01-15 15:49:18 +00:00
Mike J Innes
67d9016319
Merge pull request #538 from KristofferC/kc/promote
...
fix promotion by avoiding integer division in mse and crossentropy
2019-01-15 13:20:46 +00:00
Kristoffer Carlsson
c74aa67c5d
fix promotion by avoiding integer division in mse and crossentropy
...
oops
add tests
2019-01-15 14:15:05 +01:00
Mike J Innes
827a7b8ed5
Merge pull request #546 from ChrisRackauckas/random
...
Support random numbers as constants
2019-01-11 10:06:54 +00:00