Commit Graph

1743 Commits

Author SHA1 Message Date
Keno Fischer
45c7ab8e6d Some memory improvements to OneHotMatrix
1. Parameterize OneHotVector on Integer type, to avoid using more memory
   than required for vectors of them.
2. Switch OneHotMatrix from storing a vector of OneHotVectors to only storing
   the data and the size of the vector (reconstructing the vector locally), thus
   saving half the memory required and eliminating a transpose operation for
   matmul with OneHotMatrix on TPU.
2019-01-28 20:26:59 -05:00
Mike J Innes
8386a49bf9
Merge pull request #575 from FluxML/mji/update
Clean up parameter update API
2019-01-28 15:26:57 +00:00
Mike J Innes
e1cac76a34 params update 2019-01-28 14:14:41 +00:00
Mike J Innes
0f8a4a48c6 extend update! with an optimiser 2019-01-28 14:10:09 +00:00
Mike J Innes
0f2975d905 update -> apply 2019-01-28 13:59:23 +00:00
Mike J Innes
bf0b5c5cef
Merge pull request #535 from asbisen/master
fixed stack/unstack function - in utils.jl for v1.0
2019-01-28 12:23:07 +00:00
Mike Innes
af8fdcc7af fix #573 2019-01-28 10:54:58 +00:00
Mike J Innes
013b421b08
Merge pull request #570 from avik-pal/ap/batchnorm_fixes
Patches for default initializers
2019-01-28 10:40:55 +00:00
Mike J Innes
bb2210f552
Merge pull request #553 from xiaodaigh/patch-2
Updated with more detailed instructions for installing CuArrays
2019-01-28 10:36:27 +00:00
Mike Innes
1c3a63c42f fixes #574 2019-01-28 10:11:07 +00:00
susabi
5930ac1730
simplified instructions 2019-01-26 12:26:48 +11:00
Mike J Innes
58ac415f6b forward mode 2019-01-25 16:14:24 +00:00
Mike J Innes
962ce88c0d
Merge pull request #572 from FluxML/precision
Numeric precision utilities
2019-01-25 10:45:13 +00:00
Mike J Innes
2b1a3e92da mapparams 2019-01-25 10:11:46 +00:00
Mike J Innes
791939709b numeric precision utilities 2019-01-25 10:06:37 +00:00
Mike J Innes
1cf37ab9eb rm some old deprecations 2019-01-25 09:54:32 +00:00
Mike J Innes
a9064cad14
Merge pull request #571 from arnaudmgh/patch-1
Adding `nest = true` option in `Tracker.gradient`
2019-01-25 09:47:48 +00:00
Arnaud Amzallag
3cc3c463a3
Adding nest = true option in Tracker.gradient
otherwise fails and returns an error. Note that option has to be added in both `df` and `d2f`.
2019-01-24 19:29:29 -05:00
Avik Pal
2f3ad56166 Add test for Depthwise Conv 2019-01-24 18:53:04 +05:30
Avik Pal
733879681e Change initializer to glorot_uniform 2019-01-24 18:48:30 +05:30
Avik Pal
bb72c528e1 Change initializers to Float32 2019-01-24 18:43:39 +05:30
Avik Pal
73c1485927 Merge branch 'master' of https://github.com/FluxML/Flux.jl 2019-01-24 18:42:28 +05:30
Mike Innes
ca1c73ed35 fixup 2019-01-24 11:15:57 +00:00
Mike Innes
0142d89943 test onecold-of-tracked-gpu-vector
see #556
2019-01-24 10:40:52 +00:00
Mike J Innes
62d780c77f onecold fix 2019-01-24 10:16:41 +00:00
Mike J Innes
1eee724054
Merge pull request #567 from ayan-b/upd-docs
docs/basics.md: Add `using Flux`
2019-01-24 10:01:39 +00:00
Ayan Banerjee
bc68dfbd75
docs/basics.md: Add using Flux
In order to import sigmoid function.
2019-01-23 19:20:10 +05:30
Mike J Innes
f5acf442f5
Merge pull request #565 from ayan-b/upd-docs
docs/basics.md: Add `tracked` after 1.0
2019-01-23 12:55:47 +00:00
Ayan Banerjee
236b103b73
docs/basics.md: Add tracked after 1.0 2019-01-22 23:37:34 +05:30
Dhairya Gandhi
4be08fe194 remove debug statement 2019-01-22 17:29:12 +05:30
Mike J Innes
152ce4a164 conversions for dual numbers 2019-01-22 10:07:42 +00:00
Mike J Innes
496dbfabd2 make chain collectable 2019-01-22 00:31:55 +00:00
Mike Innes
db3f477e15 update 2019-01-21 10:55:30 +00:00
Mike J Innes
f6397e7358
Merge pull request #517 from FluxML/fix_adamw
Fix decay argument in ADAMW
2019-01-18 10:06:23 +00:00
Mike J Innes
058b4dc7fb
Merge pull request #557 from dhairyagandhi96/dg/transpose
fix transpose/ adjoint gradient
2019-01-16 15:46:44 +00:00
Mike J Innes
347678344e
Merge pull request #550 from KristofferC/kc/docs
modernize documentation
2019-01-16 10:31:53 +00:00
Mike J Innes
9d56807bcd cuarrays version check 2019-01-15 11:43:57 -05:00
Mike J Innes
c667423681 package updates 2019-01-15 11:43:23 -05:00
Dhairya Gandhi
0060cc3453 fixes transpose/ adjoint gradient 2019-01-15 21:59:32 +05:30
Mike J Innes
4d79f499bf fixes #549 2019-01-15 15:49:37 +00:00
Mike J Innes
a3e0de1ee5 fixes #516 2019-01-15 15:49:18 +00:00
Mike J Innes
67d9016319
Merge pull request #538 from KristofferC/kc/promote
fix promotion by avoiding integer division in mse and crossentropy
2019-01-15 13:20:46 +00:00
Kristoffer Carlsson
c74aa67c5d fix promotion by avoiding integer division in mse and crossentropy
oops

add tests
2019-01-15 14:15:05 +01:00
Mike J Innes
827a7b8ed5
Merge pull request #546 from ChrisRackauckas/random
Support random numbers as constants
2019-01-11 10:06:54 +00:00
Mike J Innes
aa1b4f410f simplify 2019-01-11 10:06:14 +00:00
susabi
3f62bc30b9
Update gpu.md 2019-01-11 15:57:54 +11:00
susabi
e13c6c1125
updated gpu.md with installation instructions 2019-01-11 15:55:39 +11:00
Christopher Rackauckas
f6faa10ee2 remove non-type dispatches 2019-01-10 08:57:10 -08:00
Kristoffer Carlsson
2298e4fea1 modernize documentation 2019-01-10 15:06:11 +01:00
Mike J Innes
f0d5624ed2
Merge pull request #493 from dhairyagandhi96/master
[WIP] New Optimiser Docs
2019-01-10 11:10:38 +00:00