Commit Graph

1626 Commits

Author SHA1 Message Date
Mike J Innes
6114b70f76 use regular + 2016-12-15 22:57:36 +00:00
Mike J Innes
de6c3ef07e remove diff code for now 2016-12-15 22:39:48 +00:00
Mike J Innes
f3555a9c57 remove type rendering overload 2016-12-15 22:36:40 +00:00
Mike J Innes
1c21a860e2 some docstrings 2016-12-15 22:31:27 +00:00
Mike J Innes
62fd13bded consistently use delta for gradients 2016-12-15 21:37:39 +00:00
Mike J Innes
a330b394bd move batchone util 2016-12-15 21:37:07 +00:00
Mike J Innes
03840d043c fix ops 2016-12-15 20:53:15 +00:00
Mike J Innes
4b64bf11a5 fix lstm 2016-12-15 20:53:08 +00:00
Mike J Innes
c6fb9c1f0c fix model call 2016-12-15 18:35:11 +00:00
Mike J Innes
1b22d55401 fix param interpretation 2016-12-13 15:46:34 +00:00
Mike J Innes
2aa8dfc208 tweak constants approach 2016-11-17 11:28:24 +00:00
Mike J Innes
1424b75e78 extra ops 2016-11-17 11:28:15 +00:00
Mike J Innes
b2d9514a9a make astuple more general 2016-11-17 11:27:17 +00:00
Mike J Innes
3e42db0cdf make interpmap composable 2016-11-17 11:26:58 +00:00
Mike J Innes
a6169ec2d0 stateless model support 2016-11-15 23:54:08 +00:00
Mike J Innes
2d90d04789 explicit hidden state batching 2016-11-15 23:44:11 +00:00
Mike J Innes
3c068744d2 get rid of Group 2016-11-15 21:09:58 +00:00
Mike J Innes
d86225ca47 working map interp 2016-11-15 20:46:01 +00:00
Mike J Innes
46aa456bd1 more robust loop lift 2016-11-15 20:45:24 +00:00
Mike J Innes
27554494b7 initial abstract interpretation 2016-11-15 20:01:56 +00:00
Mike J Innes
806febdd37 unroll1 2016-11-15 20:01:35 +00:00
Mike J Innes
7f2ef71daf interpreter 2016-11-15 16:58:59 +00:00
Mike J Innes
f31b539566 make these fit with julia semantics 2016-11-15 16:40:17 +00:00
Mike J Innes
b7caaf4a65 offset escaping 2016-11-15 16:39:51 +00:00
Mike J Innes
8fceb62d33 unrolled models without state input 2016-11-15 13:28:14 +00:00
Mike J Innes
85335e5ed0 esc self param 2016-11-15 00:32:50 +00:00
Mike J Innes
9062792495 rename affine file 2016-11-15 00:09:53 +00:00
Mike J Innes
bdd05157e2 dense -> affine 2016-11-14 22:16:00 +00:00
Mike J Innes
6140448f17 fix 2016-11-14 22:02:20 +00:00
Mike J Innes
ca5058f555 (╯°□°)╯︵ ┻━┻ 2016-11-14 21:58:16 +00:00
Mike J Innes
199765354e fix a todo, houdini-style 2016-11-14 21:56:40 +00:00
Mike J Innes
c597d3a793 ml macro 2016-11-14 20:14:53 +00:00
Mike J Innes
91652e5b44 need this for models with params 2016-11-14 15:42:29 +00:00
Mike J Innes
5a32c72362 use interpreter for forward pass 2016-11-13 20:46:35 +00:00
Mike J Innes
c654fe403a move towards abstract interpreter model 2016-11-13 20:27:20 +00:00
Mike J Innes
6ac4dd8429 move op 2016-11-13 18:16:58 +00:00
Mike J Innes
e4a6ca5f9e remove custom show 2016-11-13 15:35:20 +00:00
Mike J Innes
dab491955f using using 2016-11-11 01:01:26 +00:00
Mike J Innes
2bfe5cce8e update for macrotools change 2016-11-11 01:01:19 +00:00
Mike J Innes
600b3fb54c move input logic to flow 2016-11-09 21:47:54 +00:00
Mike J Innes
ad6e6b4116 update recurrent usage 2016-11-08 18:08:13 +00:00
Mike J Innes
224d84691d appears to be working 2016-11-08 18:02:14 +00:00
Mike J Innes
21a3b95260 mostly recover old behaviour 2016-11-08 00:06:45 +00:00
Mike J Innes
42a7a6ebf6 delay -> offset 2016-11-07 19:44:51 +00:00
Mike J Innes
c3d32c395c new progress integration 2016-11-04 22:28:12 +00:00
Mike J Innes
d7d95feab8 actually get GRU working 2016-11-02 00:36:13 +00:00
Mike J Innes
85415d4244 throw GRU together 2016-11-01 14:42:41 +00:00
Mike J Innes
53ebb5051a Flow -> DataFlow 2016-10-31 12:38:18 +00:00
Mike J Innes
7cd94b4a5d well, that was easy 😎 2016-10-31 11:01:19 +00:00
Mike J Innes
4517e41226 sampling + tweaks 2016-10-30 16:07:29 +00:00
Mike J Innes
508364407e simplify recurrent layer 2016-10-30 16:07:18 +00:00
Mike J Innes
a6fe1f3810 use new session and store params back in the model 2016-10-30 15:08:50 +00:00
Mike J Innes
b443425c6d cross entropy loss, loss checks 2016-10-30 14:12:03 +00:00
Mike J Innes
3b70ea6a42 split out makesession 2016-10-30 12:29:00 +00:00
Mike J Innes
e433ffce8f split out makesession logic 2016-10-30 12:10:44 +00:00
Mike J Innes
81d9743836 export recurrent 2016-10-30 11:41:52 +00:00
Mike J Innes
fabff9b0d2 todo 2016-10-30 11:38:35 +00:00
Mike J Innes
671640acd6 ninputs utility 2016-10-30 11:38:13 +00:00
Mike J Innes
a99bb03830 gradients are slow 2016-10-30 10:55:07 +00:00
Mike J Innes
ec1950b466 .* in tf 2016-10-30 10:54:55 +00:00
Mike J Innes
a1b1d87767 update states references 2016-10-30 01:58:39 +01:00
Mike J Innes
4d45ee1bb9 length for iterators 2016-10-30 01:18:20 +01:00
Mike J Innes
1761e43bc4 handle state in training 2016-10-30 00:24:29 +01:00
Mike J Innes
605e3a9363 don't rebatch batches 2016-10-30 00:20:15 +01:00
Mike J Innes
06e37081d3 consistent naming 2016-10-30 00:19:57 +01:00
Mike J Innes
73ff5b4201 batched training for char-rnn 2016-10-29 23:36:39 +01:00
Mike J Innes
ba78b99b86 include that 2016-10-29 00:16:24 +01:00
Mike J Innes
89c4a6df31 this is no longer test code 2016-10-29 00:13:32 +01:00
Mike J Innes
4de16171db basic sequence model training 2016-10-29 00:10:27 +01:00
Mike J Innes
d9abb8f0ce chunks util 2016-10-28 21:47:57 +01:00
Mike J Innes
d9ed5676c2 handle state on julia side 2016-10-28 21:17:48 +01:00
Mike J Innes
e450a585b7 handling of multiple outputs 2016-10-28 20:50:27 +01:00
Mike J Innes
1c6eaece5d rename seqmodel 2016-10-28 19:11:38 +01:00
Mike J Innes
102e09d14b tf recurrent models 2016-10-28 17:14:57 +01:00
Mike J Innes
217e28653a tf cycle conversion error 2016-10-28 17:12:19 +01:00
Mike J Innes
c5a64391a1 use batching api 2016-10-28 17:00:31 +01:00
Mike J Innes
2852dddf0f put this back 2016-10-28 16:26:06 +01:00
Mike J Innes
8140c2312d todone 2016-10-28 16:25:59 +01:00
Mike J Innes
d6eacf3375 better handling for reused params 2016-10-28 16:06:56 +01:00
Mike J Innes
740d868ef9 tf.model refactor 2016-10-28 15:13:58 +01:00
Mike J Innes
27aa2bf8d4 graph support 2016-10-28 15:13:43 +01:00
Mike J Innes
d42130b8cd fix for matmul 2016-10-28 15:02:48 +01:00
Mike J Innes
1a726033f4 do this properly 2016-10-26 15:49:35 +01:00
Mike J Innes
d5d7242c53 export unroll 2016-10-26 15:37:30 +01:00
Mike J Innes
0ad569596b tf reorg 2016-10-26 14:25:10 +01:00
Mike J Innes
82d69757c7 BatchSeq convenience alias 2016-10-26 12:37:48 +01:00
Mike J Innes
823792bc19 unrolled type 2016-10-26 11:57:03 +01:00
Mike J Innes
2a58b23085 more interesting recurrent model 2016-10-26 11:34:17 +01:00
Mike J Innes
652c26728e better loop lifting semantics 2016-10-26 11:19:45 +01:00
Mike J Innes
42b50c976a fix unrolling 2016-10-26 00:49:32 +01:00
Mike J Innes
ba60c4596b graph op fixes 2016-10-26 00:39:16 +01:00
Mike J Innes
eb78f67a93 refactor input model 2016-10-25 23:10:35 +01:00
Mike J Innes
10761a4bee update for flow 2016-10-25 22:28:30 +01:00
Mike J Innes
91a62a04bc update for flow exports 2016-10-25 21:32:51 +01:00
Mike J Innes
14e4117837 basic unrolling 2016-10-25 21:10:04 +01:00
Mike J Innes
1fde7b4615 preserve default values for hidden states 2016-10-25 19:10:26 +01:00
Mike J Innes
dea85df8b7 use param object rather than named input 2016-10-25 17:57:20 +01:00
Mike J Innes
ee0c5ae14e remove mxnet for now 2016-10-25 17:37:37 +01:00
Mike J Innes
d442dd8c5b use Float32 here 2016-10-25 16:23:04 +01:00
Mike J Innes
a06145a145 use new batching approach in TensorFlow 2016-10-25 16:21:17 +01:00
Mike J Innes
46550e4863 suspiciously similar seq data structure 2016-10-25 14:10:49 +01:00
Mike J Innes
95b955246d export rawbatch 2016-10-25 14:10:32 +01:00
Mike J Innes
7438ee6108 move convert method 2016-10-25 14:10:27 +01:00
Mike J Innes
1847809e99 batching refactor, nested batches 2016-10-25 13:48:30 +01:00
Mike J Innes
183c3b0680 batch tweaks 2016-10-15 18:16:04 +01:00
Mike J Innes
6d53b7af47 batch data structure 2016-10-12 22:49:08 +01:00
Mike J Innes
c9f9665e4e move batching logic 2016-10-12 17:07:22 +01:00
Mike J Innes
b115d8ce3f model -> net 2016-10-12 16:28:16 +01:00
Mike J Innes
a56af5d16e reshape layer 2016-10-10 23:48:16 +01:00
Mike J Innes
438dc9d40a fix conv2d shape inference 2016-10-10 23:20:40 +01:00
Mike J Innes
4961bf72af updates 2016-10-10 23:04:26 +01:00
Mike J Innes
45d30312b6 tf flatten 2016-10-04 22:50:20 +01:00
Mike J Innes
bf04b70ad1 Float32 by default 2016-10-04 22:36:56 +01:00
Mike J Innes
9e9c57d49b more TF support 2016-10-04 22:23:37 +01:00
Mike J Innes
cc1ca4c3c2 Conv2D tweaks 2016-10-04 22:23:26 +01:00
Mike J Innes
c709041d73 forward useful size method 2016-10-04 22:23:10 +01:00
Mike J Innes
2609d47ce9 work more nicely with TF batching 2016-10-04 21:10:50 +01:00
Mike J Innes
8335ab8134 sort-of working mnist example 2016-09-29 21:28:53 +01:00
Mike J Innes
a2aade718d get basic training working 2016-09-29 20:50:43 +01:00
Mike J Innes
9e35bcd4b7 remove demo code 2016-09-28 17:15:52 +01:00
Mike J Innes
74dc86bfbf backward pass shim 2016-09-28 17:15:41 +01:00
Mike J Innes
b662df6ce1 basic tf backend 2016-09-27 02:16:49 +01:00
Mike J Innes
df38a89d9a some attempts to get mxnet working 2016-09-26 21:44:53 +01:00
Mike J Innes
20c2017d15 fix matmul 2016-09-26 19:42:24 +01:00
Mike J Innes
bec7219a93 awful hack to get both examples working 2016-09-06 18:42:08 +01:00
Mike J Innes
62ede8cd80 use Juno progress bar 2016-09-06 18:37:39 +01:00
Mike J Innes
781f5c0c24 probably-not-working concatenation 2016-09-06 18:11:15 +01:00
Mike J Innes
8961b4c10f basic convnet example working 2016-09-06 18:11:15 +01:00
Mike J Innes
205e1215d6 remove anon model compilation 2016-09-06 18:11:15 +01:00
Mike J Innes
467e829b64 tweaks 2016-09-06 18:11:15 +01:00
Mike J Innes
6503496c39 improve printing 2016-09-06 18:11:14 +01:00
Mike J Innes
abcb6d6351 recurrence proof of concept 2016-09-06 18:11:14 +01:00
Mike J Innes
d58fefb972 tweak note 2016-09-06 18:11:14 +01:00
Mike J Innes
cd968af228 basic unrolling 2016-09-06 18:11:14 +01:00
Mike J Innes
19b5e8bd21 loop lifting 2016-09-06 18:11:14 +01:00
Mike J Innes
edf69ac968 handle recurrence 2016-09-06 18:11:14 +01:00
Mike J Innes
c55f955f1e nicer mxmodel printing 2016-09-06 18:11:14 +01:00
Mike J Innes
2b88be1c7f whoops 2016-09-06 18:11:14 +01:00
Mike J Innes
821efb0cf6 show accuracy less frequently 2016-09-06 18:11:14 +01:00
Mike J Innes
c92cff5dce a bunch of stuff 2016-09-06 18:11:05 +01:00
Mike J Innes
29aab1e4e0 more activation functions 2016-09-06 18:10:21 +01:00
Mike J Innes
526165c897 mxmodel tweaks 2016-09-06 18:10:21 +01:00
Mike J Innes
afac5d8bfe better default init 2016-09-06 18:10:21 +01:00
Mike J Innes
fd67383494 don't print reams of data 2016-09-06 18:10:21 +01:00
Mike J Innes
9675dc765d backprop for sigma 2016-09-06 18:10:21 +01:00
Mike J Innes
e17d1cbe7a fix signs 2016-09-06 18:10:20 +01:00
Mike J Innes
8224c77f7d fix for new api 2016-09-06 18:10:20 +01:00
Mike J Innes
5ea18ddffd revive basic train code 2016-09-06 18:10:20 +01:00
Mike J Innes
6e5e532cc1 update step for mxnet models 2016-09-06 18:10:20 +01:00
Mike J Innes
c1d85abfc2 i fluxed up 2016-09-06 18:10:20 +01:00
Mike J Innes
8c7e74bf9f implement mxnet backward pass 2016-09-06 18:10:20 +01:00
Mike J Innes
2635283bf1 small reorg 2016-09-06 18:10:20 +01:00
Mike J Innes
b8565a4cc3 update api 2016-09-06 18:10:20 +01:00
Mike J Innes
6808a92793 anonymous models 2016-09-06 18:10:20 +01:00
Mike J Innes
51d14cef20 make sure package loads 2016-09-06 18:10:20 +01:00
Mike J Innes
dcdc5fd9c3 rename ModelInput 2016-09-06 18:10:20 +01:00
Mike J Innes
545d4480ed tweaks 2016-09-06 18:10:20 +01:00
Mike J Innes
20b13b9a41 fix 2016-09-06 18:10:20 +01:00
Mike J Innes
c4b96dbc98 add gradients in place 2016-09-06 18:10:20 +01:00
Mike J Innes
79981d6415 update mxnet backend 2016-09-06 18:10:19 +01:00
Mike J Innes
cf2b168a55 support for inner layers 2016-09-06 18:10:19 +01:00
Mike J Innes
8e92403436 new params approach 2016-09-06 18:10:19 +01:00
Mike J Innes
54dd0a1e0e get forward pass working 2016-09-06 18:10:19 +01:00
Mike J Innes
cab43611e3 basic MXNet output 2016-09-06 18:10:19 +01:00
Mike J Innes
0496ce6bda deprecation 2016-09-06 18:10:19 +01:00
Mike J Innes
5995597ebc dense layer 2016-09-06 18:10:19 +01:00
Mike J Innes
4b9a2b865d model macro 2016-09-06 18:10:19 +01:00
Mike J Innes
787d563ac1 subtype of model 2016-09-06 18:10:19 +01:00
Mike J Innes
afe5f36c26 provide raw graph for models 2016-09-06 18:10:19 +01:00
Mike J Innes
4667c55a8a tweak for flow api 2016-09-06 18:10:19 +01:00
Mike J Innes
bd8c935aef updates for Flow 2016-09-06 18:10:18 +01:00
Mike J Innes
9986a1c163 remove old torch-esque code 2016-09-06 18:10:18 +01:00
Mike J Innes
52388af421 remove capacitor cruft 2016-09-06 18:10:18 +01:00
Mike J Innes
3de0bc4dec remove loop compilation 2016-09-06 18:10:18 +01:00
Mike Innes
e5856d8b27 init 2016-09-06 18:10:18 +01:00
Mike Innes
484d9f45ab Flux.jl generated files.
license:  MIT
    authors:  Mike Innes
    years:    2016
    user:     one-more-minute

Julia Version 0.4.4-pre+43 [147d6d0*]
2016-03-22 19:58:58 +00:00