Commit graph

2794 commits

Author SHA1 Message Date
Yao Zhang
810059432e Make layer suppor different input and output numeric type and Add Equal Operation as an example (#1520)
* make a layer support different type

* finish equal and make layer suppor different type

* make code clear

* move zipwith to tensor

* fix conflict

* fix scala style error

* change an implementation for make scala2.10 compile successfully
2017-09-06 14:45:12 +08:00
Yang Wang
6f368cfa35 support loading a subset of tf graph and support control dependency in graph (#1499)
* support loading a subset of tf graph

* support load model with specified inputs

* add control dependency support in Graph

* fix file reader conflict

* fix bug

* add some comments

* fix control dep bug

* fix doc
2017-09-04 14:38:04 +08:00
Ian Wong
34baa6cfc4 Allow module output multiple tensor in Graph (#1507)
* Allow module output multiple tensor in Graph

* fix failed unit test

* meet code review

* meet code review

* more unit test

* add more unit tests

* fix unit tests

* fix style check

* fix style check and unit test

* meet code review

* support nested output

* meet code review
2017-09-04 11:19:57 +08:00
Yao Zhang
6fedfc5ca1 Add Squeeze, Prod, Sum, Reshape, Identity, ReLU (#1477)
* finsh Operation, Add, Substract, Multiply and Divide operations

* meet code review

* make acc not be supported

* meet code review

* add some operations

* add prodcut

* add default prod method in UndefinedTensorNumeric class
2017-09-01 16:34:21 +08:00
Yao Zhang
23dfc7a222 1D Max Pooling (#1436)
* finish 1D pooling

* finish documentation

* meet code review

* finish 1d pooling

* meet code review

* fix scala style errors
2017-09-01 15:29:46 +08:00
Yao Zhang
33ab8e8fe5 Add LogicalNot, LogicalOr and LogicalAnd (#1495)
* add boolean, short, int, long, string, char to tensor support

* implement and test LogicalOr and LogicalAnd operations

* add logical not

* change a typo

* refine logicalOr and logicalAnd

* fix scala code style error
2017-09-01 15:27:13 +08:00
Jerry Wu
19737f3a6e serialization - add custom data conversion support (#1511)
* add custom data conversion support

* fix issue

* add missing change

* add missing change
2017-09-01 15:22:10 +08:00
Yan Wan
d345ad10a4 add isInputWithBias and isHiddenWithBias for RNNCell (#1515)
* add isInputWithBias and isHiddenWithBias for RNNCell

* default affine = true in BatchNormParams in recurrent layer

* add serializableSpec for recurrent
2017-08-30 11:20:08 +08:00
Yang Wang
391d3feaf0 Remove the code dealing with translating tensorflow NHWC format to BigDL NCHW format (#1506)
* rm process dims code

* fix rnn and nchw test case
2017-08-29 01:18:04 -07:00
Yan Wan
170f72c534 add isSplitInput in BiRecurrent (#1514)
* add isCloneInput in BiRecurrent

* rename isCloneInput to isSplitInput

* rename test class
2017-08-29 08:40:36 +08:00
Yan Wan
a9ba423241 BifurcateSplitTable (#1513)
* add BifurcateSplitTable

* createBifurcateSplitTable

* add buffer

* clearState
2017-08-28 14:58:45 +08:00
Yan Wan
daf7344ef5 add BatchParams for BiRecurrent layer (#1512) 2017-08-28 12:59:18 +08:00
zhangxiaoli73
370291a66b change tanh backward (#1502) 2017-08-28 09:19:07 +08:00
Yan Wan
9415d4f3d0 Recurrent supports BatchNormalization (#1176)
* addPreprocessInputLayer to support BatchNormalization

* revise bnorm to hiddensize

* add comments

* add BatchNormalization between preTopology and topology

* add BatchNormalization in Recurrent

* recurrent support batchnormalization

* revise sequential to identity in throw new Error

* fix serialize

* add serializeBigDLModule

* return Unit in doSerializeModule
2017-08-25 11:09:27 +08:00
Jerry Wu
e71a4dcf55 Serialization - version control & python API (#1491)
* add version control

* version support

* add python api

* add version control proto

* add unit test

* change function name

* rename function api

* per comments

* refinement to make hierachy more cleaner

* backward compatibility
2017-08-25 08:25:40 +08:00
Yang Wang
b87cf0f95d support NHWC format in SpatialAveragePooling (#1488)
* support NHWC format in SpatialAveragePooling

* fix style

* meet code review
2017-08-24 00:27:39 -07:00
Hawkwood
4586cfa84b Give Detailed information of nn exception (#1482)
* Give Detailed information of nn exception

* modify some changes

* bug fix1
2017-08-24 11:22:24 +08:00
Xianyan
f1b8f790cd fix inplace layer clearstate (#1496)
* fix inplace layer clearstate

* meet code review

* fix bug of LeakyReLU when inplace is true
2017-08-23 13:47:54 +08:00
Xianyan
56d4d42712 [Issue #1033 #450] Disable backpropagation for general layers (#1181)
* add propagateback and generate backward graph

new unit test pass

unit test except resnet pass

unit test pass

support rebuild

support multiple inputs

fix updateGradInput and acc

fix unit test

rename to trainable, add API to set trainable at graph

unit test except inception and resnet pass

unit test pass

code clean

fix conflicts

add unit test for setTrainable, setFreeze, unFreeze

use input buffer

add getSubmodule in AbstractModule

resolve conflicts

update isInputNode

update comment

update setTrainable

fix

fix mixture of graph and container

add setFreeze python API

update python and add doc

meet code review

* meet code review

* fix unit test

* meet code review

* fix code style

* fix inception unit test

* meet code review

* meet code review

* rm cloneNode

* resolve conflicts

* fix reset

* meet code review

* meet code review

* fix
2017-08-23 10:44:11 +08:00
Yang Wang
2f75079c81 Support NHWC format in SpatialMaxPooling (#1444)
* support nhwc in SpatialMaxPooling

* add tests

* fix bug and meet code review

* add python api and doc
2017-08-20 19:51:48 -07:00
Jerry Wu
69fe0e2722 support layerwise serialization (#1472)
* support layerwise serialization

* support layerwise serialization

* add unit tests

* remove commented code

* fix style issue

* change invoke api

* add new api

* resolve conflict

* fix typo

* refinement per review

* refinement per review

* refinement
2017-08-18 17:06:11 +08:00
Yan Wan
2a29808ffc add getTimes in recurrent and TimeDistributed layer (#1470)
* add getTimes

* add getTimes for all Cells

* addTime method in cell

* add appendTimes method

* remove nullException when frequently calling setTimes and getTimes in recurrent layer

* fix bugs in calculating backwardSum

* add getTimes for Graph

* revise ConcatTable

* remove add in calculating backwardTime
2017-08-17 16:24:28 +08:00
zhangxiaoli73
377d90cd4d optimize Sigmoid (#1471) 2017-08-17 13:43:41 +08:00
Yang Wang
0f372cd19c support same padding in maxpooling and avgpooling (#1458)
* support same padding

* add doc

* refactor

* add doc
2017-08-17 10:06:11 +08:00
Yao Zhang
c358955cef Add abstract Operation, Add, Substract, Multiply and Divide operations (#1462)
* finsh Operation, Add, Substract, Multiply and Divide operations

* meet code review

* make acc not be supported

* meet code review

* make documentation better

* rename package object

* rename package object
2017-08-16 17:12:24 +08:00
zhangxiaoli73
058a1cac5e add mkl.tanh (#1450)
* add mkl.tanh

* change core

* chang tanh
2017-08-16 15:54:39 +08:00
Yan Wan
6baef96116 remove set operation (#1464) 2017-08-16 10:51:55 +08:00
Yang Wang
76007c1a30 support nhwc format in SpatialConvolution (#1434)
* support nhwc format in SpatialConvolution

* add python api and doc

* meet code review

* fix bug and add tests

* meet code review

* fix bug
2017-08-14 05:55:26 -07:00
Yan Wan
7d8612d806 optimize logsoftmax (#1424)
* optimize logsoftmax

* use ev instead of MKL

* add clearState

* revise precision of InceptionSpec and EvaluatorSpec using MKL

* revise GoogleNet_v1 test precision

* change buffer name
2017-08-14 15:25:24 +08:00
Yan Wan
78e5653d2a fix copyStatus in TimeDistributed layer (#1451) 2017-08-14 14:05:41 +08:00
zhangxiaoli73
7ac4bbfcc5 add funcional model definition (#1200)
* add inception and lenet graph

* add resnet,autoencoder,alexnet graph

* fix graph unit test

* add vgg graph and test

* add inception_v2 graph

* add inception-v1 graph

* add graph model example

* change JoinTable nInputDims
2017-08-14 11:05:38 +08:00
Yan Wan
59aa377c8b revise LSTMPeephole to Graph (#1430) 2017-08-11 15:07:57 +08:00
Yan Wan
914216b258 GRU to Graph (#1429)
* GRU to Graph

* set withBias = false in gru h2g
2017-08-11 13:57:28 +08:00
Yan Wan
ce22aae616 SimpleRNN to Graph (#1431)
* SimpleRNN to Graph

* move i2h, h2h to buildGraph in SimpleRNN
2017-08-11 13:57:10 +08:00
Yan Wan
86371f3907 LSTM to Graph (#1428) 2017-08-11 13:56:37 +08:00
dding3
38251491a6 Set hiddenstate (#1439)
* support set/get state in recurrent
2017-08-10 20:34:53 -07:00
Yang Wang
fcdb4f0355 add nhwc im2col and col2im kernel (#1419)
* add nhwc im2col and col2im kernel

* address comments
2017-08-07 16:58:46 +08:00
Yao Zhang
3e610768be Add 3D de-convolution (#1401)
* finish volumetric full convolution

* add documentation

* reset core

* meet code review

* add serial version uid

* meet code review
2017-08-03 11:04:21 +08:00
Xin Qiu
2aa51233a8 Check target size in ClassNll (#1420) 2017-08-02 14:27:18 +08:00
dding3
fc4fd2005b add regularizer for convlstmpeephole3d (#1395)
* add regularizer for convlstmpeephole3d
* rename convlstmpeephole2d back to convlstmpeephole
2017-07-27 23:10:48 -07:00
Xianyan
1713f68127 add regulaizer to volumetricconvolution (#1371)
* add regulaizer to volumetricconvolution

* fix name

* update doc

* update doc
2017-07-27 16:45:20 +08:00
Jerry Wu
4e5e25662a Fix temporalconv (#1359)
* add dynamic caffe loading support

* refined with bug fix and more commnets

* fix typo and bias check for convolution

* renaming change

* fix import reference

* refine customized layer support

* fix style check issue

* resolve style issue

* resolve conflict

* add missing method
2017-07-27 14:49:26 +08:00
dding3
4bf88dacb5 support get final state and cell (#1369)
* support get final state and cell
2017-07-26 22:37:11 -07:00
Xianyan
61d443e51c add SpatialWithinChannelLRN, update the mapping of caffe lrn (#1364)
* add SpatialWithinChannelLRN

* add python

* fix map error

* fix python

* meet code review

* update doc
2017-07-26 16:18:23 +08:00
Xianyan
9757dbd1a7 Support global average pooling (#1365)
* add global pooling

* update doc and python

* update doc
2017-07-26 15:35:22 +08:00
dding3
543a3762af Convlstm3d (#1361)
* support convlstm3d
2017-07-25 22:17:34 -07:00
dding3
13ea525adc remove unnecessary contiguous check in volumetricconvolution (#1357)
remove unnecessary contiguous check in volumetricconvolution
2017-07-24 20:59:26 -07:00
Yan Wan
0ed660313a Recurrent: fix clearState (#1306) 2017-07-20 14:43:13 +08:00
Ian Wong
ea3f8cf661 Add scala tensorflow load/save examples (#1291)
* add scala tf example

* update

* update

* fix a small typo

* fix unit test
2017-07-20 00:39:06 -05:00
Yan Wan
dc0d060505 fix batchSize non-consistency bug (#1295)
add unit test
2017-07-20 12:36:13 +08:00