Merge branch 'master' into master
diff --git a/docs-site/docs/download.md b/docs-site/docs/download.md
index 99ec2d7..d58524a 100644
--- a/docs-site/docs/download.md
+++ b/docs-site/docs/download.md
@@ -23,30 +23,37 @@
- [Apache SINGA 3.1.0](http://www.apache.org/dyn/closer.cgi/singa/3.1.0/apache-singa-3.1.0.tar.gz)
[\[SHA512\]](https://www.apache.org/dist/singa/3.1.0/apache-singa-3.1.0.tar.gz.sha512)
[\[ASC\]](https://www.apache.org/dist/singa/3.1.0/apache-singa-3.1.0.tar.gz.asc)
-- [Release Notes 3.1.0](releases/RELEASE_NOTES_3.1.0)
+- [Release Notes 3.1.0](http://singa.apache.org/docs/releases/RELEASE_NOTES_3.1.0)
- Major changes:
- Update Tensor core:
- - Support tensor transformation (reshape, transpose) for tensors up to 6 dimensions.
- - Implement traverse_unary_transform in Cuda backend, which is similar to CPP backend one.
+ - Support tensor transformation (reshape, transpose) for tensors up to 6
+ dimensions.
+ - Implement traverse_unary_transform in Cuda backend, which is similar to
+ CPP backend one.
- Add new tensor operators into the autograd module.
- Reconstruct sonnx to
- Support creating operators from both layer and autograd.
- - Re-write SingaRep to provide a more powerful intermediate representation of SINGA.
- - Add a SONNXModel which implements from Model to provide uniform API and features.
- - Replace the Travis CI with Github workflow. Add quality and coverage management.
- - Add compiling and packaging scripts to create wheel packages for distribution.
- - Fix bugs
+ - Re-write SingaRep to provide a more powerful intermediate representation
+ of SINGA.
+ - Add a SONNXModel which implements from Model to provide uniform API and
+ features.
+ * Replace the Travis CI with Github workflow. Add quality and coverage
+ management.
+ * Add compiling and packaging scripts to create wheel packages for
+ distribution.
+ * Fix bugs
- Fix IMDB LSTM model example training script.
- Fix Tensor operation Mult on Broadcasting use cases.
- Gaussian function on Tensor now can run on Tensor with odd size.
- - Updated a testing helper function gradients() in autograd to lookup param gradient by param python object id for testing purpose.
+ - Updated a testing helper function gradients() in autograd to lookup param
+ gradient by param python object id for testing purpose.
## V3.0.0 (18 April 2020):
-- [Apache SINGA 3.0.0](http://www.apache.org/dyn/closer.cgi/singa/3.0.0/apache-singa-3.0.0.tar.gz)
- [\[SHA512\]](https://www.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.sha512)
- [\[ASC\]](https://www.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.asc)
-- [Release Notes 3.0.0](releases/RELEASE_NOTES_3.0.0)
+- [Apache SINGA 3.0.0](https://archive.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz)
+ [\[SHA512\]](https://archive.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.sha512)
+ [\[ASC\]](https://archive.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.asc)
+- [Release Notes 3.0.0](http://singa.apache.org/docs/releases/RELEASE_NOTES_3.0.0)
- New features and major changes,
- Enhanced ONNX. Multiple ONNX models have been tested in SINGA.
- Distributed training with MPI and NCCL Communication optimization through
@@ -62,10 +69,10 @@
## Incubating v2.0.0 (20 April 2019):
-- [Apache SINGA 2.0.0 (incubating)](http://www.apache.org/dyn/closer.cgi/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz)
- [\[SHA512\]](https://www.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.sha512)
- [\[ASC\]](https://www.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.asc)
-- [Release Notes 2.0.0 (incubating)](releases/RELEASE_NOTES_2.0.0.html)
+- [Apache SINGA 2.0.0 (incubating)](https://archive.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz)
+ [\[SHA512\]](https://archive.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.sha512)
+ [\[ASC\]](https://archive.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.asc)
+- [Release Notes 2.0.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_2.0.0.html)
- New features and major updates,
- Enhance autograd (for Convolution networks and recurrent networks)
- Support ONNX
@@ -79,7 +86,7 @@
- [Apache SINGA 1.2.0 (incubating)](https://archive.apache.org/dist/incubator/singa/1.2.0/apache-singa-incubating-1.2.0.tar.gz)
[\[SHA512\]](https://archive.apache.org/dist/incubator/singa/1.2.0/apache-singa-incubating-1.2.0.tar.gz.sha512)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/1.2.0/apache-singa-incubating-1.2.0.tar.gz.asc)
-- [Release Notes 1.2.0 (incubating)](releases/RELEASE_NOTES_1.2.0.html)
+- [Release Notes 1.2.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_1.2.0.html)
- New features and major updates,
- Implement autograd (currently support MLP model)
- Upgrade PySinga to support Python 3
@@ -97,7 +104,7 @@
- [Apache SINGA 1.1.0 (incubating)](https://archive.apache.org/dist/incubator/singa/1.1.0/apache-singa-incubating-1.1.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/1.1.0/apache-singa-incubating-1.1.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/1.1.0/apache-singa-incubating-1.1.0.tar.gz.asc)
-- [Release Notes 1.1.0 (incubating)](releases/RELEASE_NOTES_1.1.0.html)
+- [Release Notes 1.1.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_1.1.0.html)
- New features and major updates,
- Create Docker images (CPU and GPU versions)
- Create Amazon AMI for SINGA (CPU version)
@@ -121,7 +128,7 @@
- [Apache SINGA 1.0.0 (incubating)](https://archive.apache.org/dist/incubator/singa/1.0.0/apache-singa-incubating-1.0.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/1.0.0/apache-singa-incubating-1.0.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/1.0.0/apache-singa-incubating-1.0.0.tar.gz.asc)
-- [Release Notes 1.0.0 (incubating)](releases/RELEASE_NOTES_1.0.0.html)
+- [Release Notes 1.0.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_1.0.0.html)
- New features and major updates,
- Tensor abstraction for supporting more machine learning models.
- Device abstraction for running on different hardware devices, including CPU,
@@ -141,7 +148,7 @@
- [Apache SINGA 0.3.0 (incubating)](https://archive.apache.org/dist/incubator/singa/0.3.0/apache-singa-incubating-0.3.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/0.3.0/apache-singa-incubating-0.3.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/0.3.0/apache-singa-incubating-0.3.0.tar.gz.asc)
-- [Release Notes 0.3.0 (incubating)](releases/RELEASE_NOTES_0.3.0.html)
+- [Release Notes 0.3.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_0.3.0.html)
- New features and major updates,
- Training on GPU cluster enables training of deep learning models over a GPU
cluster.
@@ -159,7 +166,7 @@
- [Apache SINGA 0.2.0 (incubating)](https://archive.apache.org/dist/incubator/singa/0.2.0/apache-singa-incubating-0.2.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/0.2.0/apache-singa-incubating-0.2.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/0.2.0/apache-singa-incubating-0.2.0.tar.gz.asc)
-- [Release Notes 0.2.0 (incubating)](releases/RELEASE_NOTES_0.2.0.html)
+- [Release Notes 0.2.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_0.2.0.html)
- New features and major updates,
- Training on GPU enables training of complex models on a single node with
multiple GPU cards.
@@ -187,7 +194,7 @@
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/apache-singa-incubating-0.1.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/apache-singa-incubating-0.1.0.tar.gz.asc)
- [Amazon EC2 image](https://console.aws.amazon.com/ec2/v2/home?region=ap-southeast-1#LaunchInstanceWizard:ami=ami-b41001e6)
-- [Release Notes 0.1.0 (incubating)](releases/RELEASE_NOTES_0.1.0.html)
+- [Release Notes 0.1.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_0.1.0.html)
- Major features include,
- Installation using GNU build utility
- Scripts for job management with zookeeper
diff --git a/docs-site/docs/releases/RELEASE_NOTES_0.1.0.md b/docs-site/docs/releases/RELEASE_NOTES_0.1.0.md
index 9d1dc09..a025794 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_0.1.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_0.1.0.md
@@ -1,6 +1,6 @@
---
id: RELEASE_NOTES_0.1.0
-title: singa-incubating-0.1.0 Release Notes
+title: Apache SINGA-incubating-0.1.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
diff --git a/docs-site/docs/releases/RELEASE_NOTES_0.2.0.md b/docs-site/docs/releases/RELEASE_NOTES_0.2.0.md
index 77633f3..72c2baf 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_0.2.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_0.2.0.md
@@ -1,6 +1,6 @@
---
id: RELEASE_NOTES_0.2.0
-title: singa-incubating-0.2.0 Release Notes
+title: Apache SINGA-incubating-0.2.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
diff --git a/docs-site/docs/releases/RELEASE_NOTES_0.3.0.md b/docs-site/docs/releases/RELEASE_NOTES_0.3.0.md
index ed02198..868c173 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_0.3.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_0.3.0.md
@@ -1,6 +1,6 @@
---
id: RELEASE_NOTES_0.3.0
-title: singa-incubating-0.3.0 Release Notes
+title: Apache SINGA-incubating-0.3.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
diff --git a/docs-site/docs/releases/RELEASE_NOTES_1.0.0.md b/docs-site/docs/releases/RELEASE_NOTES_1.0.0.md
index 0577ede..36ecc98 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_1.0.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_1.0.0.md
@@ -1,6 +1,6 @@
---
id: RELEASE_NOTES_1.0.0
-title: singa-incubating-1.0.0 Release Notes
+title: Apache SINGA-incubating-1.0.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
diff --git a/docs-site/docs/releases/RELEASE_NOTES_1.1.0.md b/docs-site/docs/releases/RELEASE_NOTES_1.1.0.md
index db79546..41ccd28 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_1.1.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_1.1.0.md
@@ -1,6 +1,6 @@
---
id: RELEASE_NOTES_1.1.0
-title: singa-incubating-1.1.0 Release Notes
+title: Apache SINGA-incubating-1.1.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
diff --git a/docs-site/docs/releases/RELEASE_NOTES_1.2.0.md b/docs-site/docs/releases/RELEASE_NOTES_1.2.0.md
index aade8bd..2da1cbd 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_1.2.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_1.2.0.md
@@ -1,6 +1,6 @@
---
id: RELEASE_NOTES_1.2.0
-title: singa-incubating-1.2.0 Release Notes
+title: Apache SINGA-incubating-1.2.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
diff --git a/docs-site/docs/releases/RELEASE_NOTES_2.0.0.md b/docs-site/docs/releases/RELEASE_NOTES_2.0.0.md
index f574d69..9288784 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_2.0.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_2.0.0.md
@@ -1,6 +1,6 @@
---
id: RELEASE_NOTES_2.0.0
-title: singa-incubating-2.0.0 Release Notes
+title: Apache SINGA-incubating-2.0.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
diff --git a/docs-site/docs/releases/RELEASE_NOTES_3.0.0.md b/docs-site/docs/releases/RELEASE_NOTES_3.0.0.md
index 70a0ea2..2922dec 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_3.0.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_3.0.0.md
@@ -1,12 +1,10 @@
---
id: RELEASE_NOTES_3.0.0
-title: singa-3.0.0 Release Notes
+title: Apache SINGA-3.0.0 Release Notes
---
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
-Release Notes - SINGA - Version singa-3.0.0.rc1
-
SINGA is a distributed deep learning library.
This release includes following changes:
diff --git a/docs-site/docs/releases/RELEASE_NOTES_3.1.0.md b/docs-site/docs/releases/RELEASE_NOTES_3.1.0.md
index d716350..f8e556f 100644
--- a/docs-site/docs/releases/RELEASE_NOTES_3.1.0.md
+++ b/docs-site/docs/releases/RELEASE_NOTES_3.1.0.md
@@ -7,39 +7,44 @@
SINGA is a distributed deep learning library.
-This release includes following changes
+This release includes following changes:
- Tensor core:
- - Support tensor transformation (reshape, transpose) for tensors up to 6 dimensions.
- - Implement traverse_unary_transform in Cuda backend, which is similar to CPP backend one.
+ - Support tensor transformation (reshape, transpose) for tensors up to 6
+ dimensions.
+ - Implement traverse_unary_transform in Cuda backend, which is similar to CPP
+ backend one.
-- Add new tensor operators into the autograd module, including CosSim, DepthToSpace, Embedding, Erf,
- Expand, Floor, Pad, Round, Rounde, SpaceToDepth, UpSample, Where. The corresponding ONNX operators are thus supported by SINGA.
+- Add new tensor operators into the autograd module, including CosSim,
+ DepthToSpace, Embedding, Erf, Expand, Floor, Pad, Round, Rounde, SpaceToDepth,
+ UpSample, Where. The corresponding ONNX operators are thus supported by SINGA.
- Add Embedding and Gemm into the layer module.
- Add SGD operators to opt module, including RMSProp, Adam, and AdaGrad.
-- Extend the sonnx module to support DenseNet121, ShuffleNetv1, ShuffleNetv2, SqueezeNet, VGG19, GPT2,
- and RoBERTa.
+- Extend the sonnx module to support DenseNet121, ShuffleNetv1, ShuffleNetv2,
+ SqueezeNet, VGG19, GPT2, and RoBERTa.
- Reconstruct sonnx to
- Support creating operators from both layer and autograd.
- - Re-write SingaRep to provide a more powerful intermediate representation of SINGA.
- - Add a SONNXModel which implements from Model to provide uniform API and features.
+ - Re-write SingaRep to provide a more powerful intermediate representation of
+ SINGA.
+ - Add a SONNXModel which implements from Model to provide uniform API and
+ features.
- Add one example that trains a BiLSTM model over the InsuranceQA data.
-- Replace the Travis CI with Github workflow. Add quality and coverage management.
+- Replace the Travis CI with Github workflow. Add quality and coverage
+ management.
- Add compiling and packaging scripts to creat wheel packages for distribution.
- Fix bugs
-
- Fix IMDB LSTM model example training script.
- Fix Tensor operation Mult on Broadcasting use cases.
- Gaussian function on Tensor now can run on Tensor with odd size.
- - Updated a testing helper function gradients() in autograd to lookup param gradient by param python
- object id for testing purpose.
+ - Updated a testing helper function gradients() in autograd to lookup param
+ gradient by param python object id for testing purpose.
diff --git a/docs-site/website/versioned_docs/version-3.1.0/download.md b/docs-site/website/versioned_docs/version-3.1.0/download.md
index a423077..7e5aefc 100644
--- a/docs-site/website/versioned_docs/version-3.1.0/download.md
+++ b/docs-site/website/versioned_docs/version-3.1.0/download.md
@@ -24,30 +24,37 @@
- [Apache SINGA 3.1.0](http://www.apache.org/dyn/closer.cgi/singa/3.1.0/apache-singa-3.1.0.tar.gz)
[\[SHA512\]](https://www.apache.org/dist/singa/3.1.0/apache-singa-3.1.0.tar.gz.sha512)
[\[ASC\]](https://www.apache.org/dist/singa/3.1.0/apache-singa-3.1.0.tar.gz.asc)
-- [Release Notes 3.1.0](releases/RELEASE_NOTES_3.1.0)
+- [Release Notes 3.1.0](http://singa.apache.org/docs/releases/RELEASE_NOTES_3.1.0)
- Major changes:
- Update Tensor core:
- - Support tensor transformation (reshape, transpose) for tensors up to 6 dimensions.
- - Implement traverse_unary_transform in Cuda backend, which is similar to CPP backend one.
+ - Support tensor transformation (reshape, transpose) for tensors up to 6
+ dimensions.
+ - Implement traverse_unary_transform in Cuda backend, which is similar to
+ CPP backend one.
- Add new tensor operators into the autograd module.
- Reconstruct sonnx to
- Support creating operators from both layer and autograd.
- - Re-write SingaRep to provide a more powerful intermediate representation of SINGA.
- - Add a SONNXModel which implements from Model to provide uniform API and features.
- - Replace the Travis CI with Github workflow. Add quality and coverage management.
- - Add compiling and packaging scripts to create wheel packages for distribution.
- - Fix bugs
+ - Re-write SingaRep to provide a more powerful intermediate representation
+ of SINGA.
+ - Add a SONNXModel which implements from Model to provide uniform API and
+ features.
+ * Replace the Travis CI with Github workflow. Add quality and coverage
+ management.
+ * Add compiling and packaging scripts to create wheel packages for
+ distribution.
+ * Fix bugs
- Fix IMDB LSTM model example training script.
- Fix Tensor operation Mult on Broadcasting use cases.
- Gaussian function on Tensor now can run on Tensor with odd size.
- - Updated a testing helper function gradients() in autograd to lookup param gradient by param python object id for testing purpose.
+ - Updated a testing helper function gradients() in autograd to lookup param
+ gradient by param python object id for testing purpose.
## V3.0.0 (18 April 2020):
-- [Apache SINGA 3.0.0](http://www.apache.org/dyn/closer.cgi/singa/3.0.0/apache-singa-3.0.0.tar.gz)
- [\[SHA512\]](https://www.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.sha512)
- [\[ASC\]](https://www.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.asc)
-- [Release Notes 3.0.0](releases/RELEASE_NOTES_3.0.0)
+- [Apache SINGA 3.0.0](https://archive.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz)
+ [\[SHA512\]](https://archive.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.sha512)
+ [\[ASC\]](https://archive.apache.org/dist/singa/3.0.0/apache-singa-3.0.0.tar.gz.asc)
+- [Release Notes 3.0.0](http://singa.apache.org/docs/releases/RELEASE_NOTES_3.0.0)
- New features and major changes,
- Enhanced ONNX. Multiple ONNX models have been tested in SINGA.
- Distributed training with MPI and NCCL Communication optimization through
@@ -63,10 +70,10 @@
## Incubating v2.0.0 (20 April 2019):
-- [Apache SINGA 2.0.0 (incubating)](http://www.apache.org/dyn/closer.cgi/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz)
- [\[SHA512\]](https://www.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.sha512)
- [\[ASC\]](https://www.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.asc)
-- [Release Notes 2.0.0 (incubating)](releases/RELEASE_NOTES_2.0.0.html)
+- [Apache SINGA 2.0.0 (incubating)](https://archive.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz)
+ [\[SHA512\]](https://archive.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.sha512)
+ [\[ASC\]](https://archive.apache.org/dist/incubator/singa/2.0.0/apache-singa-incubating-2.0.0.tar.gz.asc)
+- [Release Notes 2.0.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_2.0.0.html)
- New features and major updates,
- Enhance autograd (for Convolution networks and recurrent networks)
- Support ONNX
@@ -80,7 +87,7 @@
- [Apache SINGA 1.2.0 (incubating)](https://archive.apache.org/dist/incubator/singa/1.2.0/apache-singa-incubating-1.2.0.tar.gz)
[\[SHA512\]](https://archive.apache.org/dist/incubator/singa/1.2.0/apache-singa-incubating-1.2.0.tar.gz.sha512)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/1.2.0/apache-singa-incubating-1.2.0.tar.gz.asc)
-- [Release Notes 1.2.0 (incubating)](releases/RELEASE_NOTES_1.2.0.html)
+- [Release Notes 1.2.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_1.2.0.html)
- New features and major updates,
- Implement autograd (currently support MLP model)
- Upgrade PySinga to support Python 3
@@ -98,7 +105,7 @@
- [Apache SINGA 1.1.0 (incubating)](https://archive.apache.org/dist/incubator/singa/1.1.0/apache-singa-incubating-1.1.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/1.1.0/apache-singa-incubating-1.1.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/1.1.0/apache-singa-incubating-1.1.0.tar.gz.asc)
-- [Release Notes 1.1.0 (incubating)](releases/RELEASE_NOTES_1.1.0.html)
+- [Release Notes 1.1.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_1.1.0.html)
- New features and major updates,
- Create Docker images (CPU and GPU versions)
- Create Amazon AMI for SINGA (CPU version)
@@ -122,7 +129,7 @@
- [Apache SINGA 1.0.0 (incubating)](https://archive.apache.org/dist/incubator/singa/1.0.0/apache-singa-incubating-1.0.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/1.0.0/apache-singa-incubating-1.0.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/1.0.0/apache-singa-incubating-1.0.0.tar.gz.asc)
-- [Release Notes 1.0.0 (incubating)](releases/RELEASE_NOTES_1.0.0.html)
+- [Release Notes 1.0.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_1.0.0.html)
- New features and major updates,
- Tensor abstraction for supporting more machine learning models.
- Device abstraction for running on different hardware devices, including CPU,
@@ -142,7 +149,7 @@
- [Apache SINGA 0.3.0 (incubating)](https://archive.apache.org/dist/incubator/singa/0.3.0/apache-singa-incubating-0.3.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/0.3.0/apache-singa-incubating-0.3.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/0.3.0/apache-singa-incubating-0.3.0.tar.gz.asc)
-- [Release Notes 0.3.0 (incubating)](releases/RELEASE_NOTES_0.3.0.html)
+- [Release Notes 0.3.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_0.3.0.html)
- New features and major updates,
- Training on GPU cluster enables training of deep learning models over a GPU
cluster.
@@ -160,7 +167,7 @@
- [Apache SINGA 0.2.0 (incubating)](https://archive.apache.org/dist/incubator/singa/0.2.0/apache-singa-incubating-0.2.0.tar.gz)
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/0.2.0/apache-singa-incubating-0.2.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/0.2.0/apache-singa-incubating-0.2.0.tar.gz.asc)
-- [Release Notes 0.2.0 (incubating)](releases/RELEASE_NOTES_0.2.0.html)
+- [Release Notes 0.2.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_0.2.0.html)
- New features and major updates,
- Training on GPU enables training of complex models on a single node with
multiple GPU cards.
@@ -188,7 +195,7 @@
[\[MD5\]](https://archive.apache.org/dist/incubator/singa/apache-singa-incubating-0.1.0.tar.gz.md5)
[\[ASC\]](https://archive.apache.org/dist/incubator/singa/apache-singa-incubating-0.1.0.tar.gz.asc)
- [Amazon EC2 image](https://console.aws.amazon.com/ec2/v2/home?region=ap-southeast-1#LaunchInstanceWizard:ami=ami-b41001e6)
-- [Release Notes 0.1.0 (incubating)](releases/RELEASE_NOTES_0.1.0.html)
+- [Release Notes 0.1.0 (incubating)](http://singa.apache.org/docs/releases/RELEASE_NOTES_0.1.0.html)
- Major features include,
- Installation using GNU build utility
- Scripts for job management with zookeeper
diff --git a/docs-site/website/versioned_docs/version-3.1.0/releases/RELEASE_NOTES_3.0.0.md b/docs-site/website/versioned_docs/version-3.1.0/releases/RELEASE_NOTES_3.0.0.md
new file mode 100644
index 0000000..07e23bb
--- /dev/null
+++ b/docs-site/website/versioned_docs/version-3.1.0/releases/RELEASE_NOTES_3.0.0.md
@@ -0,0 +1,106 @@
+---
+id: version-3.1.0-RELEASE_NOTES_3.0.0
+title: Apache SINGA-3.0.0 Release Notes
+original_id: RELEASE_NOTES_3.0.0
+---
+
+<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->
+
+SINGA is a distributed deep learning library.
+
+This release includes following changes:
+
+- Code quality has been promoted by introducing linting check in CI and auto
+ code formatter. For linting, the tools, `cpplint` and `pylint`, are used and
+ configured to comply
+ [google coding styles](http://google.github.io/styleguide/) details in
+ `tool/linting/`. Similarly, formatting tools, `clang-format` and `yapf`
+ configured with google coding styles, are the recommended one for developers
+ to clean code before submitting changes, details in `tool/code-format/`.
+ [LGTM](https://lgtm.com) is enabled on Github for code quality check; License
+ check is also enabled.
+
+- New Tensor APIs are added for naming consistency, and feature enhancement:
+
+ - size(), mem_size(), get_value(), to_proto(), l1(), l2(): added for the sake
+ of naming consistency
+ - AsType(): convert data type between `float` and `int`
+ - ceil(): perform element-wise ceiling of the input
+ - concat(): concatenate two tensor
+ - index selector: e.g. tensor1[:,:,1:,1:]
+ - softmax(in, axis): allow to perform softmax on a axis on a multi-dimensional
+ tensor
+
+- 14 new operators are added into the autograd module: Gemm, GlobalAveragePool,
+ ConstantOfShape, Dropout, ReduceSum, ReduceMean, Slice, Ceil, Split, Gather,
+ Tile, NonZero, Cast, OneHot. Their unit tests are added as well.
+
+- 14 new operators are added to sonnx module for both backend and frontend:
+ [Gemm](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Gemm),
+ [GlobalAveragePool](https://github.com/onnx/onnx/blob/master/docs/Operators.md#GlobalAveragePool),
+ [ConstantOfShape](https://github.com/onnx/onnx/blob/master/docs/Operators.md#ConstantOfShape),
+ [Dropout](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Dropout),
+ [ReduceSum](https://github.com/onnx/onnx/blob/master/docs/Operators.md#ReduceSum),
+ [ReduceMean](https://github.com/onnx/onnx/blob/master/docs/Operators.md#ReduceMean),
+ [Slice](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Slice),
+ [Ceil](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Ceil),
+ [Split](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Split),
+ [Gather](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Gather),
+ [Tile](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Tile),
+ [NonZero](https://github.com/onnx/onnx/blob/master/docs/Operators.md#NonZero),
+ [Cast](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Cast),
+ [OneHot](https://github.com/onnx/onnx/blob/master/docs/Operators.md#OneHot).
+ Their tests are added as well.
+
+- Some ONNX models are imported into SINGA, including
+ [Bert-squad](https://github.com/onnx/models/tree/master/text/machine_comprehension/bert-squad),
+ [Arcface](https://github.com/onnx/models/tree/master/vision/body_analysis/arcface),
+ [FER+ Emotion](https://github.com/onnx/models/tree/master/vision/body_analysis/emotion_ferplus),
+ [MobileNet](https://github.com/onnx/models/tree/master/vision/classification/mobilenet),
+ [ResNet18](https://github.com/onnx/models/tree/master/vision/classification/resnet),
+ [Tiny Yolov2](https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/tiny_yolov2),
+ [Vgg16](https://github.com/onnx/models/tree/master/vision/classification/vgg),
+ and Mnist.
+
+- Some operators now support
+ [multidirectional broadcasting](https://github.com/onnx/onnx/blob/master/docs/Broadcasting.md#multidirectional-broadcasting),
+ including Add, Sub, Mul, Div, Pow, PRelu, Gemm
+
+- [Distributed training with communication optimization].
+ [DistOpt](./python/singa/opt.py) has implemented multiple optimization
+ techniques, including gradient sparsification, chunk transmission, and
+ gradient compression.
+
+- Computational graph construction at the CPP level. The operations submitted to
+ the Device are buffered. After analyzing the dependency, the computational
+ graph is created, which is further analyzed for speed and memory optimization.
+ To enable this feature, use the [Module API](./python/singa/module.py).
+
+- New website based on Docusaurus. The documentation files are moved to a
+ separate repo [singa-doc](https://github.com/apache/singa-doc). The static
+ website files are stored at
+ [singa-site](https://github.com/apache/singa-site).
+
+- DNNL([Deep Neural Network Library](https://github.com/intel/mkl-dnn)), powered
+ by Intel, is integrated into
+ `model/operations/[batchnorm|pooling|convolution]`, the changes is opaque to
+ the end users. The current version is dnnl v1.1 which replaced previous
+ integration of mkl-dnn v0.18. The framework could boost the performance of dl
+ operations when executing on CPU. The dnnl dependency is installed through
+ conda.
+
+- Some Tensor APIs are marked as deprecated which could be replaced by
+ broadcast, and it can support better on multi-dimensional operations. These
+ APIs are add_column(), add_row(), div_column(), div_row(), mult_column(),
+ mult_row()
+
+- Conv and Pooling are enhanced to support fine-grained padding like (2,3,2,3),
+ and
+ [SAME_UPPER, SAME_LOWER](https://github.com/onnx/onnx/blob/master/docs/Operators.md#Conv)
+ pad mode and shape checking.
+
+- Reconstruct soonx,
+ - Support two types of weight value (Initializer and Constant Node);
+ - For some operators (BatchNorm, Reshape, Clip, Slice, Gather, Tile, OneHot),
+ move some inputs to its attributes;
+ - Define and implement the type conversion map.
diff --git a/docs-site/website/versioned_docs/version-3.1.0/releases/RELEASE_NOTES_3.1.0.md b/docs-site/website/versioned_docs/version-3.1.0/releases/RELEASE_NOTES_3.1.0.md
index 292e5fc..dc0fed5 100644
--- a/docs-site/website/versioned_docs/version-3.1.0/releases/RELEASE_NOTES_3.1.0.md
+++ b/docs-site/website/versioned_docs/version-3.1.0/releases/RELEASE_NOTES_3.1.0.md
@@ -8,39 +8,44 @@
SINGA is a distributed deep learning library.
-This release includes following changes
+This release includes following changes:
- Tensor core:
- - Support tensor transformation (reshape, transpose) for tensors up to 6 dimensions.
- - Implement traverse_unary_transform in Cuda backend, which is similar to CPP backend one.
+ - Support tensor transformation (reshape, transpose) for tensors up to 6
+ dimensions.
+ - Implement traverse_unary_transform in Cuda backend, which is similar to CPP
+ backend one.
-- Add new tensor operators into the autograd module, including CosSim, DepthToSpace, Embedding, Erf,
- Expand, Floor, Pad, Round, Rounde, SpaceToDepth, UpSample, Where. The corresponding ONNX operators are thus supported by SINGA.
+- Add new tensor operators into the autograd module, including CosSim,
+ DepthToSpace, Embedding, Erf, Expand, Floor, Pad, Round, Rounde, SpaceToDepth,
+ UpSample, Where. The corresponding ONNX operators are thus supported by SINGA.
- Add Embedding and Gemm into the layer module.
- Add SGD operators to opt module, including RMSProp, Adam, and AdaGrad.
-- Extend the sonnx module to support DenseNet121, ShuffleNetv1, ShuffleNetv2, SqueezeNet, VGG19, GPT2,
- and RoBERTa.
+- Extend the sonnx module to support DenseNet121, ShuffleNetv1, ShuffleNetv2,
+ SqueezeNet, VGG19, GPT2, and RoBERTa,
- Reconstruct sonnx to
- Support creating operators from both layer and autograd.
- - Re-write SingaRep to provide a more powerful intermediate representation of SINGA.
- - Add a SONNXModel which implements from Model to provide uniform API and features.
+ - Re-write SingaRep to provide a more powerful intermediate representation of
+ SINGA.
+ - Add a SONNXModel which implements from Model to provide uniform API and
+ features.
- Add one example that trains a BiLSTM model over the InsuranceQA data.
-- Replace the Travis CI with Github workflow. Add quality and coverage management.
+- Replace the Travis CI with Github workflow. Add quality and coverage
+ management.
- Add compiling and packaging scripts to creat wheel packages for distribution.
- Fix bugs
-
- Fix IMDB LSTM model example training script.
- Fix Tensor operation Mult on Broadcasting use cases.
- Gaussian function on Tensor now can run on Tensor with odd size.
- - Updated a testing helper function gradients() in autograd to lookup param gradient by param python
- object id for testing purpose.
+ - Updated a testing helper function gradients() in autograd to lookup param
+ gradient by param python object id for testing purpose.
