diff --git a/RELEASE_NOTES b/RELEASE_NOTES
index 43d4004..a75ceea 100644
--- a/RELEASE_NOTES
+++ b/RELEASE_NOTES
@@ -1,3 +1,102 @@
+Release Notes - SINGA - Version singa-incubating-2.0.0
+
+SINGA is a general distributed deep learning platform for training big deep
+learning models over large datasets.
+
+This release includes following features:
+
+  * Core components
+    * [SINGA-434] Support tensor broadcasting
+    * [SINGA-370] Improvement to tensor reshape and various misc. changes related to SINGA-341 and 351
+
+  * Model components
+    * [SINGA-333] Add support for Open Neural Network Exchange (ONNX) format
+    * [SINGA-385] Add new python module for optimizers
+    * [SINGA-394] Improve the CPP operations via Intel MKL DNN lib
+    * [SINGA-425] Add 3 operators , Abs(), Exp() and leakyrelu(), for Autograd 
+    * [SINGA-410] Add two function, set_params() and get_params(), for Autograd Layer class
+    * [SINGA-383] Add Separable Convolution for autograd
+    * [SINGA-388] Develop some RNN layers by calling tiny operations like matmul, addbias.
+    * [SINGA-382] Implement concat operation for autograd    
+    * [SINGA-378] Implement maxpooling operation and its related functions for autograd
+    * [SINGA-379] Implement batchnorm operation and its related functions for autograd
+
+  * Utility functions and CI
+    * [SINGA-432] Update depdent lib versions in conda-build config
+    * [SINGA-429] Update docker images for latest cuda and cudnn
+    * [SINGA-428] Move Docker images under Apache user name
+
+  * Documentation and usability
+    * [SINGA-395] Add documentation for autograd APIs
+    * [SINGA-344] Add a GAN example
+    * [SINGA-390] Update installation.md
+    * [SINGA-384] Implement ResNet using autograd API
+    * [SINGA-352] Complete SINGA documentation in Chinese version
+      
+  * Bugs fixed
+    * [SINGA-431] Unit Test failed - Tensor Transpose
+    * [SINGA-422] ModuleNotFoundError: No module named "_singa_wrap"
+    * [SINGA-418] Unsupportive type 'long' in python3.  
+    * [SINGA-409] Basic `singa-cpu` import throws error
+    * [SINGA-408] Unsupportive function definition in python3
+    * [SINGA-380] Fix bugs from Reshape  
+
+---------------------------------------------------------------
+Release Notes - SINGA - Version singa-incubating-1.2.0
+
+SINGA is a general distributed deep learning platform for training big deep
+learning models over large datasets.
+
+This release includes following features:
+
+  * Core components
+      * [SINGA-290] Upgrade to Python 3
+      * [SINGA-341] Added stride functionality to tensors for CPP
+      * [SINGA-347] Create a function that supports einsum
+      * [SINGA-351] Added stride support and cudnn codes to cuda
+
+  * Model components
+      * [SINGA-300] Add residual networks for imagenet classification
+      * [SINGA-312] Rename layer parameters
+      * [SINGA-313] Add L2 norm layer
+      * [SINGA-315] Reduce memory footprint by Python generator for parameter
+      * [SINGA-316] Add SigmoidCrossEntropy
+      * [SINGA-324] Extend RNN layer to accept variant seq length across batches
+      * [SINGA-326] Add Inception V4 for ImageNet classification
+      * [SINGA-328] Add VGG models for ImageNet classification
+      * [SINGA-329] Support layer freezing during training (fine-tuning)
+      * [SINGA-346] Update cudnn from V5 to V7
+      * [SINGA-349] Create layer operations for autograd
+      * [SINGA-363] Add DenseNet for Imagenet classification
+
+  * Utility functions and CI
+      * [SINGA-274] Improve Debian packaging with CPack
+      * [SINGA-303] Create conda packages
+      * [SINGA-337] Add test cases for code
+      * [SINGA-348] Support autograd MLP Example
+      * [SINGA-345] Update Jenkins and fix bugs in compliation
+      * [SINGA-354] Update travis scripts to use conda-build for all platforms
+      * [SINGA-358] Consolidated RUN steps and cleaned caches in Docker containers
+      * [SINGA-359] Create alias for conda packages
+
+  * Documentation and usability
+      * [SINGA-223] Fix side navigation menu in the website
+      * [SINGA-294] Add instructions to run CUDA unit tests on Windows
+      * [SINGA-305] Add jupyter notebooks for SINGA V1 tutorial
+      * [SINGA-319] Fix link errors on the index page
+      * [SINGA-352] Complete SINGA documentation in Chinese version
+      * [SINGA-361] Add git instructions for contributors and committers
+
+  * Bugs fixed
+      * [SINGA-330] fix openblas building on i7 7700k
+      * [SINGA-331] Fix the bug of tensor division operation
+      * [SINGA-350] Error from python3 test
+      * [SINGA-356] Error using travis tool to build SINGA on mac os
+      * [SINGA-363] Fix some bugs in imagenet examples
+      * [SINGA-368] Fix the bug in Cifar10 examples
+      * [SINGA-369] the errors of examples in testing
+
+---------------------------------------------------------------
 Release Notes - SINGA - Version singa-incubating-1.1.0
 
 SINGA is a general distributed deep learning platform for training big deep learning models over large datasets.
diff --git a/doc/en/releases/RELEASE_NOTES_2.0.0.md b/doc/en/releases/RELEASE_NOTES_2.0.0.md
new file mode 100644
index 0000000..3a9159c
--- /dev/null
+++ b/doc/en/releases/RELEASE_NOTES_2.0.0.md
@@ -0,0 +1,45 @@
+# singa-incubating-2.0.0 Release Notes
+
+---
+
+SINGA is a general distributed deep learning platform for training big deep
+learning models over large datasets.
+
+This release includes following features:
+
+  * Core components
+    * [SINGA-434] Support tensor broadcasting
+    * [SINGA-370] Improvement to tensor reshape and various misc. changes related to SINGA-341 and 351
+
+  * Model components
+    * [SINGA-333] Add support for Open Neural Network Exchange (ONNX) format
+    * [SINGA-385] Add new python module for optimizers
+    * [SINGA-394] Improve the CPP operations via Intel MKL DNN lib
+    * [SINGA-425] Add 3 operators , Abs(), Exp() and leakyrelu(), for Autograd 
+    * [SINGA-410] Add two function, set_params() and get_params(), for Autograd Layer class
+    * [SINGA-383] Add Separable Convolution for autograd
+    * [SINGA-388] Develop some RNN layers by calling tiny operations like matmul, addbias.
+    * [SINGA-382] Implement concat operation for autograd    
+    * [SINGA-378] Implement maxpooling operation and its related functions for autograd
+    * [SINGA-379] Implement batchnorm operation and its related functions for autograd
+
+  * Utility functions and CI
+    * [SINGA-432] Update depdent lib versions in conda-build config
+    * [SINGA-429] Update docker images for latest cuda and cudnn
+    * [SINGA-428] Move Docker images under Apache user name
+
+  * Documentation and usability
+    * [SINGA-395] Add documentation for autograd APIs
+    * [SINGA-344] Add a GAN example
+    * [SINGA-390] Update installation.md
+    * [SINGA-384] Implement ResNet using autograd API
+    * [SINGA-352] Complete SINGA documentation in Chinese version
+      
+
+  * Bugs fixed
+    * [SINGA-431] Unit Test failed - Tensor Transpose
+    * [SINGA-422] ModuleNotFoundError: No module named "_singa_wrap"
+    * [SINGA-418] Unsupportive type 'long' in python3.  
+    * [SINGA-409] Basic `singa-cpu` import throws error
+    * [SINGA-408] Unsupportive function definition in python3
+    * [SINGA-380] Fix bugs from Reshape