Merge pull request #1580 from linmx0130/master

add AdaGrad optimizer in python, a revised version
tree: 48b9279922399ceeb3244c4cfdf3d7ec92f5c282
  1. amalgamation/
  2. cmake/
  3. doc/
  4. example/
  5. include/
  6. make/
  7. matlab/
  8. plugin/
  9. python/
  10. R-package/
  11. scala-package/
  12. src/
  13. tests/
  14. tools/
  15. .gitignore
  16. .gitmodules
  17. .travis.yml
  18. appveyor.yml
  19. CHANGES.md
  20. CMakeLists.txt
  21. CONTRIBUTORS.md
  22. LICENSE
  23. Makefile
  24. README.md
README.md

for Deep Learning

Build Status Build Status Documentation Status GitHub license todofy badge

MXNet is a deep learning framework designed for both efficiency and flexibility. It allows you to mix the flavours of symbolic programming and imperative programming to maximize efficiency and productivity. In its core, a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations on the fly. A graph optimization layer on top of that makes symbolic execution fast and memory efficient. The library is portable and lightweight, and it scales to multiple GPUs and multiple machines.

MXNet is also more than a deep learning project. It is also a collection of blue prints and guidelines for building deep learning system, and interesting insights of DL systems for hackers.

Join the chat at https://gitter.im/dmlc/mxnet

What's New

Contents

Features

  • Design notes providing useful insights that can re-used by other DL projects
  • Flexible configuration for arbitrary computation graph
  • Mix and match good flavours of programming to maximize flexibility and efficiency
  • Lightweight, memory efficient and portable to smart devices
  • Scales up to multi GPUs and distributed setting with auto parallelism
  • Support for python, R, C++ and Julia
  • Cloud-friendly and directly compatible with S3, HDFS, and Azure

Ask Questions

License

© Contributors, 2015. Licensed under an Apache-2.0 license.

Reference Paper

Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. In Neural Information Processing Systems, Workshop on Machine Learning Systems, 2015

History

MXNet is initiated and designed in collaboration by the authors of cxxnet, minerva and purine2. The project reflects what we have learnt from the past projects. It combines important flavours of the existing projects for efficiency, flexibility and memory efficiency.