[MXNET-593] Adding 2 tutorials on Learning Rate Schedules (#11296)

* Added two tutorials on learning rate schedules; basic and advanced.

* Correcting notebook skip line.

* Corrected cosine graph

* Changes based on @KellenSunderland feedback.
4 files changed
tree: f76b46c0566262441e545de178debdeed5453bab
  1. .github/
  2. 3rdparty/
  3. amalgamation/
  4. benchmark/
  5. ci/
  6. cmake/
  7. cpp-package/
  8. docker/
  9. docs/
  10. example/
  11. include/
  12. make/
  13. matlab/
  14. perl-package/
  15. plugin/
  16. python/
  17. R-package/
  18. scala-package/
  19. setup-utils/
  20. src/
  21. tests/
  22. tools/
  23. .codecov.yml
  24. .gitattributes
  25. .gitignore
  26. .gitmodules
  27. .mxnet_root
  28. .travis.yml
  29. appveyor.yml
  30. CMakeLists.txt
  31. CODEOWNERS
  32. CONTRIBUTORS.md
  33. DISCLAIMER
  34. Jenkinsfile
  35. KEYS
  36. LICENSE
  37. Makefile
  38. MKL_README.md
  39. NEWS.md
  40. NOTICE
  41. prepare_mkl.sh
  42. prepare_mkldnn.sh
  43. README.md
  44. readthedocs.yml
  45. snap.python
  46. snapcraft.yaml
README.md

Apache MXNet (incubating) for Deep Learning

MasterDocsLicense
Build StatusDocumentation StatusGitHub license

banner

Apache MXNet (incubating) is a deep learning framework designed for both efficiency and flexibility. It allows you to mix symbolic and imperative programming to maximize efficiency and productivity. At its core, MXNet contains a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations on the fly. A graph optimization layer on top of that makes symbolic execution fast and memory efficient. MXNet is portable and lightweight, scaling effectively to multiple GPUs and multiple machines.

MXNet is also more than a deep learning project. It is also a collection of blue prints and guidelines for building deep learning systems, and interesting insights of DL systems for hackers.

Join the chat at https://gitter.im/dmlc/mxnet

What's New

Contents

Features

  • Design notes providing useful insights that can re-used by other DL projects
  • Flexible configuration for arbitrary computation graph
  • Mix and match imperative and symbolic programming to maximize flexibility and efficiency
  • Lightweight, memory efficient and portable to smart devices
  • Scales up to multi GPUs and distributed setting with auto parallelism
  • Support for Python, R, Scala, C++ and Julia
  • Cloud-friendly and directly compatible with S3, HDFS, and Azure

Ask Questions

License

Licensed under an Apache-2.0 license.

Reference Paper

Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. In Neural Information Processing Systems, Workshop on Machine Learning Systems, 2015

History

MXNet emerged from a collaboration by the authors of cxxnet, minerva, and purine2. The project reflects what we have learned from the past projects. MXNet combines aspects of each of these projects to achieve flexibility, speed, and memory efficiency.