Google Git
Sign in
apache / mxnet / refs/heads/v1.6.x
commitc76593162c2a5e421243dd09a8c3cde044efaa3f[log] [tgz]
authorChaitanya Prakash Bapat <chai.bapat@gmail.com>Thu Jul 23 12:17:39 2020 -0700
committerGitHub <noreply@github.com>Thu Jul 23 12:17:39 2020 -0700
treee1c723f492d1e136f4235f0bbccacf9f60c10a21
parente503704bb13bd1873572cf081a7566416f72b7b8 [diff]
[v1.6.x][Bug Fixed] Fix batch norm when grad_req is `add` (#18518) (#18714)

* [Bug Fixed] Fix batch norm when grad_req is `add` (#18500)

* fix batch norm when fix_gamma is True

* support gradient accumulation for batch norm

* mkldnn batchnorm support grad add

* unittest for bn

* fix bn arg

* fix lint

* fix mkldnn

* fix mkldnn bn

* fix grad when fixing gamma

* fix naive gpu bn

* fix lint

* fix cudnn bn

* fix flag

* fix lint

* fix testcase

* fix

* use @pytest.mark.parametrize

* combination

* remove redundant test in batchnorm

* npx.batch_norm test

* try to fix test

* reduce the number of tests for batchnorm

* fix

* Revert "[Bug Fixed] Fix batch norm when grad_req is `add` (#18500)"

This reverts commit 8e32cd6959461290c1698e02466fcc16f61ad237.

* [v1.x] backport #18500 - [Bug Fixed] Fix batch norm when grad_req is `add` (#18518)

* Fix batch norm when grad_req is

* fix

* remove softmax test

* fix

* add copy_size

* Fix init method for TestBatchNorm

Co-authored-by: JackieWu <wkcn@live.cn>
7 files changed
tree: e1c723f492d1e136f4235f0bbccacf9f60c10a21
  1. .github/
  2. 3rdparty/
  3. amalgamation/
  4. benchmark/
  5. cd/
  6. ci/
  7. cmake/
  8. contrib/
  9. cpp-package/
  10. docker/
  11. docs/
  12. example/
  13. include/
  14. julia/
  15. make/
  16. matlab/
  17. perl-package/
  18. plugin/
  19. python/
  20. R-package/
  21. scala-package/
  22. setup-utils/
  23. src/
  24. tests/
  25. tools/
  26. .clang-tidy
  27. .codecov.yml
  28. .gitattributes
  29. .gitignore
  30. .gitmodules
  31. .mxnet_root
  32. .travis.yml
  33. appveyor.yml
  34. CMakeLists.txt
  35. CODE_OF_CONDUCT.md
  36. CODEOWNERS
  37. CONTRIBUTORS.md
  38. dev_menu.py
  39. DISCLAIMER-WIP
  40. KEYS
  41. LICENSE
  42. Makefile
  43. mkldnn.mk
  44. MKLDNN_README.md
  45. NEWS.md
  46. NOTICE
  47. README.md
  48. readthedocs.yml
  49. SECURITY.md
  50. snap.python
  51. snapcraft.yaml
README.md

Apache MXNet (incubating) for Deep Learning

MasterDocsLicense
CentOS CPU Build Status CentOS GPU Build Status Clang Build Status
Edge Build Status Miscellaneous Build Status Sanity Build Status
Unix CPU Build Status Unix GPU Build Status Website Build Status
Windows CPU Build Status Windows GPU Build Status		Documentation StatusGitHub license

banner

Apache MXNet (incubating) is a deep learning framework designed for both efficiency and flexibility. It allows you to mix symbolic and imperative programming to maximize efficiency and productivity. At its core, MXNet contains a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations on the fly. A graph optimization layer on top of that makes symbolic execution fast and memory efficient. MXNet is portable and lightweight, scaling effectively to multiple GPUs and multiple machines.

MXNet is more than a deep learning project. It is a collection of blue prints and guidelines for building deep learning systems, and interesting insights of DL systems for hackers.

Ask Questions

How to Contribute

What's New

Contents

Features

  • Design notes providing useful insights that can re-used by other DL projects
  • Flexible configuration for arbitrary computation graph
  • Mix and match imperative and symbolic programming to maximize flexibility and efficiency
  • Lightweight, memory efficient and portable to smart devices
  • Scales up to multi GPUs and distributed setting with auto parallelism
  • Support for Python, Scala, C++, Java, Clojure, R, Go, Javascript, Perl, Matlab, and Julia
  • Cloud-friendly and directly compatible with AWS S3, AWS Deep Learning AMI, AWS SageMaker, HDFS, and Azure

License

Licensed under an Apache-2.0 license.

Reference Paper

Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. In Neural Information Processing Systems, Workshop on Machine Learning Systems, 2015

History

MXNet emerged from a collaboration by the authors of cxxnet, minerva, and purine2. The project reflects what we have learned from the past projects. MXNet combines aspects of each of these projects to achieve flexibility, speed, and memory efficiency.