Java2.0 proto (#20461)

* ADD: first commit

* ADD: load local libraries

* UPDATE: use header files of MXNet 2.0

* ADD: load binaries from environment variable, java properties or jar files.

* ADD: add symbol loading and closing
add module integration

* ADD: [WIP] Component MxNDArray

* ADD: [WIP] Component MxNDArray

* ADD: Component MxNDArray. Pass static compilation check

* ADD: Component CachedOp

* REMOVE: module api which is no use

* FIX: dependency missing

* ADD: [WIP] add test cases for NdArray and CachedOp

* ADD: [WIP] add test cases for NdArray and CachedOp

* ADD: implement of the forward function for MxSymbolblock

* ADD: implement of the forward function for MxSymbolblock

* ADD: Sample model downloader for MLP

* ADD: doc

* ADD: Front-end module for inference, class MxModel, Predictor and so on.

* FIX: Mxnet crash when process exits.

* FIX: remove and initialize 3rdparty directory

* FIX: revert version of submodules: dlpack, dmlc-core, googletest, ps-lite

* Revert "FIX: remove and initialize 3rdparty directory"

This reverts commit d097675e

* FIX: redownload files in 3rdparty

* FIX: reset --hard the version of a few submodules

* FIX: reset --hard the version of a few submodules

* FIX: reset --hard the version of a few submodules

* PERF: [WIP] optimize code structure and memory management and

* ADD: add copyright; remove Mx prefix for some classes

* ADD: add copyright

* FIX: group name, path to find header files

* UPDATE: README.md

* ADD: copyright

* ADD: copyright

* ADD: package-info

ADD: ci

ADD: ci

ADD: make modification to trigger ci

ADD: ci

ADD: ci

ADD: ci

ADD: ci

ADD: gradlew

ADD: java_package_ci

ADD: java_package_ci

ADD: java_package_ci

ADD: java_package_ci

ADD: java_package_ci

ADD: java_package_ci

ADD: java_package_ci

ADD: java_package_ci

ADD: java_package_ci

FIX: build failure

* FIX: ci config file

* UPDATE: remove ParameterStore and some scripts

UPDATE: remove Initializer.java

* UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

FIX: issues in Resource close methods

FIX: issues in Resource close methods

FIX: issues in Resource close methods

UPDATE: remove scripts for dev

* FIX: loading on Linux platform

* # This is a combination of 18 commits.
# This is the 1st commit message:

FIX: loading on Linux platform

# This is the commit message #2:

UPDATE: ci for java-package

# This is the commit message #3:

UPDATE: ci for java-package

# This is the commit message #4:

UPDATE: ci for java-package

# This is the commit message #5:

UPDATE: ci for java-package

# This is the commit message #6:

UPDATE: ci for java-package

# This is the commit message #7:

UPDATE: ci for java-package

# This is the commit message #8:

UPDATE: ci for java-package

# This is the commit message #9:

UPDATE: ci for java-package

# This is the commit message #10:

UPDATE: ci for java-package

# This is the commit message #11:

UPDATE: ci for java-package

# This is the commit message #12:

UPDATE: ci for java-package

# This is the commit message #13:

UPDATE: ci for java-package

# This is the commit message #14:

UPDATE: ci for java-package

# This is the commit message #15:

UPDATE: ci for java-package

# This is the commit message #16:

UPDATE: ci for java-package

# This is the commit message #17:

UPDATE: ci for java-package

# This is the commit message #18:

UPDATE: ci for java-package

* # This is a combination of 27 commits.
parent 1ea18edce197b402cbfbaaaa54a94347501d92ab
author cspchen <cspchen@amazon.com> 1629186478 +0800
committer cspchen <cspchen@amazon.com> 1629186485 +0800

# This is a combination of 21 commits.
# This is the 1st commit message:

FIX: loading on Linux platform

# This is the commit message #2:

UPDATE: ci for java-package

# This is the commit message #3:

UPDATE: ci for java-package

# This is the commit message #4:

UPDATE: ci for java-package

# This is the commit message #5:

UPDATE: ci for java-package

# This is the commit message #6:

UPDATE: ci for java-package

# This is the commit message #7:

UPDATE: ci for java-package

# This is the commit message #8:

UPDATE: ci for java-package

# This is the commit message #9:

UPDATE: ci for java-package

# This is the commit message #10:

UPDATE: ci for java-package

# This is the commit message #11:

UPDATE: ci for java-package

# This is the commit message #12:

UPDATE: ci for java-package

# This is the commit message #13:

UPDATE: ci for java-package

# This is the commit message #14:

UPDATE: ci for java-package

# This is the commit message #15:

UPDATE: ci for java-package

# This is the commit message #16:

UPDATE: ci for java-package

# This is the commit message #17:

UPDATE: ci for java-package

# This is the commit message #18:

UPDATE: ci for java-package

# This is the commit message #19:

UPDATE: ci for java-package

# This is the commit message #20:

UPDATE: ci for java-package

# This is the commit message #21:

UPDATE: ci for java-package

# This is the commit message #22:

UPDATE: ci for java-package

# This is the commit message #23:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #24:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #25:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #26:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #27:

UPDATE: jenkins ci scripts for java-package

* MERGE: resolve conflicts

* MERGE: resolve conflicts

* # This is a combination of 35 commits.
parent 1ea18edce197b402cbfbaaaa54a94347501d92ab
author cspchen <cspchen@amazon.com> 1629186478 +0800
committer cspchen <cspchen@amazon.com> 1629186485 +0800

# This is a combination of 21 commits.
# This is the 1st commit message:

FIX: loading on Linux platform

# This is the commit message #2:

UPDATE: ci for java-package

# This is the commit message #3:

UPDATE: ci for java-package

# This is the commit message #4:

UPDATE: ci for java-package

# This is the commit message #5:

UPDATE: ci for java-package

# This is the commit message #6:

UPDATE: ci for java-package

# This is the commit message #7:

UPDATE: ci for java-package

# This is the commit message #8:

UPDATE: ci for java-package

# This is the commit message #9:

UPDATE: ci for java-package

# This is the commit message #10:

UPDATE: ci for java-package

# This is the commit message #11:

UPDATE: ci for java-package

# This is the commit message #12:

UPDATE: ci for java-package

# This is the commit message #13:

UPDATE: ci for java-package

# This is the commit message #14:

UPDATE: ci for java-package

# This is the commit message #15:

UPDATE: ci for java-package

# This is the commit message #16:

UPDATE: ci for java-package

# This is the commit message #17:

UPDATE: ci for java-package

# This is the commit message #18:

UPDATE: ci for java-package

# This is the commit message #19:

UPDATE: ci for java-package

# This is the commit message #20:

UPDATE: ci for java-package

# This is the commit message #21:

UPDATE: ci for java-package

# This is the commit message #22:

UPDATE: ci for java-package

# This is the commit message #23:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #24:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #25:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #26:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #27:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #28:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #30:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #31:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #32:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #33:

UPDATE: jenkins ci scripts for java-package

# This is the commit message #34:

FIX: issues in Resource close methods

# This is the commit message #35:

FIX: issues in Resource close methods

* parent 1ea18edce197b402cbfbaaaa54a94347501d92ab
author cspchen <cspchen@amazon.com> 1629186478 +0800
committer cspchen <cspchen@amazon.com> 1629186485 +0800

FIX: loading on Linux platform

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: ci for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

UPDATE: jenkins ci scripts for java-package

FIX: issues in Resource close methods

FIX: issues in Resource close methods

FIX: issues in Resource close methods

DOC: add doc

STYLE: change code style for pmd check

FIX: avoid the register for a signal handler twice

STYLE: pass pmd check

UPDATE: remove unused scripts

* FIX: solve problems before merge

* UPDATE: remove useless files

* FIX: licence to apache

* FIX: sanity check

* FIX: sanity check

* FIX: sanity check

* FIX: remove unused files

* FIX: remove unused files

* DOC: add document

* FIX: doesn't work on osx

* FIX: clang static check

* FIX: sanity

* FIX: skip signal handler registration when building java package

* FIX: remove DataType String

* FIX: add license

Co-authored-by: cspchen <cspchen@amazon.com>
128 files changed
tree: 0162aa61e56f30fa8402cfddb3de3cd9bbe783d2
  1. .github/
  2. 3rdparty/
  3. benchmark/
  4. cd/
  5. ci/
  6. cmake/
  7. config/
  8. contrib/
  9. cpp-package/
  10. docker/
  11. docs/
  12. example/
  13. include/
  14. java-package/
  15. licenses/
  16. plugin/
  17. python/
  18. src/
  19. tests/
  20. tools/
  21. .asf.yaml
  22. .clang-tidy
  23. .codecov.yml
  24. .gitattributes
  25. .gitignore
  26. .gitmodules
  27. .mxnet_root
  28. CMakeLists.txt
  29. CODE_OF_CONDUCT.md
  30. CODEOWNERS
  31. conftest.py
  32. CONTRIBUTORS.md
  33. DISCLAIMER
  34. doap.rdf
  35. KEYS
  36. LICENSE
  37. MKLDNN_README.md
  38. NEWS.md
  39. NOTICE
  40. pytest.ini
  41. rat-excludes
  42. README.md
  43. readthedocs.yml
  44. SECURITY.md
  45. snap.python
README.md

banner

Apache MXNet (incubating) for Deep Learning

GitHub release (latest SemVer) GitHub stars GitHub forks GitHub contributors GitHub issues good first issue GitHub pull requests by-label GitHub license Twitter Twitter Follow

Apache MXNet is a deep learning framework designed for both efficiency and flexibility. It allows you to mix symbolic and imperative programming to maximize efficiency and productivity. At its core, MXNet contains a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations on the fly. A graph optimization layer on top of that makes symbolic execution fast and memory efficient. MXNet is portable and lightweight, scalable to many GPUs and machines.

MXNet is more than a deep learning project. It is a community on a mission of democratizing AI. It is a collection of blue prints and guidelines for building deep learning systems, and interesting insights of DL systems for hackers.

Licensed under an Apache-2.0 license.

BranchBuild Status
masterCentOS CPU Build Status CentOS GPU Build Status Clang Build Status
Edge Build Status Miscellaneous Build Status Sanity Build Status
Unix CPU Build Status Unix GPU Build Status Website Build Status
Windows CPU Build Status Windows GPU Build Status Documentation Status
v1.xCentOS CPU Build Status CentOS GPU Build Status Clang Build Status
Edge Build Status Miscellaneous Build Status Sanity Build Status
Unix CPU Build Status Unix GPU Build Status Website Build Status
Windows CPU Build Status Windows GPU Build Status Documentation Status

Features

  • NumPy-like programming interface, and is integrated with the new, easy-to-use Gluon 2.0 interface. NumPy users can easily adopt MXNet and start in deep learning.
  • Automatic hybridization provides imperative programming with the performance of traditional symbolic programming.
  • Lightweight, memory-efficient, and portable to smart devices through native cross-compilation support on ARM, and through ecosystem projects such as TVM, TensorRT, OpenVINO.
  • Scales up to multi GPUs and distributed setting with auto parallelism through ps-lite, Horovod, and BytePS.
  • Extensible backend that supports full customization, allowing integration with custom accelerator libraries and in-house hardware without the need to maintain a fork.
  • Support for Python, Java, C++, R, Scala, Clojure, Go, Javascript, Perl, and Julia.
  • Cloud-friendly and directly compatible with AWS and Azure.

Contents

What's New

Ecosystem News

Stay Connected

ChannelPurpose
Follow MXNet Development on GithubSee what's going on in the MXNet project.
MXNet Confluence Wiki for Developers MXNet developer wiki for information related to project development, maintained by contributors and developers. To request write access, send an email to send request to the dev list .
dev@mxnet.apache.org mailing listThe “dev list”. Discussions about the development of MXNet. To subscribe, send an email to dev-subscribe@mxnet.apache.org .
discuss.mxnet.io Asking & answering MXNet usage questions.
Apache Slack #mxnet Channel Connect with MXNet and other Apache developers. To join the MXNet slack channel send request to the dev list .
Follow MXNet on Social MediaGet updates about new features and events.

Social Media

Keep connected with the latest MXNet news and updates.

History

MXNet emerged from a collaboration by the authors of cxxnet, minerva, and purine2. The project reflects what we have learned from the past projects. MXNet combines aspects of each of these projects to achieve flexibility, speed, and memory efficiency.

Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. In Neural Information Processing Systems, Workshop on Machine Learning Systems, 2015