Click below contents if you want to understand more.
Apache Submarine Community Guide
Here're some examples about Submarine usage.
Running Distributed CIFAR 10 Tensorflow Job_With_Yarn_Service_Runtime
Running Standalone CIFAR 10 PyTorch Job_With_Yarn_Service_Runtime
Running Distributed thchs30 Kaldi Job
Submarine Project Development Guide
Submarine Project Database Guide
How to write Dockerfile for Submarine TensorFlow jobs
How to write Dockerfile for Submarine PyTorch jobs
How to write Dockerfile for Submarine MXNet jobs
How to write Dockerfile for Submarine Kaldi jobs
Note: You need to install dependencies when using Hadoop YARN 3.1.x + or above.
Submarine project may use YARN Service (When Submarine YARN service runtime is being used, see QuickStart, Docker container, and GPU (when GPU hardware available and properly configured).
That means as an admin you may have to properly setup YARN Service related dependencies, including:
Docker related dependencies, including:
And when GPU plans to be used:
For your convenience, we provide installation documents to help you to set up your environment. You can always choose to have them installed in your own way.
Use Submarine installer to install dependencies: EN CN
Alternatively, you can follow manual install dependencies: EN CN
Once you have installed dependencies, please follow following guide to TestAndTroubleshooting.