tree: c455a838971aff275eb73847aa35f5debeaa404d [path history] [tgz]
  1. assets/
  2. community/
  3. database/
  4. design/
  5. development/
  6. ecosystem/
  7. helper/
  8. submarine-sdk/
  9. submarine-security/
  10. submarine-server/
  11. workbench/
  12. README.md
docs/README.md

Docs index

Click below contents if you want to understand more.

Quick Start Guide

Quick Start Guide

Build From Code

Build From Code Guide

Apache Submarine Community

Apache Submarine Community Guide

Submarine Workbench

Submarine Workbench Guide

Submarine Server

Submarine Server Guide

Examples

Here're some examples about Submarine usage.

Running Distributed CIFAR 10 Tensorflow Job_With_Yarn_Service_Runtime

Running Standalone CIFAR 10 PyTorch Job_With_Yarn_Service_Runtime

Running Distributed thchs30 Kaldi Job

Development

Submarine Project Development Guide

Submarine Project Database Guide

Dockerfile

How to write Dockerfile for Submarine TensorFlow jobs

How to write Dockerfile for Submarine PyTorch jobs

How to write Dockerfile for Submarine MXNet jobs

How to write Dockerfile for Submarine Kaldi jobs

Install Dependencies

Note: You need to install dependencies when using Hadoop YARN 3.1.x + or above.

Submarine project may use YARN Service (When Submarine YARN service runtime is being used, see QuickStart, Docker container, and GPU (when GPU hardware available and properly configured).

That means as an admin you may have to properly setup YARN Service related dependencies, including:

  • YARN Registry DNS

Docker related dependencies, including:

  • Docker binary with expected versions.
  • Docker network which allows Docker container can talk to each other across different nodes.

And when GPU plans to be used:

  • GPU Driver.
  • Nvidia-docker.

For your convenience, we provide installation documents to help you to set up your environment. You can always choose to have them installed in your own way.

Use Submarine installer to install dependencies: EN CN

Alternatively, you can follow manual install dependencies: EN CN

Once you have installed dependencies, please follow following guide to TestAndTroubleshooting.