Submarine for YARN supports TensorFlow, PyTorch and MXNet framework. (Which is leveraging TonY created by Linkedin to run deep learning training jobs on YARN.
Submarine also supports GPU-on-YARN and Docker-on-YARN feature.
Submarine can run on Hadoop 2.7.3 or later version, if GPU-on-YARN or Docker-on-YARN feature is needed, newer Hadoop version is required, please refer to the next section about what Hadoop version to choose.
Must:
Optional:
YARN Runtime Guide talk about how to use Submarine to run jobs on YARN, with Docker / without Docker.