Examples inside this folder show how to train CNN models using SINGA for image classification.
It read the dataset from the filesystem defined by process_data.py
. Hence, users can modify process_data.py
for their perference of dataset format.
Before running the code, the model
folder in examples/cnn
should be copied to this directory.
train_largedata.py
is the training script, which controls the training flow by doing BackPropagation and SGD update.
train_mpi.py
is the script for distributed training (among multiple nodes) using MPI and NCCL for communication.