You can start using MXNet on the cloud with MXNet pre-installed. Refer below for more details.
Here is a link to an AWS blog illustrating how to set up an Amazon Machine Image(AMI) that supports both MXNet and other popular deep learning frameworks.
Or you can use Bitfusion's MXNet AMI with a variety of deep learning and data science libraries and frameworks pre-installed, plus MXNet tutorial Jupyter notebook sample code.
To scale up on AWS GPU instances using a CloudFormation template, you can follow the instructions linked in the blog below.