tree: 44ed5a09079fb1f17c7e2fee0fbcd52724e6fead [path history] [tgz]
  1. base/
  2. master/
  3. worker/
  4. build
  5. README.md
docker/spark-test/README.md

Spark Docker files usable for testing and development purposes.

These images are intended to be run like so:

docker run -v $SPARK_HOME:/opt/spark spark-test-master
docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://<master_ip>:7077

Using this configuration, the containers will have their Spark directories mounted to your actual SPARK_HOME, allowing you to modify and recompile your Spark source and have them immediately usable in the docker images (without rebuilding them).