tree: 390a1f1539e90eea915eb53fcfdba186795a04ea [path history] [tgz]
  1. base/
  2. master/
  3. worker/
  4. build
  5. README.md
docker/spark-test/README.md

Spark Docker files usable for testing and development purposes.

These images are intended to be run like so:

docker run -v $SPARK_HOME:/opt/spark spark-test-master
docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://<master_ip>:7077

Using this configuration, the containers will have their Spark directories mounted to your actual SPARK_HOME, allowing you to modify and recompile your Spark source and have them immediately usable in the docker images (without rebuilding them).