tree: 14a1f244e35eb6db9daa0409e9b310eaae5b654c [path history] [tgz]
  1. base/
  2. master/
  3. worker/
  4. build
  5. README.md
external/docker/spark-test/README.md

Spark Docker files usable for testing and development purposes.

These images are intended to be run like so:

docker run -v $SPARK_HOME:/opt/spark spark-test-master
docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://<master_ip>:7077

Using this configuration, the containers will have their Spark directories mounted to your actual SPARK_HOME, allowing you to modify and recompile your Spark source and have them immediately usable in the docker images (without rebuilding them).