tree: d9ddd20fffec6a3a721538ad0d109a89b806c956 [path history] [tgz]
  1. base/
  2. master/
  3. worker/
  4. build
  5. README.md
external/docker/spark-test/README.md

Spark Docker files usable for testing and development purposes.

These images are intended to be run like so:

docker run -v $SPARK_HOME:/opt/spark spark-test-master
docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://<master_ip>:7077

Using this configuration, the containers will have their Spark directories mounted to your actual SPARK_HOME, allowing you to modify and recompile your Spark source and have them immediately usable in the docker images (without rebuilding them).