Google Git
Sign in
apache / spark-docker

Official Dockerfile for Apache Spark

Mirrored from https://github.com/apache/spark-docker.git
Clone this repo:

Branches

  1. 4f2d96a [SPARK-47206][FOLLOWUP] Fix wrong path version by Yikun Jiang · 2 months ago master
  2. 7216374 [SPARK-47206] Add official image Dockerfile for Apache Spark 3.5.1 by Yikun Jiang · 2 months ago
  3. 431aa51 [SPARK-46209] Add java 11 only yml for version before 3.5 by Yikun Jiang · 5 months ago
  4. ec69b9c [SPARK-46185] Add official image Dockerfile for Apache Spark 3.4.2 by Yikun Jiang · 5 months ago
  5. 6f68fe0 Add support for java 17 from spark 3.5.0 by vakarisbk · 6 months ago

Apache Spark Official Dockerfiles

What is Apache Spark?

Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.

https://spark.apache.org/

About this repository

This repository contains the Dockerfiles used to build the Apache Spark Docker Image.

See more in SPARK-40513: SPIP: Support Docker Official Image for Spark.