| commit | 7216374855ba57ce14c8ddbf56890538f678ec3d | [log] [tgz] |
|---|---|---|
| author | Yikun Jiang <yikunkero@gmail.com> | Thu Feb 29 08:55:47 2024 +0800 |
| committer | Yikun Jiang <yikunkero@gmail.com> | Thu Feb 29 08:55:47 2024 +0800 |
| tree | cec1e612a6f1c1c96320738bc96fea983865165c | |
| parent | 431aa516ba58985c902bf2d2a07bf0eaa1df6740 [diff] |
[SPARK-47206] Add official image Dockerfile for Apache Spark 3.5.1 ### What changes were proposed in this pull request? Add Apache Spark 3.5.1 Dockerfiles. - Add 3.5.1 GPG key - Add .github/workflows/build_3.5.1.yaml - `./add-dockerfiles.sh 3.5.1` to generate dockerfiles - Add version and tag info ### Why are the changes needed? Apache Spark 3.5.1 released ### Does this PR introduce _any_ user-facing change? Docker image will be published. ### How was this patch tested? Add workflow and CI passed Closes #59 from Yikun/3.5.1. Authored-by: Yikun Jiang <yikunkero@gmail.com> Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.
This repository contains the Dockerfiles used to build the Apache Spark Docker Image.
See more in SPARK-40513: SPIP: Support Docker Official Image for Spark.