| commit | 6f68fe0f7051c10f2bf43a50a7decfce2e97baf0 | [log] [tgz] |
|---|---|---|
| author | vakarisbk <vakaris.bashkirov@gmail.com> | Fri Nov 10 11:33:39 2023 +0800 |
| committer | Yikun Jiang <yikunkero@gmail.com> | Fri Nov 10 11:33:39 2023 +0800 |
| tree | caf2d3932bf2272b5b4b7f2235988b62070f5ca2 | |
| parent | 028efd4637fb2cf791d5bd9ea70b2fca472de4b7 [diff] |
Add support for java 17 from spark 3.5.0 ### What changes were proposed in this pull request? 1. Create Java17 base images alongside Java11 images starting from spark 3.5.0 2. Change ubuntu version to 22.04 for `scala2.12-java17-*` ### Why are the changes needed? Spark supports multiple Java versions, but the images are currently built only with Java 11. ### Does this PR introduce _any_ user-facing change? New images would be available in the repositories. ### How was this patch tested? Closes #56 from vakarisbk/master. Authored-by: vakarisbk <vakaris.bashkirov@gmail.com> Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.
This repository contains the Dockerfiles used to build the Apache Spark Docker Image.
See more in SPARK-40513: SPIP: Support Docker Official Image for Spark.