Choose a Spark release:
Choose a package type:
Download Spark:
Verify this release using the and project release KEYS.
Note that, Spark 2.x is pre-built with Scala 2.11 except version 2.4.2, which is pre-built with Scala 2.12. Spark 3.0+ is pre-built with Scala 2.12.
Preview releases, as the name suggests, are releases for previewing upcoming features. Unlike nightly packages, preview releases have been audited by the project‘s management committee to satisfy the legal requirements of Apache Software Foundation’s release policy. Preview releases are not meant to be functional, i.e. they can and highly likely will contain critical bugs or documentation errors. The latest preview release is Spark 3.0.0-preview2, published on Dec 23, 2019.
Spark artifacts are hosted in Maven Central. You can add a Maven dependency with the following coordinates:
groupId: org.apache.spark artifactId: spark-core_2.12 version: 3.1.2
PySpark is now available in pypi. To install just run pip install pyspark.
As new Spark releases come out for each development stream, previous ones will be archived, but they are still available at Spark release archives.
NOTE: Previous releases of Spark may be affected by security issues. Please consult the Security page for a list of known issues that may affect the version you download before deciding to use it.