commit 183eb75e0d98c852b580cbd9666735fea71cb77d
author Bo Zhang <bo.zhang@databricks.com> Tue Apr 27 10:59:30 2021 +0900
committer hyukjinkwon <gurwls223@apache.org> Tue Apr 27 11:02:42 2021 +0900
tree 04880979f4ac9a3478bc70d25fb0a1c6e88a6395
parent 101c9e77ef694417ed2470826678e77b7b10b8c8

[SPARK-35227][BUILD] Update the resolver for spark-packages in SparkSubmit

This change is to use repos.spark-packages.org instead of Bintray as the repository service for spark-packages.

The change is needed because Bintray will no longer be available from May 1st.

This should be transparent for users who use SparkSubmit.

Tested running spark-shell with --packages manually.

Closes #32346 from bozhang2820/replace-bintray.

Authored-by: Bo Zhang <bo.zhang@databricks.com>
Signed-off-by: hyukjinkwon <gurwls223@apache.org>
(cherry picked from commit f738fe07b6fc85c880b64a1cc2f6c7cc1cc1379b)
Signed-off-by: hyukjinkwon <gurwls223@apache.org>

core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

diff --git a/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala b/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
index b5e4660..fb82e3b 100644
--- a/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
+++ b/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
@@ -1083,7 +1083,7 @@
     val sp: IBiblioResolver = new IBiblioResolver
     sp.setM2compatible(true)
     sp.setUsepoms(true)
-    sp.setRoot("https://dl.bintray.com/spark-packages/maven")
+    sp.setRoot("https://repos.spark-packages.org/")
     sp.setName("spark-packages")
     cr.add(sp)
     cr