[SPARK-36358][K8S] Upgrade Kubernetes Client Version to 5.6.0
### What changes were proposed in this pull request?
Upgrade Kubernetes Client Version to 5.6.0.
### Why are the changes needed?
The exponential backoff feature is extended with one more case:
[ Retry HTTP operation in case IOException too (exponential backoff)](https://github.com/fabric8io/kubernetes-client/pull/3293)
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Tested with existing unit and integration tests:
```
KubernetesSuite:
- Run SparkPi with no resources
- Run SparkPi with a very long application name.
- Use SparkLauncher.NO_RESOURCE
- Run SparkPi with a master URL without a scheme.
- Run SparkPi with an argument.
- Run SparkPi with custom labels, annotations, and environment variables.
- All pods have the same service account by default
- Run extraJVMOptions check on driver
- Run SparkRemoteFileTest using a remote data file
- Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties
- Run SparkPi with env and mount secrets.
- Run PySpark on simple pi.py example
- Run PySpark to test a pyfiles example
- Run PySpark with memory customization
- Run in client mode.
- Start pod creation from template
- Launcher client dependencies
- SPARK-33615: Launcher client archives
- SPARK-33748: Launcher python client respecting PYSPARK_PYTHON
- SPARK-33748: Launcher python client respecting spark.pyspark.python and spark.pyspark.driver.python
- Launcher python client dependencies using a zip file
- Test basic decommissioning
- Test basic decommissioning with shuffle cleanup
- Test decommissioning with dynamic allocation & shuffle cleanups
- Test decommissioning timeouts
...
[INFO] BUILD SUCCESS
```
Closes #33593 from attilapiros/SPARK-36358.
Authored-by: attilapiros <piros.attila.zsolt@gmail.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
diff --git a/dev/deps/spark-deps-hadoop-2.7-hive-2.3 b/dev/deps/spark-deps-hadoop-2.7-hive-2.3
index 533b495..50b5bf0 100644
--- a/dev/deps/spark-deps-hadoop-2.7-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-2.7-hive-2.3
@@ -154,27 +154,27 @@
jta/1.1//jta-1.1.jar
jul-to-slf4j/1.7.30//jul-to-slf4j-1.7.30.jar
kryo-shaded/4.0.2//kryo-shaded-4.0.2.jar
-kubernetes-client/5.5.0//kubernetes-client-5.5.0.jar
-kubernetes-model-admissionregistration/5.5.0//kubernetes-model-admissionregistration-5.5.0.jar
-kubernetes-model-apiextensions/5.5.0//kubernetes-model-apiextensions-5.5.0.jar
-kubernetes-model-apps/5.5.0//kubernetes-model-apps-5.5.0.jar
-kubernetes-model-autoscaling/5.5.0//kubernetes-model-autoscaling-5.5.0.jar
-kubernetes-model-batch/5.5.0//kubernetes-model-batch-5.5.0.jar
-kubernetes-model-certificates/5.5.0//kubernetes-model-certificates-5.5.0.jar
-kubernetes-model-common/5.5.0//kubernetes-model-common-5.5.0.jar
-kubernetes-model-coordination/5.5.0//kubernetes-model-coordination-5.5.0.jar
-kubernetes-model-core/5.5.0//kubernetes-model-core-5.5.0.jar
-kubernetes-model-discovery/5.5.0//kubernetes-model-discovery-5.5.0.jar
-kubernetes-model-events/5.5.0//kubernetes-model-events-5.5.0.jar
-kubernetes-model-extensions/5.5.0//kubernetes-model-extensions-5.5.0.jar
-kubernetes-model-flowcontrol/5.5.0//kubernetes-model-flowcontrol-5.5.0.jar
-kubernetes-model-metrics/5.5.0//kubernetes-model-metrics-5.5.0.jar
-kubernetes-model-networking/5.5.0//kubernetes-model-networking-5.5.0.jar
-kubernetes-model-node/5.5.0//kubernetes-model-node-5.5.0.jar
-kubernetes-model-policy/5.5.0//kubernetes-model-policy-5.5.0.jar
-kubernetes-model-rbac/5.5.0//kubernetes-model-rbac-5.5.0.jar
-kubernetes-model-scheduling/5.5.0//kubernetes-model-scheduling-5.5.0.jar
-kubernetes-model-storageclass/5.5.0//kubernetes-model-storageclass-5.5.0.jar
+kubernetes-client/5.6.0//kubernetes-client-5.6.0.jar
+kubernetes-model-admissionregistration/5.6.0//kubernetes-model-admissionregistration-5.6.0.jar
+kubernetes-model-apiextensions/5.6.0//kubernetes-model-apiextensions-5.6.0.jar
+kubernetes-model-apps/5.6.0//kubernetes-model-apps-5.6.0.jar
+kubernetes-model-autoscaling/5.6.0//kubernetes-model-autoscaling-5.6.0.jar
+kubernetes-model-batch/5.6.0//kubernetes-model-batch-5.6.0.jar
+kubernetes-model-certificates/5.6.0//kubernetes-model-certificates-5.6.0.jar
+kubernetes-model-common/5.6.0//kubernetes-model-common-5.6.0.jar
+kubernetes-model-coordination/5.6.0//kubernetes-model-coordination-5.6.0.jar
+kubernetes-model-core/5.6.0//kubernetes-model-core-5.6.0.jar
+kubernetes-model-discovery/5.6.0//kubernetes-model-discovery-5.6.0.jar
+kubernetes-model-events/5.6.0//kubernetes-model-events-5.6.0.jar
+kubernetes-model-extensions/5.6.0//kubernetes-model-extensions-5.6.0.jar
+kubernetes-model-flowcontrol/5.6.0//kubernetes-model-flowcontrol-5.6.0.jar
+kubernetes-model-metrics/5.6.0//kubernetes-model-metrics-5.6.0.jar
+kubernetes-model-networking/5.6.0//kubernetes-model-networking-5.6.0.jar
+kubernetes-model-node/5.6.0//kubernetes-model-node-5.6.0.jar
+kubernetes-model-policy/5.6.0//kubernetes-model-policy-5.6.0.jar
+kubernetes-model-rbac/5.6.0//kubernetes-model-rbac-5.6.0.jar
+kubernetes-model-scheduling/5.6.0//kubernetes-model-scheduling-5.6.0.jar
+kubernetes-model-storageclass/5.6.0//kubernetes-model-storageclass-5.6.0.jar
lapack/2.2.0//lapack-2.2.0.jar
leveldbjni-all/1.8//leveldbjni-all-1.8.jar
libfb303/0.9.3//libfb303-0.9.3.jar
diff --git a/dev/deps/spark-deps-hadoop-3.2-hive-2.3 b/dev/deps/spark-deps-hadoop-3.2-hive-2.3
index c93f990..31c9b96 100644
--- a/dev/deps/spark-deps-hadoop-3.2-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3.2-hive-2.3
@@ -125,27 +125,27 @@
jta/1.1//jta-1.1.jar
jul-to-slf4j/1.7.30//jul-to-slf4j-1.7.30.jar
kryo-shaded/4.0.2//kryo-shaded-4.0.2.jar
-kubernetes-client/5.5.0//kubernetes-client-5.5.0.jar
-kubernetes-model-admissionregistration/5.5.0//kubernetes-model-admissionregistration-5.5.0.jar
-kubernetes-model-apiextensions/5.5.0//kubernetes-model-apiextensions-5.5.0.jar
-kubernetes-model-apps/5.5.0//kubernetes-model-apps-5.5.0.jar
-kubernetes-model-autoscaling/5.5.0//kubernetes-model-autoscaling-5.5.0.jar
-kubernetes-model-batch/5.5.0//kubernetes-model-batch-5.5.0.jar
-kubernetes-model-certificates/5.5.0//kubernetes-model-certificates-5.5.0.jar
-kubernetes-model-common/5.5.0//kubernetes-model-common-5.5.0.jar
-kubernetes-model-coordination/5.5.0//kubernetes-model-coordination-5.5.0.jar
-kubernetes-model-core/5.5.0//kubernetes-model-core-5.5.0.jar
-kubernetes-model-discovery/5.5.0//kubernetes-model-discovery-5.5.0.jar
-kubernetes-model-events/5.5.0//kubernetes-model-events-5.5.0.jar
-kubernetes-model-extensions/5.5.0//kubernetes-model-extensions-5.5.0.jar
-kubernetes-model-flowcontrol/5.5.0//kubernetes-model-flowcontrol-5.5.0.jar
-kubernetes-model-metrics/5.5.0//kubernetes-model-metrics-5.5.0.jar
-kubernetes-model-networking/5.5.0//kubernetes-model-networking-5.5.0.jar
-kubernetes-model-node/5.5.0//kubernetes-model-node-5.5.0.jar
-kubernetes-model-policy/5.5.0//kubernetes-model-policy-5.5.0.jar
-kubernetes-model-rbac/5.5.0//kubernetes-model-rbac-5.5.0.jar
-kubernetes-model-scheduling/5.5.0//kubernetes-model-scheduling-5.5.0.jar
-kubernetes-model-storageclass/5.5.0//kubernetes-model-storageclass-5.5.0.jar
+kubernetes-client/5.6.0//kubernetes-client-5.6.0.jar
+kubernetes-model-admissionregistration/5.6.0//kubernetes-model-admissionregistration-5.6.0.jar
+kubernetes-model-apiextensions/5.6.0//kubernetes-model-apiextensions-5.6.0.jar
+kubernetes-model-apps/5.6.0//kubernetes-model-apps-5.6.0.jar
+kubernetes-model-autoscaling/5.6.0//kubernetes-model-autoscaling-5.6.0.jar
+kubernetes-model-batch/5.6.0//kubernetes-model-batch-5.6.0.jar
+kubernetes-model-certificates/5.6.0//kubernetes-model-certificates-5.6.0.jar
+kubernetes-model-common/5.6.0//kubernetes-model-common-5.6.0.jar
+kubernetes-model-coordination/5.6.0//kubernetes-model-coordination-5.6.0.jar
+kubernetes-model-core/5.6.0//kubernetes-model-core-5.6.0.jar
+kubernetes-model-discovery/5.6.0//kubernetes-model-discovery-5.6.0.jar
+kubernetes-model-events/5.6.0//kubernetes-model-events-5.6.0.jar
+kubernetes-model-extensions/5.6.0//kubernetes-model-extensions-5.6.0.jar
+kubernetes-model-flowcontrol/5.6.0//kubernetes-model-flowcontrol-5.6.0.jar
+kubernetes-model-metrics/5.6.0//kubernetes-model-metrics-5.6.0.jar
+kubernetes-model-networking/5.6.0//kubernetes-model-networking-5.6.0.jar
+kubernetes-model-node/5.6.0//kubernetes-model-node-5.6.0.jar
+kubernetes-model-policy/5.6.0//kubernetes-model-policy-5.6.0.jar
+kubernetes-model-rbac/5.6.0//kubernetes-model-rbac-5.6.0.jar
+kubernetes-model-scheduling/5.6.0//kubernetes-model-scheduling-5.6.0.jar
+kubernetes-model-storageclass/5.6.0//kubernetes-model-storageclass-5.6.0.jar
lapack/2.2.0//lapack-2.2.0.jar
leveldbjni-all/1.8//leveldbjni-all-1.8.jar
libfb303/0.9.3//libfb303-0.9.3.jar
diff --git a/pom.xml b/pom.xml
index 95bf2e1..d17e055 100644
--- a/pom.xml
+++ b/pom.xml
@@ -203,7 +203,7 @@
<arrow.version>2.0.0</arrow.version>
<!-- org.fusesource.leveldbjni will be used except on arm64 platform. -->
<leveldbjni.group>org.fusesource.leveldbjni</leveldbjni.group>
- <kubernetes-client.version>5.5.0</kubernetes-client.version>
+ <kubernetes-client.version>5.6.0</kubernetes-client.version>
<test.java.home>${java.home}</test.java.home>
