commit 979820ec522fdc654f7ce857df60fb4795b459e5
author rick <rick@rickdeMacBook-Pro.local> Fri Jul 23 15:17:48 2021 +0800
committer Philipp Dallig <philipp.dallig@gmail.com> Thu Sep 02 16:23:31 2021 +0200
tree 1a6cab9daf6247023770f3bc8e8a18eb9ac14697
parent 91f6cdfb1974966c4e25a773be2a999b4d6dea77

[ZEPPELIN-5466] Can not specify the spark image from the interpreter settings

### What is this PR for?
When Zeppelin launches a spark interpreter pod under k8s mode, it will build the **spark submit options** through [buildSparkSubmitOptions()](https://github.com/apache/zeppelin/blob/master/zeppelin-plugins/launcher/k8s-standard/src/main/java/org/apache/zeppelin/interpreter/launcher/K8sRemoteInterpreterProcess.java#L372-L393)

But the property `--conf spark.kubernetes.container.image=` will use the value from the `zConf.getK8sSparkContainerImage()`. Note that although the interpreter properties overrides the values through

```
// interpreter properties overrides the values
k8sProperties.putAll(Maps.fromProperties(properties));
```

But the spark submit options has already been built. So if user sets the `spark.kubernetes.container.image` from the interpreter settings, it will not correctly set the spark image in the `spark submit options`.

### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* <https://issues.apache.org/jira/browse/ZEPPELIN-5466>

### How should this be tested?
* CI pass and manually tested

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: rick <rick@rickdeMacBook-Pro.local>

Closes #4185 from rickchengx/ZEPPELIN-5466 and squashes the following commits:

9f270de35 [rick] [ZEPPELIN-5466] Can not specify the spark image from the interpreter settings