| commit | 906ae5138e772e4bd57fbb90a202c7f26679057a | [log] [tgz] |
|---|---|---|
| author | Steve Loughran <stevel@cloudera.com> | Mon Aug 15 11:18:47 2022 +0100 |
| committer | Steve Loughran <stevel@cloudera.com> | Mon Aug 15 11:20:59 2022 +0100 |
| tree | 92f4a0f9fb6c2de62a2664f21f59207ea9791b9d | |
| parent | eee59a83723febf18daab6916a1233858a96380d [diff] |
HADOOP-18402. S3A committer NPE in spark job abort (#4735) JobID.toString() and TaskID.toString() to only be called when the IDs are not null. This doesn't surface in MapReduce, but Spark SQL can trigger in job abort, where it may invok abortJob() with an incomplete TaskContext. This patch MUST be applied to branches containing HADOOP-17833. "Improve Magic Committer Performance." Contributed by Steve Loughran.