tree 1af888c16b8f714d49235e24f5c55aa6649ec4cb
parent 6bbf6b1eff2cffe8d116ebba0194fac233b42348
author Gengliang Wang <gengliang@apache.org> 1715134730 -0700
committer Dongjoon Hyun <dhyun@apple.com> 1715134730 -0700

[SPARK-48131][CORE][FOLLOWUP] Add a new configuration for the MDC key of Task Name

### What changes were proposed in this pull request?

Introduce a new Spark config `spark.log.legacyTaskNameMdc.enabled`:
When true, the MDC key `mdc.taskName` will be set in the logs, which is consistent with the behavior of Spark 3.1 to Spark 3.5 releases. When false, the logging framework will use `task_name` as the MDC key for consistency with other new MDC keys.

### Why are the changes needed?

As discussed in https://github.com/apache/spark/pull/46386#issuecomment-2098985001, we should add a configuration and migration guide about the change in the MDC key of Task Name.
### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

Manual test

### Was this patch authored or co-authored using generative AI tooling?

No

Closes #46446 from gengliangwang/addConfig.

Authored-by: Gengliang Wang <gengliang@apache.org>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>