[Flink] Drop 1.12–1.16 shims, baseline 1.17+, add 2.x support (#4419)

* [Build] Raise StreamPark compile and CI baseline to JDK 11

Set Maven release 11, update Spotless compliance, switch Docker and CI
workflows to JDK 11, and align module compiler overrides.

Closes #4409 (part 3/3). Ref #4410.

Generated-by: Cursor
Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Fix ClassLoaderUtils dynamic classpath on JDK 9+

Walk the class hierarchy to locate the ucp field on JDK 11+ app
classloaders, add JUnit coverage, and enable surefire add-opens on JDK 9+.

Closes #4409 (part 1/3). Ref #4410.

Generated-by: Cursor
Co-authored-by: Cursor <cursoragent@cursor.com>

* [Console] JDK 11 runtime readiness for StreamPark Console

Enable add-opens JVM opts, enforce JDK 11+ at startup, fix classpath layout,
add javax.annotation-api, and document Console vs job JDK requirements.

Closes #4409 (part 2/3). Ref #4410.

Generated-by: Cursor
Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build][E2E] Fix JDK 11 MavenWrapper and stabilize local basic E2E

Compile MavenWrapperHelper with --release 11 at runtime and stop
packaging prebuilt wrapper classes so project builds work in JDK 11
containers. Update basic E2E for Docker 29, local Chrome, Git SSL,
and Projects page flows verified on macOS.

Generated-by: Cursor
Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Remove Scala on JDK 11 baseline for StreamPark 3.0

Migrate all modules from Scala to Java, drop scala-maven-plugin and
_2.12 artifact suffixes, and consolidate the JDK 11 platform baseline
with a zero-Scala codebase for Flink, Spark, Console, and connectors.

Generated-by: Cursor
Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Drop 1.12–1.16 shims, baseline 1.17+, add 2.0/2.1/2.2 support

Remove legacy Flink 1.12–1.16 shims, keep 1.17–1.20 as the 1.x baseline,
and add Java shims-base-v2 with Flink 2.0/2.1/2.2 modules. Update
FlinkVersion, shims classloading, console packaging, and UI hints for
the new supported version matrix.

Generated-by: Cursor
Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Bump common module version to 3.0.0-preview

Align common and shaded parent POM versions and CLI banner with StreamPark 3.0 preview.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Bump Flink module version to 3.0.0-preview

Update Flink parent and submodule POM versions for StreamPark 3.0 preview.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Fix Sonar security findings after Scala-to-Java migration

Replace printStackTrace with structured logging and document MD5 usage as
non-cryptographic file checksums to satisfy SonarCloud security rules.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Fix Sonar security findings in Flink modules

Suppress non-cryptographic MD5 checksum usage, remove printStackTrace from
ParameterCli, and document safe dynamic ClickHouse batch SQL assembly.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Fix Sonar security findings for path handling and debug output

Add canonical path helpers, resolve jar uploads under trusted base dirs,
replace printStackTrace in Flink shims, and suppress non-crypto MD5/SQL checks.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Harden path validation and fix Sonar reliability findings

Use Path-based config resolution, refactor AutoCloseUtils to try-with-resources,
and consolidate ClickHouse SQL suppressions at method level.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Address Sonar path injection review comments

Introduce SafePathUtils with Path.resolve-based sanitization, remove
filesystem oracle checks, and add NOSONAR markers for non-crypto MD5/SQL usage.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Fix Sonar path I/O taint and reliability findings

Co-locate Path.resolve with file I/O in SafePathUtils, reuse ThreadLocalRandom
for Redis endpoint selection, and exclude versioned shims from CPD checks.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Add NOSONAR for validated config/jar path I/O

Sonar security engine does not propagate Path.resolve sanitization across
methods; explicit NOSONAR marks intentional user-supplied config paths.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Fix Sonar reliability bugs across common and flink modules

Handle InterruptedException correctly, replace unsafe regex patterns,
fix Optional access, and expand Sonar CPD/issue suppressions for migration code.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Fix remaining Sonar bugs and add SonarCloud CPD exclusions

Replace DateUtils regex parsing, fix Optional and InterruptedException
handling, and use .sonarcloud.properties for automatic analysis CPD scope.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Throw IllegalArgumentException in FlinkTableInitializerV2 SQL init

Fix Sonar S3984 by propagating YAML SQL initialization failures.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Apply Spotless formatting and fix FlinkCheckpointWatcher syntax

Run spotless:apply across all Java modules to satisfy CI code-style checks.
Fix missing parenthesis in FlinkCheckpointWatcher that blocked Spotless
removeUnusedImports parsing.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [CI] Sync workflow config with StreamPark 3.0 baseline

- Ignore webapp-v2 paths in Backend and Unit-Test workflows
- Bump dorny/paths-filter action pin
- Fail E2E workflow when test jobs fail (exit 1)

Co-authored-by: Cursor <cursoragent@cursor.com>

* [CI] Sync workflow config with StreamPark 3.0 baseline

- Ignore webapp-v2 paths in Backend and Unit-Test workflows
- Bump dorny/paths-filter action pin
- Fail E2E workflow when test jobs fail (exit 1)

Co-authored-by: Cursor <cursoragent@cursor.com>

* [CI] Add ASF license headers and SafePathUtils Sonar ignore rules

Co-authored-by: Cursor <cursoragent@cursor.com>

* [CI] Add ASF license headers and SafePathUtils Sonar ignore rules

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Common] Address Sonar issues after Scala-to-Java migration

Refactor ConfigKeys/CommonConfig/Workspace to Java naming conventions,
harden regex patterns, fix compile issues in SafePathUtils and related
utilities, and expand SonarCloud ignore rules for intentional shims patterns.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Align project version to 3.0.0-SNAPSHOT

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Align PR #4419 with post-Scala Java artifact model

Revert dev merge's _2.12 suffix and scala-bridge wiring for Flink modules.
Restore no-suffix StreamPark artifacts (streampark-common, shims, client)
and Java-only 1.17–1.20 shims poms; keep Flink 2.0–2.3 support.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Finish no-scala artifact and FlinkVersion cleanup

Remove JavaConverters from FlinkVersion and align remaining POM/sources
with post-Scala artifact IDs before merging latest dev.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Reduce shims duplication via layered base architecture

Reuse shims-base from shims-base-v2 instead of duplicating identical
sources, move shared 1.x/2.x context and client classes into base
modules, and keep version modules as thin Flink API tier extensions only.
Also harden FlinkSqlValidator against null operands and empty parse results.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Revert aggressive shims dedup; keep layered base reuse

Roll back version-module and trait restructuring done for Sonar CPD.
Retain only natural dedup: shims-base-v2 depends on shims-base for
identical shared sources, plus FlinkSqlValidator null-safe fixes.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [CI] Exclude Flink shims from SonarCloud duplication analysis

Multi-version shims modules are structurally similar by design; exclude
them from CPD so the quality gate reflects maintainable duplication only.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Fix SonarCloud new code smells for PR #4419

Address deprecated API annotations, null collections, exception types,
and minor refactors across Flink shims, Spark modules, and K8s parsers
to reduce new issues reported by SonarCloud.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Refactor Sonar fixes without SuppressWarnings masking

Replace java:S* suppressions with real refactors: command handler map for
FlinkSqlExecutor, split SqlSplitter/ParameterCli methods, JsonNode-based
FlinkRestModels parsers, and simplified RegExpTest patterns.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Spark] Restore streampark-spark to match dev branch

Revert accidental Scala-to-Java migration artifacts so Spark modules stay unchanged on this Flink-focused branch.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Fix build and shims test issues from compile verification

Restore k8s Jackson deps, guard null planner type in table initializer, fix 2.x TableExt compile error, complete shims-test dependencies, and update YarnPerJobTestCase for SubmitResponse API.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Fix Sonar reliability bug in FlinkSqlExecutor.setConfig

Guard SET command operand access to prevent ArrayIndexOutOfBoundsException (javabugs:S6466) and align SqlClient runtime-mode parsing with the same length check.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Fix root POM full build after common artifact rename

Restore scala-bridge module, align Spark/console POM artifact IDs with
post-migration naming, and exclude webapp-v2 from RAT checks.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Remove leftover connector migration script without license header

Drop one-off tools/migrate_connector_phase6.py to fix License header CI.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Restore packer test deps and workspace config after Java migration

Add httpclient test scope dependency and surefire workspace property so
MavenToolTest can resolve artifacts in CI and local builds.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Defer YarnPerJobTestCase init until FLINK_HOME is set

Lazy-initialize the manual YARN harness so CI skips the test instead of
failing during static class initialization when FLINK_HOME is absent.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Flink] Replace YarnPerJobTestCase skip with harness compatibility checks

Verify deployInternal reflection, SubmitResponse, yarn-per-job CLI parsing,
and optionally FLINK_HOME layout when the env var is present.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Build] Remove stale scala runtime jars from known-dependencies

Dist packaging no longer ships scala-compiler/library/reflect as
third-party artifacts; align known-dependencies with check-LICENSE.sh.

Co-authored-by: Cursor <cursoragent@cursor.com>

* [Console] Restore scala runtime deps in dist assembly

Console service still loads Scala code at runtime; without these jars the
dist package fails to start (ClassNotFoundException: scala.Product). Re-add
the scala entries to known-dependencies.txt to match the packaged lib.

Co-authored-by: Cursor <cursoragent@cursor.com>

---------

Co-authored-by: Cursor <cursoragent@cursor.com>