[FLINK-28060][Connector/Kafka] Updated Kafka Clients to 3.1.1 to resolve the issue where Flink is unable to commit its offset back to Kafka in case of Kafka Broker becoming unavailable. This should be resolved when the broker comes back up, but due to KAFKA-13563 that doesn't work. Since that fix has only become available with Kafka Clients 3.1.1, this commit updates the Kafka Clients dependency from 2.8.4 to 3.1.1.
No interfaces needed to be adjusted.
It was necessary to change some of our Bash e2e tests since they still relied on the Zookeeper parameter which has been removed in this version.
The other necessary change was adjusting the KafkaConsumerTestBase class since the level of exception is changed in the new Kafka Clients so exception.getCause().getMessage() throws an NPE in the test case.
diff --git a/flink-formats-kafka/flink-avro-confluent-registry/pom.xml b/flink-formats-kafka/flink-avro-confluent-registry/pom.xml
index cd29ae1..7d160a5 100644
--- a/flink-formats-kafka/flink-avro-confluent-registry/pom.xml
+++ b/flink-formats-kafka/flink-avro-confluent-registry/pom.xml
@@ -32,7 +32,7 @@
<name>Flink : Formats : Avro confluent registry</name>
<properties>
- <kafka.version>2.8.1</kafka.version>
+ <kafka.version>3.1.1</kafka.version>
<confluent.version>6.2.2</confluent.version>
</properties>
