The Apache Flink community released the next bugfix version of the Apache Flink 1.1 series.
This release includes major robustness improvements for checkpoint cleanup on failures and consumption of intermediate streams. We highly recommend all users to upgrade to Flink 1.1.4.
<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.1.4</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.10</artifactId> <version>1.1.4</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.10</artifactId> <version>1.1.4</version> </dependency>
You can find the binaries on the updated Downloads page.
We updated Flink‘s RocksDB dependency version from 4.5.1 to 4.11.2. Between these versions some of RocksDB’s internal configuration defaults changed that would affect the memory footprint of running Flink with RocksDB. Therefore, we manually reset them to the previous defaults. If you want to run with the new Rocks 4.11.2 defaults, you can do this via:
RocksDBStateBackend backend = new RocksDBStateBackend("..."); // Use the new default options. Otherwise, the default for RocksDB 4.5.1 // `PredefinedOptions.DEFAULT_ROCKS_4_5_1` will be used. backend.setPredefinedOptions(PredefinedOptions.DEFAULT);