blob: d50c975adbfc5563929a764732c6d930fe3e51e4 [file] [log] [blame]
<table class="table table-bordered">
<thead>
<tr>
<th class="text-left" style="width: 20%">Key</th>
<th class="text-left" style="width: 15%">Default</th>
<th class="text-left" style="width: 10%">Type</th>
<th class="text-left" style="width: 55%">Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><h5>classloader.check-leaked-classloader</h5></td>
<td style="word-wrap: break-word;">true</td>
<td>Boolean</td>
<td>Fails attempts at loading classes if the user classloader of a job is used after it has terminated.
This is usually caused by the classloader being leaked by lingering threads or misbehaving libraries, which may also result in the classloader being used by other jobs.
This check should only be disabled if such a leak prevents further jobs from running.</td>
</tr>
<tr>
<td><h5>classloader.fail-on-metaspace-oom-error</h5></td>
<td style="word-wrap: break-word;">true</td>
<td>Boolean</td>
<td>Fail Flink JVM processes if 'OutOfMemoryError: Metaspace' is thrown while trying to load a user code class.</td>
</tr>
<tr>
<td><h5>classloader.parent-first-patterns.additional</h5></td>
<td style="word-wrap: break-word;">(none)</td>
<td>String</td>
<td>A (semicolon-separated) list of patterns that specifies which classes should always be resolved through the parent ClassLoader first. A pattern is a simple prefix that is checked against the fully qualified class name. These patterns are appended to "classloader.parent-first-patterns.default".</td>
</tr>
<tr>
<td><h5>classloader.parent-first-patterns.default</h5></td>
<td style="word-wrap: break-word;">"java.;<wbr>scala.;<wbr>org.apache.flink.;<wbr>com.esotericsoftware.kryo;<wbr>org.apache.hadoop.;<wbr>javax.annotation.;<wbr>org.slf4j;<wbr>org.apache.log4j;<wbr>org.apache.logging;<wbr>org.apache.commons.logging;<wbr>ch.qos.logback;<wbr>org.xml;<wbr>javax.xml;<wbr>org.apache.xerces;<wbr>org.w3c"</td>
<td>String</td>
<td>A (semicolon-separated) list of patterns that specifies which classes should always be resolved through the parent ClassLoader first. A pattern is a simple prefix that is checked against the fully qualified class name. This setting should generally not be modified. To add another pattern we recommend to use "classloader.parent-first-patterns.additional" instead.</td>
</tr>
<tr>
<td><h5>classloader.resolve-order</h5></td>
<td style="word-wrap: break-word;">"child-first"</td>
<td>String</td>
<td>Defines the class resolution strategy when loading classes from user code, meaning whether to first check the user code jar ("child-first") or the application classpath ("parent-first"). The default settings indicate to load classes first from the user code jar, which means that user code jars can include and load different dependencies than Flink uses (transitively).</td>
</tr>
<tr>
<td><h5>fs.allowed-fallback-filesystems</h5></td>
<td style="word-wrap: break-word;">(none)</td>
<td>String</td>
<td>A (semicolon-separated) list of file schemes, for which Hadoop can be used instead of an appropriate Flink plugin. (example: s3;wasb)</td>
</tr>
<tr>
<td><h5>fs.default-scheme</h5></td>
<td style="word-wrap: break-word;">(none)</td>
<td>String</td>
<td>The default filesystem scheme, used for paths that do not declare a scheme explicitly. May contain an authority, e.g. host:port in case of an HDFS NameNode.</td>
</tr>
<tr>
<td><h5>fs.output.always-create-directory</h5></td>
<td style="word-wrap: break-word;">false</td>
<td>Boolean</td>
<td>File writers running with a parallelism larger than one create a directory for the output file path and put the different result files (one per parallel writer task) into that directory. If this option is set to "true", writers with a parallelism of 1 will also create a directory and place a single result file into it. If the option is set to "false", the writer will directly create the file directly at the output path, without creating a containing directory.</td>
</tr>
<tr>
<td><h5>fs.overwrite-files</h5></td>
<td style="word-wrap: break-word;">false</td>
<td>Boolean</td>
<td>Specifies whether file output writers should overwrite existing files by default. Set to "true" to overwrite by default,"false" otherwise.</td>
</tr>
<tr>
<td><h5>io.tmp.dirs</h5></td>
<td style="word-wrap: break-word;">'LOCAL_DIRS' on Yarn. '_FLINK_TMP_DIR' on Mesos. System.getProperty("java.io.tmpdir") in standalone.</td>
<td>String</td>
<td>Directories for temporary files, separated by",", "|", or the system's java.io.File.pathSeparator.</td>
</tr>
<tr>
<td><h5>parallelism.default</h5></td>
<td style="word-wrap: break-word;">1</td>
<td>Integer</td>
<td>Default parallelism for jobs.</td>
</tr>
</tbody>
</table>