| <!DOCTYPE html ><html><head><meta http-equiv="X-UA-Compatible" content="IE=edge"/><meta content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" name="viewport"/><title>Spark 4.0.0-preview2 ScalaDoc - org.apache.spark.SparkConf</title><meta content="Spark 4.0.0 - preview2 ScalaDoc - org.apache.spark.SparkConf" name="description"/><meta content="Spark 4.0.0 preview2 ScalaDoc org.apache.spark.SparkConf" name="keywords"/><meta http-equiv="content-type" content="text/html; charset=UTF-8"/><link href="../../../lib/index.css" media="screen" type="text/css" rel="stylesheet"/><link href="../../../lib/template.css" media="screen" type="text/css" rel="stylesheet"/><link href="../../../lib/print.css" media="print" type="text/css" rel="stylesheet"/><link href="../../../lib/diagrams.css" media="screen" type="text/css" rel="stylesheet" id="diagrams-css"/><script type="text/javascript" src="../../../lib/jquery.min.js"></script><script type="text/javascript" src="../../../lib/index.js"></script><script type="text/javascript" src="../../../index.js"></script><script type="text/javascript" src="../../../lib/scheduler.js"></script><script type="text/javascript" src="../../../lib/template.js"></script><script type="text/javascript">/* this variable can be used by the JS to determine the path to the root document */ |
| var toRoot = '../../../';</script></head><body><div id="search"><span id="doc-title">Spark 4.0.0-preview2 ScalaDoc<span id="doc-version"></span></span> <span class="close-results"><span class="left"><</span> Back</span><div id="textfilter"><span class="input"><input autocapitalize="none" placeholder="Search" id="index-input" type="text" accesskey="/"/><i class="clear material-icons"></i><i id="search-icon" class="material-icons"></i></span></div></div><div id="search-results"><div id="search-progress"><div id="progress-fill"></div></div><div id="results-content"><div id="entity-results"></div><div id="member-results"></div></div></div><div id="content-scroll-container" style="-webkit-overflow-scrolling: touch;"><div id="content-container" style="-webkit-overflow-scrolling: touch;"><div id="subpackage-spacer"><div id="packages"><h1>Packages</h1><ul><li class="indented0 " name="_root_.root" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="_root_" class="anchorToMember"></a><a id="root:_root_" class="anchorToMember"></a> <span class="permalink"><a href="../../../index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="../../../index.html" title=""><span class="name">root</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="../../../index.html" name="_root_" id="_root_" class="extype">root</a></dd></dl></div></li><li class="indented1 " name="_root_.org" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="org" class="anchorToMember"></a><a id="org:org" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="../../index.html" title=""><span class="name">org</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="../../../index.html" name="_root_" id="_root_" class="extype">root</a></dd></dl></div></li><li class="indented2 " name="org.apache" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="apache" class="anchorToMember"></a><a id="apache:apache" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="../index.html" title=""><span class="name">apache</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="../../index.html" name="org" id="org" class="extype">org</a></dd></dl></div></li><li class="indented3 " name="org.apache.spark" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="spark" class="anchorToMember"></a><a id="spark:spark" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="index.html" title="Core Spark functionality."><span class="name">spark</span></a></span><p class="shortcomment cmt">Core Spark functionality.</p><div class="fullcomment"><div class="comment cmt"><p>Core Spark functionality. <a href="SparkContext.html" name="org.apache.spark.SparkContext" id="org.apache.spark.SparkContext" class="extype">org.apache.spark.SparkContext</a> serves as the main entry point to |
| Spark, while <a href="rdd/RDD.html" name="org.apache.spark.rdd.RDD" id="org.apache.spark.rdd.RDD" class="extype">org.apache.spark.rdd.RDD</a> is the data type representing a distributed collection, |
| and provides most parallel operations.</p><p>In addition, <a href="rdd/PairRDDFunctions.html" name="org.apache.spark.rdd.PairRDDFunctions" id="org.apache.spark.rdd.PairRDDFunctions" class="extype">org.apache.spark.rdd.PairRDDFunctions</a> contains operations available only on RDDs |
| of key-value pairs, such as <code>groupByKey</code> and <code>join</code>; <a href="rdd/DoubleRDDFunctions.html" name="org.apache.spark.rdd.DoubleRDDFunctions" id="org.apache.spark.rdd.DoubleRDDFunctions" class="extype">org.apache.spark.rdd.DoubleRDDFunctions</a> |
| contains operations available only on RDDs of Doubles; and |
| <a href="rdd/SequenceFileRDDFunctions.html" name="org.apache.spark.rdd.SequenceFileRDDFunctions" id="org.apache.spark.rdd.SequenceFileRDDFunctions" class="extype">org.apache.spark.rdd.SequenceFileRDDFunctions</a> contains operations available on RDDs that can |
| be saved as SequenceFiles. These operations are automatically available on any RDD of the right |
| type (e.g. RDD[(Int, Int)] through implicit conversions.</p><p>Java programmers should reference the <a href="api/java/index.html" name="org.apache.spark.api.java" id="org.apache.spark.api.java" class="extype">org.apache.spark.api.java</a> package |
| for Spark programming APIs in Java.</p><p>Classes and methods marked with <span class="experimental badge" style="float: none;"> |
| Experimental</span> are user-facing features which have not been officially adopted by the |
| Spark project. These are subject to change or removal in minor releases.</p><p>Classes and methods marked with <span class="developer badge" style="float: none;"> |
| Developer API</span> are intended for advanced users want to extend Spark through lower |
| level interfaces. These are subject to changes or removal in minor releases. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="../index.html" name="org.apache" id="org.apache" class="extype">apache</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.api" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="api" class="anchorToMember"></a><a id="api:api" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/api/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="api/index.html" title=""><span class="name">api</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.broadcast" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="broadcast" class="anchorToMember"></a><a id="broadcast:broadcast" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/broadcast/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="broadcast/index.html" title="Spark's broadcast variables, used to broadcast immutable datasets to all nodes."><span class="name">broadcast</span></a></span><p class="shortcomment cmt">Spark's broadcast variables, used to broadcast immutable datasets to all nodes.</p><div class="fullcomment"><div class="comment cmt"><p>Spark's broadcast variables, used to broadcast immutable datasets to all nodes. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.graphx" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="graphx" class="anchorToMember"></a><a id="graphx:graphx" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/graphx/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="graphx/index.html" title="ALPHA COMPONENT GraphX is a graph processing framework built on top of Spark."><span class="name">graphx</span></a></span><p class="shortcomment cmt"><span class="badge" style="float: right;">ALPHA COMPONENT</span> |
| GraphX is a graph processing framework built on top of Spark.</p><div class="fullcomment"><div class="comment cmt"><p><span class="badge" style="float: right;">ALPHA COMPONENT</span> |
| GraphX is a graph processing framework built on top of Spark. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.input" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="input" class="anchorToMember"></a><a id="input:input" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/input/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="input/index.html" title=""><span class="name">input</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.io" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="io" class="anchorToMember"></a><a id="io:io" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/io/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="io/index.html" title="IO codecs used for compression."><span class="name">io</span></a></span><p class="shortcomment cmt">IO codecs used for compression.</p><div class="fullcomment"><div class="comment cmt"><p>IO codecs used for compression. See <a href="io/CompressionCodec.html" name="org.apache.spark.io.CompressionCodec" id="org.apache.spark.io.CompressionCodec" class="extype">org.apache.spark.io.CompressionCodec</a>. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.launcher" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="launcher" class="anchorToMember"></a><a id="launcher:launcher" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/launcher/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="launcher/index.html" title=""><span class="name">launcher</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.mapred" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="mapred" class="anchorToMember"></a><a id="mapred:mapred" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/mapred/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="mapred/index.html" title=""><span class="name">mapred</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.metrics" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="metrics" class="anchorToMember"></a><a id="metrics:metrics" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/metrics/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="metrics/index.html" title=""><span class="name">metrics</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.ml" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="ml" class="anchorToMember"></a><a id="ml:ml" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/ml/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="ml/index.html" title="DataFrame-based machine learning APIs to let users quickly assemble and configure practical machine learning pipelines."><span class="name">ml</span></a></span><p class="shortcomment cmt">DataFrame-based machine learning APIs to let users quickly assemble and configure practical |
| machine learning pipelines.</p><div class="fullcomment"><div class="comment cmt"><p>DataFrame-based machine learning APIs to let users quickly assemble and configure practical |
| machine learning pipelines. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.mllib" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="mllib" class="anchorToMember"></a><a id="mllib:mllib" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/mllib/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="mllib/index.html" title="RDD-based machine learning APIs (in maintenance mode)."><span class="name">mllib</span></a></span><p class="shortcomment cmt">RDD-based machine learning APIs (in maintenance mode).</p><div class="fullcomment"><div class="comment cmt"><p>RDD-based machine learning APIs (in maintenance mode).</p><p>The <code>spark.mllib</code> package is in maintenance mode as of the Spark 2.0.0 release to encourage |
| migration to the DataFrame-based APIs under the <a href="ml/index.html" name="org.apache.spark.ml" id="org.apache.spark.ml" class="extype">org.apache.spark.ml</a> package. |
| While in maintenance mode,</p><ul><li>no new features in the RDD-based <code>spark.mllib</code> package will be accepted, unless they block |
| implementing new features in the DataFrame-based <code>spark.ml</code> package;</li><li>bug fixes in the RDD-based APIs will still be accepted.</li></ul><p>The developers will continue adding more features to the DataFrame-based APIs in the 2.x series |
| to reach feature parity with the RDD-based APIs. |
| And once we reach feature parity, this package will be deprecated. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd><dt>See also</dt><dd><span class="cmt"><p><a href="https://issues.apache.org/jira/browse/SPARK-4591">SPARK-4591</a> to track |
| the progress of feature parity</p></span></dd></dl></div></li><li class="indented4 " name="org.apache.spark.partial" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="partial" class="anchorToMember"></a><a id="partial:partial" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/partial/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="partial/index.html" title="Support for approximate results."><span class="name">partial</span></a></span><p class="shortcomment cmt">Support for approximate results.</p><div class="fullcomment"><div class="comment cmt"><p>Support for approximate results. This provides convenient api and also implementation for |
| approximate calculation. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd><dt>See also</dt><dd><span class="cmt"><p><a href="rdd/RDD.html#countApprox(timeout:Long,confidence:Double):org.apache.spark.partial.PartialResult[org.apache.spark.partial.BoundedDouble]" name="org.apache.spark.rdd.RDD#countApprox" id="org.apache.spark.rdd.RDD#countApprox" class="extmbr">org.apache.spark.rdd.RDD.countApprox</a></p></span></dd></dl></div></li><li class="indented4 " name="org.apache.spark.paths" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="paths" class="anchorToMember"></a><a id="paths:paths" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/paths/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="paths/index.html" title=""><span class="name">paths</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.rdd" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="rdd" class="anchorToMember"></a><a id="rdd:rdd" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/rdd/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="rdd/index.html" title="Provides several RDD implementations."><span class="name">rdd</span></a></span><p class="shortcomment cmt">Provides several RDD implementations.</p><div class="fullcomment"><div class="comment cmt"><p>Provides several RDD implementations. See <a href="rdd/RDD.html" name="org.apache.spark.rdd.RDD" id="org.apache.spark.rdd.RDD" class="extype">org.apache.spark.rdd.RDD</a>. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.resource" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="resource" class="anchorToMember"></a><a id="resource:resource" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/resource/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="resource/index.html" title=""><span class="name">resource</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.scheduler" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="scheduler" class="anchorToMember"></a><a id="scheduler:scheduler" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/scheduler/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="scheduler/index.html" title="Spark's scheduling components."><span class="name">scheduler</span></a></span><p class="shortcomment cmt">Spark's scheduling components.</p><div class="fullcomment"><div class="comment cmt"><p>Spark's scheduling components. This includes the <code>org.apache.spark.scheduler.DAGScheduler</code> and |
| lower level <code>org.apache.spark.scheduler.TaskScheduler</code>. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.security" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="security" class="anchorToMember"></a><a id="security:security" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/security/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="security/index.html" title=""><span class="name">security</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.serializer" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="serializer" class="anchorToMember"></a><a id="serializer:serializer" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/serializer/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="serializer/index.html" title="Pluggable serializers for RDD and shuffle data."><span class="name">serializer</span></a></span><p class="shortcomment cmt">Pluggable serializers for RDD and shuffle data.</p><div class="fullcomment"><div class="comment cmt"><p>Pluggable serializers for RDD and shuffle data. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd><dt>See also</dt><dd><span class="cmt"><p><a href="serializer/Serializer.html" name="org.apache.spark.serializer.Serializer" id="org.apache.spark.serializer.Serializer" class="extype">org.apache.spark.serializer.Serializer</a></p></span></dd></dl></div></li><li class="indented4 " name="org.apache.spark.shuffle" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="shuffle" class="anchorToMember"></a><a id="shuffle:shuffle" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/shuffle/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="shuffle/index.html" title=""><span class="name">shuffle</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.sql" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="sql" class="anchorToMember"></a><a id="sql:sql" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/sql/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="sql/index.html" title="Allows the execution of relational queries, including those expressed in SQL using Spark."><span class="name">sql</span></a></span><p class="shortcomment cmt">Allows the execution of relational queries, including those expressed in SQL using Spark.</p><div class="fullcomment"><div class="comment cmt"><p>Allows the execution of relational queries, including those expressed in SQL using Spark. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.status" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="status" class="anchorToMember"></a><a id="status:status" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/status/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="status/index.html" title=""><span class="name">status</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.storage" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="storage" class="anchorToMember"></a><a id="storage:storage" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/storage/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="storage/index.html" title=""><span class="name">storage</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.streaming" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="streaming" class="anchorToMember"></a><a id="streaming:streaming" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/streaming/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="streaming/index.html" title="Spark Streaming functionality."><span class="name">streaming</span></a></span><p class="shortcomment cmt">Spark Streaming functionality.</p><div class="fullcomment"><div class="comment cmt"><p>Spark Streaming functionality. <a href="streaming/StreamingContext.html" name="org.apache.spark.streaming.StreamingContext" id="org.apache.spark.streaming.StreamingContext" class="extype">org.apache.spark.streaming.StreamingContext</a> serves as the main |
| entry point to Spark Streaming, while <a href="streaming/dstream/DStream.html" name="org.apache.spark.streaming.dstream.DStream" id="org.apache.spark.streaming.dstream.DStream" class="extype">org.apache.spark.streaming.dstream.DStream</a> is the data |
| type representing a continuous sequence of RDDs, representing a continuous stream of data.</p><p>In addition, <a href="streaming/dstream/PairDStreamFunctions.html" name="org.apache.spark.streaming.dstream.PairDStreamFunctions" id="org.apache.spark.streaming.dstream.PairDStreamFunctions" class="extype">org.apache.spark.streaming.dstream.PairDStreamFunctions</a> contains operations |
| available only on DStreams |
| of key-value pairs, such as <code>groupByKey</code> and <code>reduceByKey</code>. These operations are automatically |
| available on any DStream of the right type (e.g. DStream[(Int, Int)] through implicit |
| conversions.</p><p>For the Java API of Spark Streaming, take a look at the |
| <a href="streaming/api/java/JavaStreamingContext.html" name="org.apache.spark.streaming.api.java.JavaStreamingContext" id="org.apache.spark.streaming.api.java.JavaStreamingContext" class="extype">org.apache.spark.streaming.api.java.JavaStreamingContext</a> which serves as the entry point, and |
| the <a href="streaming/api/java/JavaDStream.html" name="org.apache.spark.streaming.api.java.JavaDStream" id="org.apache.spark.streaming.api.java.JavaDStream" class="extype">org.apache.spark.streaming.api.java.JavaDStream</a> and the |
| <a href="streaming/api/java/JavaPairDStream.html" name="org.apache.spark.streaming.api.java.JavaPairDStream" id="org.apache.spark.streaming.api.java.JavaPairDStream" class="extype">org.apache.spark.streaming.api.java.JavaPairDStream</a> which have the DStream functionality. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.types" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="types" class="anchorToMember"></a><a id="types:types" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/types/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="types/index.html" title=""><span class="name">types</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.ui" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="ui" class="anchorToMember"></a><a id="ui:ui" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/ui/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="ui/index.html" title=""><span class="name">ui</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.unsafe" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="unsafe" class="anchorToMember"></a><a id="unsafe:unsafe" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/unsafe/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="unsafe/index.html" title=""><span class="name">unsafe</span></a></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="indented4 " name="org.apache.spark.util" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="util" class="anchorToMember"></a><a id="util:util" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/util/index.html" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">package</span></span> <span class="symbol"><a href="util/index.html" title="Spark utilities."><span class="name">util</span></a></span><p class="shortcomment cmt">Spark utilities.</p><div class="fullcomment"><div class="comment cmt"><p>Spark utilities. |
| </p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></dd></dl></div></li><li class="current-entities indented3"><span class="separator"></span> <a href="Aggregator.html" title=":: DeveloperApi :: A set of functions used to aggregate data." class="class"></a><a href="Aggregator.html" title=":: DeveloperApi :: A set of functions used to aggregate data.">Aggregator</a></li><li class="current-entities indented3"><a href="BarrierTaskContext$.html" title="" class="object"></a> <a href="BarrierTaskContext.html" title=":: Experimental :: A TaskContext with extra contextual info and tooling for tasks in a barrier stage." class="class"></a><a href="BarrierTaskContext.html" title=":: Experimental :: A TaskContext with extra contextual info and tooling for tasks in a barrier stage.">BarrierTaskContext</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="BarrierTaskInfo.html" title=":: Experimental :: Carries all task infos of a barrier task." class="class"></a><a href="BarrierTaskInfo.html" title=":: Experimental :: Carries all task infos of a barrier task.">BarrierTaskInfo</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="ComplexFutureAction.html" title="A FutureAction for actions that could trigger multiple Spark jobs." class="class"></a><a href="ComplexFutureAction.html" title="A FutureAction for actions that could trigger multiple Spark jobs.">ComplexFutureAction</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="ContextAwareIterator.html" title=":: DeveloperApi :: A TaskContext aware iterator." class="class"></a><a href="ContextAwareIterator.html" title=":: DeveloperApi :: A TaskContext aware iterator.">ContextAwareIterator</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="Dependency.html" title=":: DeveloperApi :: Base class for dependencies." class="class"></a><a href="Dependency.html" title=":: DeveloperApi :: Base class for dependencies.">Dependency</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="ErrorClassesJsonReader.html" title="A reader to load error information from one or more JSON files." class="class"></a><a href="ErrorClassesJsonReader.html" title="A reader to load error information from one or more JSON files.">ErrorClassesJsonReader</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="ExceptionFailure.html" title=":: DeveloperApi :: Task failed due to a runtime exception." class="class"></a><a href="ExceptionFailure.html" title=":: DeveloperApi :: Task failed due to a runtime exception.">ExceptionFailure</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="ExecutorLostFailure.html" title=":: DeveloperApi :: The task failed because the executor that it was running on was lost." class="class"></a><a href="ExecutorLostFailure.html" title=":: DeveloperApi :: The task failed because the executor that it was running on was lost.">ExecutorLostFailure</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="FetchFailed.html" title=":: DeveloperApi :: Task failed to fetch shuffle data from a remote node." class="class"></a><a href="FetchFailed.html" title=":: DeveloperApi :: Task failed to fetch shuffle data from a remote node.">FetchFailed</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="FutureAction.html" title="A future for the result of an action to support cancellation." class="trait"></a><a href="FutureAction.html" title="A future for the result of an action to support cancellation.">FutureAction</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="HashPartitioner.html" title="A org.apache.spark.Partitioner that implements hash-based partitioning using Java's Object.hashCode." class="class"></a><a href="HashPartitioner.html" title="A org.apache.spark.Partitioner that implements hash-based partitioning using Java's Object.hashCode.">HashPartitioner</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="InterruptibleIterator.html" title=":: DeveloperApi :: An iterator that wraps around an existing iterator to provide task killing functionality." class="class"></a><a href="InterruptibleIterator.html" title=":: DeveloperApi :: An iterator that wraps around an existing iterator to provide task killing functionality.">InterruptibleIterator</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="JobExecutionStatus.html" title="" class="class"></a><a href="JobExecutionStatus.html" title="">JobExecutionStatus</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="JobSubmitter.html" title="Handle via which a "run" function passed to a ComplexFutureAction can submit jobs for execution." class="trait"></a><a href="JobSubmitter.html" title="Handle via which a "run" function passed to a ComplexFutureAction can submit jobs for execution.">JobSubmitter</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="NarrowDependency.html" title=":: DeveloperApi :: Base class for dependencies where each partition of the child RDD depends on a small number of partitions of the parent RDD." class="class"></a><a href="NarrowDependency.html" title=":: DeveloperApi :: Base class for dependencies where each partition of the child RDD depends on a small number of partitions of the parent RDD.">NarrowDependency</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="OneToOneDependency.html" title=":: DeveloperApi :: Represents a one-to-one dependency between partitions of the parent and child RDDs." class="class"></a><a href="OneToOneDependency.html" title=":: DeveloperApi :: Represents a one-to-one dependency between partitions of the parent and child RDDs.">OneToOneDependency</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="Partition.html" title="An identifier for a partition in an RDD." class="trait"></a><a href="Partition.html" title="An identifier for a partition in an RDD.">Partition</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="PartitionEvaluator.html" title="An evaluator for computing RDD partitions." class="trait"></a><a href="PartitionEvaluator.html" title="An evaluator for computing RDD partitions.">PartitionEvaluator</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="PartitionEvaluatorFactory.html" title="A factory to create PartitionEvaluator." class="trait"></a><a href="PartitionEvaluatorFactory.html" title="A factory to create PartitionEvaluator.">PartitionEvaluatorFactory</a></li><li class="current-entities indented3"><a href="Partitioner$.html" title="" class="object"></a> <a href="Partitioner.html" title="An object that defines how the elements in a key-value pair RDD are partitioned by key." class="class"></a><a href="Partitioner.html" title="An object that defines how the elements in a key-value pair RDD are partitioned by key.">Partitioner</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="QueryContext.html" title="Query context of a SparkThrowable." class="trait"></a><a href="QueryContext.html" title="Query context of a SparkThrowable.">QueryContext</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="QueryContextType.html" title="The type of QueryContext." class="class"></a><a href="QueryContextType.html" title="The type of QueryContext.">QueryContextType</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="RangeDependency.html" title=":: DeveloperApi :: Represents a one-to-one dependency between ranges of partitions in the parent and child RDDs." class="class"></a><a href="RangeDependency.html" title=":: DeveloperApi :: Represents a one-to-one dependency between ranges of partitions in the parent and child RDDs.">RangeDependency</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="RangePartitioner.html" title="A org.apache.spark.Partitioner that partitions sortable records by range into roughly equal ranges." class="class"></a><a href="RangePartitioner.html" title="A org.apache.spark.Partitioner that partitions sortable records by range into roughly equal ranges.">RangePartitioner</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="Resubmitted$.html" title=":: DeveloperApi :: A org.apache.spark.scheduler.ShuffleMapTask that completed successfully earlier, but we lost the executor before the stage completed." class="object"></a><a href="Resubmitted$.html" title=":: DeveloperApi :: A org.apache.spark.scheduler.ShuffleMapTask that completed successfully earlier, but we lost the executor before the stage completed.">Resubmitted</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SerializableWritable.html" title="" class="class"></a><a href="SerializableWritable.html" title="">SerializableWritable</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="ShuffleDependency.html" title=":: DeveloperApi :: Represents a dependency on the output of a shuffle stage." class="class"></a><a href="ShuffleDependency.html" title=":: DeveloperApi :: Represents a dependency on the output of a shuffle stage.">ShuffleDependency</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SimpleFutureAction.html" title="A FutureAction holding the result of an action that triggers a single job." class="class"></a><a href="SimpleFutureAction.html" title="A FutureAction holding the result of an action that triggers a single job.">SimpleFutureAction</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="" title="Configuration for a Spark application." class="class"></a><a href="" title="Configuration for a Spark application.">SparkConf</a></li><li class="current-entities indented3"><a href="SparkContext$.html" title="The SparkContext object contains a number of implicit conversions and parameters for use with various Spark features." class="object"></a> <a href="SparkContext.html" title="Main entry point for Spark functionality." class="class"></a><a href="SparkContext.html" title="Main entry point for Spark functionality.">SparkContext</a></li><li class="current-entities indented3"><a href="SparkEnv$.html" title="" class="object"></a> <a href="SparkEnv.html" title=":: DeveloperApi :: Holds all the runtime environment objects for a running Spark instance (either master or worker), including the serializer, RpcEnv, block manager, map output tracker, etc." class="class"></a><a href="SparkEnv.html" title=":: DeveloperApi :: Holds all the runtime environment objects for a running Spark instance (either master or worker), including the serializer, RpcEnv, block manager, map output tracker, etc.">SparkEnv</a></li><li class="current-entities indented3"><a href="SparkException$.html" title="" class="object"></a> <a href="SparkException.html" title="" class="class"></a><a href="SparkException.html" title="">SparkException</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SparkExecutorInfo.html" title="Exposes information about Spark Executors." class="trait"></a><a href="SparkExecutorInfo.html" title="Exposes information about Spark Executors.">SparkExecutorInfo</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SparkFiles$.html" title="Resolves paths to files added through SparkContext.addFile()." class="object"></a><a href="SparkFiles$.html" title="Resolves paths to files added through SparkContext.addFile().">SparkFiles</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SparkFirehoseListener.html" title="Class that allows users to receive all SparkListener events." class="class"></a><a href="SparkFirehoseListener.html" title="Class that allows users to receive all SparkListener events.">SparkFirehoseListener</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SparkJobInfo.html" title="Exposes information about Spark Jobs." class="trait"></a><a href="SparkJobInfo.html" title="Exposes information about Spark Jobs.">SparkJobInfo</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SparkStageInfo.html" title="Exposes information about Spark Stages." class="trait"></a><a href="SparkStageInfo.html" title="Exposes information about Spark Stages.">SparkStageInfo</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SparkStatusTracker.html" title="Low-level status reporting APIs for monitoring job and stage progress." class="class"></a><a href="SparkStatusTracker.html" title="Low-level status reporting APIs for monitoring job and stage progress.">SparkStatusTracker</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="SparkThrowable.html" title="Interface mixed into Throwables thrown from Spark." class="trait"></a><a href="SparkThrowable.html" title="Interface mixed into Throwables thrown from Spark.">SparkThrowable</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="Success$.html" title=":: DeveloperApi :: Task succeeded." class="object"></a><a href="Success$.html" title=":: DeveloperApi :: Task succeeded.">Success</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="TaskCommitDenied.html" title=":: DeveloperApi :: Task requested the driver to commit, but was denied." class="class"></a><a href="TaskCommitDenied.html" title=":: DeveloperApi :: Task requested the driver to commit, but was denied.">TaskCommitDenied</a></li><li class="current-entities indented3"><a href="TaskContext$.html" title="" class="object"></a> <a href="TaskContext.html" title="Contextual information about a task which can be read or mutated during execution." class="class"></a><a href="TaskContext.html" title="Contextual information about a task which can be read or mutated during execution.">TaskContext</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="TaskEndReason.html" title=":: DeveloperApi :: Various possible reasons why a task ended." class="trait"></a><a href="TaskEndReason.html" title=":: DeveloperApi :: Various possible reasons why a task ended.">TaskEndReason</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="TaskFailedReason.html" title=":: DeveloperApi :: Various possible reasons why a task failed." class="trait"></a><a href="TaskFailedReason.html" title=":: DeveloperApi :: Various possible reasons why a task failed.">TaskFailedReason</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="TaskKilled.html" title=":: DeveloperApi :: Task was killed intentionally and needs to be rescheduled." class="class"></a><a href="TaskKilled.html" title=":: DeveloperApi :: Task was killed intentionally and needs to be rescheduled.">TaskKilled</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="TaskKilledException.html" title=":: DeveloperApi :: Exception thrown when a task is explicitly killed (i.e., task failure is expected)." class="class"></a><a href="TaskKilledException.html" title=":: DeveloperApi :: Exception thrown when a task is explicitly killed (i.e., task failure is expected).">TaskKilledException</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="TaskResultLost$.html" title=":: DeveloperApi :: The task finished successfully, but the result was lost from the executor's block manager before it was fetched." class="object"></a><a href="TaskResultLost$.html" title=":: DeveloperApi :: The task finished successfully, but the result was lost from the executor's block manager before it was fetched.">TaskResultLost</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="UnknownReason$.html" title=":: DeveloperApi :: We don't know why the task ended -- for example, because of a ClassNotFound exception when deserializing the task result." class="object"></a><a href="UnknownReason$.html" title=":: DeveloperApi :: We don't know why the task ended -- for example, because of a ClassNotFound exception when deserializing the task result.">UnknownReason</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="WritableConverter$.html" title="" class="object"></a><a href="WritableConverter$.html" title="">WritableConverter</a></li><li class="current-entities indented3"><span class="separator"></span> <a href="WritableFactory$.html" title="" class="object"></a><a href="WritableFactory$.html" title="">WritableFactory</a></li></ul></div></div><div id="content"><body class="class type"><div id="definition"><div class="big-circle class">c</div><p id="owner"><a href="../../index.html" name="org" id="org" class="extype">org</a>.<a href="../index.html" name="org.apache" id="org.apache" class="extype">apache</a>.<a href="index.html" name="org.apache.spark" id="org.apache.spark" class="extype">spark</a></p><h1>SparkConf<span class="permalink"><a href="../../../org/apache/spark/SparkConf.html" title="Permalink"><i class="material-icons"></i></a></span></h1><h3><span class="morelinks"></span></h3></div><h4 id="signature" class="signature"><span class="modifier_kind"><span class="modifier"></span> <span class="kind">class</span></span> <span class="symbol"><span class="name">SparkConf</span><span class="result"> extends <span name="scala.Cloneable" class="extype">Cloneable</span> with <span name="org.apache.spark.internal.Logging" class="extype">Logging</span> with <span name="scala.Serializable" class="extype">Serializable</span></span></span></h4><div id="comment" class="fullcommenttop"><div class="comment cmt"><p>Configuration for a Spark application. Used to set various Spark parameters as key-value pairs.</p><p>Most of the time, you would create a SparkConf object with <code>new SparkConf()</code>, which will load |
| values from any <code>spark.*</code> Java system properties set in your application as well. In this case, |
| parameters you set directly on the <code>SparkConf</code> object take priority over system properties.</p><p>For unit tests, you can also call <code>new SparkConf(false)</code> to skip loading external settings and |
| get the same configuration no matter what the system properties are.</p><p>All setter methods in this class support chaining. For example, you can write |
| <code>new SparkConf().setMaster("local").setAppName("My app")</code>. |
| </p></div><dl class="attributes block"><dt>Source</dt><dd><a href="https://github.com/apache/spark/tree/v4.0.0-preview2/core/src/main/scala/org/apache/spark/SparkConf.scala" target="_blank">SparkConf.scala</a></dd><dt>Note</dt><dd><span class="cmt"><p>Once a SparkConf object is passed to Spark, it is cloned and can no longer be modified |
| by the user. Spark does not support modifying the configuration at runtime.</p></span></dd></dl><div class="toggleContainer"><div class="toggle block"><span>Linear Supertypes</span><div class="superTypes hiddenContent"><a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/io/Serializable.html#java.io.Serializable" name="java.io.Serializable" id="java.io.Serializable" class="extype">Serializable</a>, <span name="org.apache.spark.internal.Logging" class="extype">Logging</span>, <a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/lang/Cloneable.html#java.lang.Cloneable" name="java.lang.Cloneable" id="java.lang.Cloneable" class="extype">Cloneable</a>, <span name="scala.AnyRef" class="extype">AnyRef</span>, <span name="scala.Any" class="extype">Any</span></div></div></div></div><div id="mbrsel"><div class="toggle"></div><div id="memberfilter"><i class="material-icons arrow"></i><span class="input"><input placeholder="Filter all members" id="mbrsel-input" type="text" accesskey="/"/></span><i class="clear material-icons"></i></div><div id="filterby"><div id="order"><span class="filtertype">Ordering</span><ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By Inheritance</span></li></ol></div><div class="ancestors"><span class="filtertype">Inherited<br/></span><ol id="linearization"><li class="in" name="org.apache.spark.SparkConf"><span>SparkConf</span></li><li class="in" name="java.io.Serializable"><span>Serializable</span></li><li class="in" name="org.apache.spark.internal.Logging"><span>Logging</span></li><li class="in" name="java.lang.Cloneable"><span>Cloneable</span></li><li class="in" name="scala.AnyRef"><span>AnyRef</span></li><li class="in" name="scala.Any"><span>Any</span></li></ol></div><div class="ancestors"><span class="filtertype"></span><ol><li class="hideall out"><span>Hide All</span></li><li class="showall in"><span>Show All</span></li></ol></div><div id="visbl"><span class="filtertype">Visibility</span><ol><li class="public in"><span>Public</span></li><li class="protected out"><span>Protected</span></li></ol></div></div></div><div id="template"><div id="allMembers"><div id="constructors" class="members"><h3>Instance Constructors</h3><ol><li class="indented0 " name="org.apache.spark.SparkConf#<init>" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="<init>():org.apache.spark.SparkConf" class="anchorToMember"></a><a id="<init>:SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#<init>():org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">new</span></span> <span class="symbol"><span class="name">SparkConf</span><span class="params">()</span></span><p class="shortcomment cmt">Create a SparkConf that loads defaults from system properties and the classpath</p></li><li class="indented0 " name="org.apache.spark.SparkConf#<init>" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="<init>(loadDefaults:Boolean):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="<init>:SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#<init>(loadDefaults:Boolean):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">new</span></span> <span class="symbol"><span class="name">SparkConf</span><span class="params">(<span name="loadDefaults">loadDefaults: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span></span><p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">loadDefaults</dt><dd class="cmt"><p>whether to also load values from Java system properties</p></dd></dl></div></li></ol></div><div id="types" class="types members"><h3>Type Members</h3><ol><li class="indented0 " name="org.apache.spark.internal.Logging.LogStringContext" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="LogStringContextextendsAnyRef" class="anchorToMember"></a><a id="LogStringContext:LogStringContext" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#LogStringContextextendsAnyRef" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">implicit </span> <span class="kind">class</span></span> <span class="symbol"><span class="name">LogStringContext</span><span class="result"> extends <span name="scala.AnyRef" class="extype">AnyRef</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li></ol></div><div class="values members"><h3>Value Members</h3><ol><li class="indented0 " name="scala.AnyRef#!=" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="!=(x$1:Any):Boolean" class="anchorToMember"></a><a id="!=(Any):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#!=(x$1:Any):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div></li><li class="indented0 " name="scala.AnyRef###" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="##:Int" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html###:Int" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name" title="gt4s: $hash$hash">##</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div></li><li class="indented0 " name="scala.AnyRef#==" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="==(x$1:Any):Boolean" class="anchorToMember"></a><a id="==(Any):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#==(x$1:Any):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div></li><li class="indented0 " name="scala.Any#asInstanceOf" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="asInstanceOf[T0]:T0" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#asInstanceOf[T0]:T0" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Any.asInstanceOf.T0" class="extype">T0</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>Any</dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#clone" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="clone():org.apache.spark.SparkConf" class="anchorToMember"></a><a id="clone():SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#clone():org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">clone</span><span class="params">()</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Copy this object</p><div class="fullcomment"><div class="comment cmt"><p>Copy this object</p></div><dl class="attributes block"><dt>Definition Classes</dt><dd><a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a> → AnyRef</dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#contains" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="contains(key:String):Boolean" class="anchorToMember"></a><a id="contains(String):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#contains(key:String):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">contains</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><p class="shortcomment cmt">Does the configuration contain a given parameter?</p></li><li class="indented0 " name="scala.AnyRef#eq" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="eq(x$1:AnyRef):Boolean" class="anchorToMember"></a><a id="eq(AnyRef):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#eq(x$1:AnyRef):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">eq</span><span class="params">(<span name="arg0">arg0: <span name="scala.AnyRef" class="extype">AnyRef</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd></dl></div></li><li class="indented0 " name="scala.AnyRef#equals" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="equals(x$1:Object):Boolean" class="anchorToMember"></a><a id="equals(AnyRef):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#equals(x$1:Object):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.AnyRef" class="extype">AnyRef</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#get" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="get(key:String,defaultValue:String):String" class="anchorToMember"></a><a id="get(String,String):String" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#get(key:String,defaultValue:String):String" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">get</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Predef.String" class="extype">String</span></span></span><p class="shortcomment cmt">Get a parameter, falling back to a default if not set</p></li><li class="indented0 " name="org.apache.spark.SparkConf#get" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="get(key:String):String" class="anchorToMember"></a><a id="get(String):String" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#get(key:String):String" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">get</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Predef.String" class="extype">String</span></span></span><p class="shortcomment cmt">Get a parameter; throws a NoSuchElementException if it's not set</p></li><li class="indented0 " name="org.apache.spark.SparkConf#getAll" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="getAll:Array[(String,String)]" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getAll:Array[(String,String)]" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getAll</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(<span name="scala.Predef.String" class="extype">String</span>, <span name="scala.Predef.String" class="extype">String</span>)]</span></span><p class="shortcomment cmt">Get all parameters as a list of pairs</p></li><li class="indented0 " name="org.apache.spark.SparkConf#getAllWithPrefix" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="getAllWithPrefix(prefix:String):Array[(String,String)]" class="anchorToMember"></a><a id="getAllWithPrefix(String):Array[(String,String)]" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getAllWithPrefix(prefix:String):Array[(String,String)]" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getAllWithPrefix</span><span class="params">(<span name="prefix">prefix: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(<span name="scala.Predef.String" class="extype">String</span>, <span name="scala.Predef.String" class="extype">String</span>)]</span></span><p class="shortcomment cmt">Get all parameters that start with <code>prefix</code> |
| </p></li><li class="indented0 " name="org.apache.spark.SparkConf#getAppId" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="getAppId:String" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getAppId:String" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getAppId</span><span class="result">: <span name="scala.Predef.String" class="extype">String</span></span></span><p class="shortcomment cmt">Returns the Spark application id, valid in the Driver after TaskScheduler registration and |
| from the start in the Executor.</p></li><li class="indented0 " name="org.apache.spark.SparkConf#getAvroSchema" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="getAvroSchema:Map[Long,String]" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getAvroSchema:Map[Long,String]" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getAvroSchema</span><span class="result">: <span name="scala.Predef.Map" class="extype">Map</span>[<span name="scala.Long" class="extype">Long</span>, <span name="scala.Predef.String" class="extype">String</span>]</span></span><p class="shortcomment cmt">Gets all the avro schemas in the configuration used in the generic Avro record serializer</p></li><li class="indented0 " name="org.apache.spark.SparkConf#getBoolean" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getBoolean(key:String,defaultValue:Boolean):Boolean" class="anchorToMember"></a><a id="getBoolean(String,Boolean):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getBoolean(key:String,defaultValue:Boolean):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getBoolean</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><p class="shortcomment cmt">Get a parameter as a boolean, falling back to a default if not set</p><div class="fullcomment"><div class="comment cmt"><p>Get a parameter as a boolean, falling back to a default if not set</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="IllegalArgumentException" class="extype"><code>IllegalArgumentException</code></span> If the value cannot be interpreted as a boolean</p></span></dd></dl></div></li><li class="indented0 " name="scala.AnyRef#getClass" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getClass():Class[_]" class="anchorToMember"></a><a id="getClass():Class[_<:AnyRef]" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getClass():Class[_]" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getClass</span><span class="params">()</span><span class="result">: <a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/lang/Class.html#java.lang.Class" name="java.lang.Class" id="java.lang.Class" class="extype">Class</a>[_ <: <span name="scala.AnyRef" class="extype">AnyRef</span>]</span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef → Any</dd><dt>Annotations</dt><dd><span class="name">@IntrinsicCandidate</span><span class="args">()</span> <span class="name">@native</span><span class="args">()</span> </dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getDouble" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getDouble(key:String,defaultValue:Double):Double" class="anchorToMember"></a><a id="getDouble(String,Double):Double" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getDouble(key:String,defaultValue:Double):Double" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getDouble</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span></span><p class="shortcomment cmt">Get a parameter as a double, falling back to a default if not ste</p><div class="fullcomment"><div class="comment cmt"><p>Get a parameter as a double, falling back to a default if not ste</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as a double</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getExecutorEnv" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="getExecutorEnv:Seq[(String,String)]" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getExecutorEnv:Seq[(String,String)]" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getExecutorEnv</span><span class="result">: <span name="scala.Seq" class="extype">Seq</span>[(<span name="scala.Predef.String" class="extype">String</span>, <span name="scala.Predef.String" class="extype">String</span>)]</span></span><p class="shortcomment cmt">Get all executor environment variables set on this SparkConf</p></li><li class="indented0 " name="org.apache.spark.SparkConf#getInt" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getInt(key:String,defaultValue:Int):Int" class="anchorToMember"></a><a id="getInt(String,Int):Int" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getInt(key:String,defaultValue:Int):Int" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getInt</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span></span><p class="shortcomment cmt">Get a parameter as an integer, falling back to a default if not set</p><div class="fullcomment"><div class="comment cmt"><p>Get a parameter as an integer, falling back to a default if not set</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as an integer</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getLong" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getLong(key:String,defaultValue:Long):Long" class="anchorToMember"></a><a id="getLong(String,Long):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getLong(key:String,defaultValue:Long):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getLong</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a parameter as a long, falling back to a default if not set</p><div class="fullcomment"><div class="comment cmt"><p>Get a parameter as a long, falling back to a default if not set</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as a long</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getOption" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="getOption(key:String):Option[String]" class="anchorToMember"></a><a id="getOption(String):Option[String]" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getOption(key:String):Option[String]" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getOption</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<span name="scala.Predef.String" class="extype">String</span>]</span></span><p class="shortcomment cmt">Get a parameter as an Option</p></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsBytes" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsBytes(key:String,defaultValue:Long):Long" class="anchorToMember"></a><a id="getSizeAsBytes(String,Long):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsBytes(key:String,defaultValue:Long):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsBytes</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as bytes, falling back to a default if not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as bytes, falling back to a default if not set.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as bytes</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsBytes" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsBytes(key:String,defaultValue:String):Long" class="anchorToMember"></a><a id="getSizeAsBytes(String,String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsBytes(key:String,defaultValue:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsBytes</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as bytes, falling back to a default if not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as bytes, falling back to a default if not set. If no |
| suffix is provided then bytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as bytes</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsBytes" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsBytes(key:String):Long" class="anchorToMember"></a><a id="getSizeAsBytes(String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsBytes(key:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsBytes</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as bytes; throws a NoSuchElementException if it's not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as bytes; throws a NoSuchElementException if it's not set. If no |
| suffix is provided then bytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as bytes</p></span><span class="cmt"><p><a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/util/NoSuchElementException.html" name="java.util.NoSuchElementException" id="java.util.NoSuchElementException" class="extype"><code>java.util.NoSuchElementException</code></a> If the size parameter is not set</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsGb" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsGb(key:String,defaultValue:String):Long" class="anchorToMember"></a><a id="getSizeAsGb(String,String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsGb(key:String,defaultValue:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsGb</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as Gibibytes, falling back to a default if not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as Gibibytes, falling back to a default if not set. If no |
| suffix is provided then Gibibytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as Gibibytes</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsGb" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsGb(key:String):Long" class="anchorToMember"></a><a id="getSizeAsGb(String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsGb(key:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsGb</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set. If no |
| suffix is provided then Gibibytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as Gibibytes</p></span><span class="cmt"><p><a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/util/NoSuchElementException.html" name="java.util.NoSuchElementException" id="java.util.NoSuchElementException" class="extype"><code>java.util.NoSuchElementException</code></a> If the size parameter is not set</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsKb" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsKb(key:String,defaultValue:String):Long" class="anchorToMember"></a><a id="getSizeAsKb(String,String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsKb(key:String,defaultValue:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsKb</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as Kibibytes, falling back to a default if not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as Kibibytes, falling back to a default if not set. If no |
| suffix is provided then Kibibytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as Kibibytes</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsKb" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsKb(key:String):Long" class="anchorToMember"></a><a id="getSizeAsKb(String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsKb(key:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsKb</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set. If no |
| suffix is provided then Kibibytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as Kibibytes</p></span><span class="cmt"><p><a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/util/NoSuchElementException.html" name="java.util.NoSuchElementException" id="java.util.NoSuchElementException" class="extype"><code>java.util.NoSuchElementException</code></a> If the size parameter is not set</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsMb" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsMb(key:String,defaultValue:String):Long" class="anchorToMember"></a><a id="getSizeAsMb(String,String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsMb(key:String,defaultValue:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsMb</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as Mebibytes, falling back to a default if not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as Mebibytes, falling back to a default if not set. If no |
| suffix is provided then Mebibytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as Mebibytes</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getSizeAsMb" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getSizeAsMb(key:String):Long" class="anchorToMember"></a><a id="getSizeAsMb(String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getSizeAsMb(key:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getSizeAsMb</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set. If no |
| suffix is provided then Mebibytes are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as Mebibytes</p></span><span class="cmt"><p><a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/util/NoSuchElementException.html" name="java.util.NoSuchElementException" id="java.util.NoSuchElementException" class="extype"><code>java.util.NoSuchElementException</code></a> If the size parameter is not set</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getTimeAsMs" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getTimeAsMs(key:String,defaultValue:String):Long" class="anchorToMember"></a><a id="getTimeAsMs(String,String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getTimeAsMs(key:String,defaultValue:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getTimeAsMs</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a time parameter as milliseconds, falling back to a default if not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a time parameter as milliseconds, falling back to a default if not set. If no |
| suffix is provided then milliseconds are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as milliseconds</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getTimeAsMs" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getTimeAsMs(key:String):Long" class="anchorToMember"></a><a id="getTimeAsMs(String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getTimeAsMs(key:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getTimeAsMs</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set. If no |
| suffix is provided then milliseconds are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as milliseconds</p></span><span class="cmt"><p><a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/util/NoSuchElementException.html" name="java.util.NoSuchElementException" id="java.util.NoSuchElementException" class="extype"><code>java.util.NoSuchElementException</code></a> If the time parameter is not set</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getTimeAsSeconds" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getTimeAsSeconds(key:String,defaultValue:String):Long" class="anchorToMember"></a><a id="getTimeAsSeconds(String,String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getTimeAsSeconds(key:String,defaultValue:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getTimeAsSeconds</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="defaultValue">defaultValue: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a time parameter as seconds, falling back to a default if not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a time parameter as seconds, falling back to a default if not set. If no |
| suffix is provided then seconds are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as seconds</p></span></dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#getTimeAsSeconds" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="getTimeAsSeconds(key:String):Long" class="anchorToMember"></a><a id="getTimeAsSeconds(String):Long" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#getTimeAsSeconds(key:String):Long" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">getTimeAsSeconds</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span></span><p class="shortcomment cmt">Get a time parameter as seconds; throws a NoSuchElementException if it's not set.</p><div class="fullcomment"><div class="comment cmt"><p>Get a time parameter as seconds; throws a NoSuchElementException if it's not set. If no |
| suffix is provided then seconds are assumed.</p></div><dl class="attributes block"><dt>Exceptions thrown</dt><dd><span class="cmt"><p><span name="NumberFormatException" class="extype"><code>NumberFormatException</code></span> If the value cannot be interpreted as seconds</p></span><span class="cmt"><p><a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/util/NoSuchElementException.html" name="java.util.NoSuchElementException" id="java.util.NoSuchElementException" class="extype"><code>java.util.NoSuchElementException</code></a> If the time parameter is not set</p></span></dd></dl></div></li><li class="indented0 " name="scala.AnyRef#hashCode" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="hashCode():Int" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#hashCode():Int" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef → Any</dd><dt>Annotations</dt><dd><span class="name">@IntrinsicCandidate</span><span class="args">()</span> <span class="name">@native</span><span class="args">()</span> </dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#initializeLogIfNecessary" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="initializeLogIfNecessary(isInterpreter:Boolean,silent:Boolean):Boolean" class="anchorToMember"></a><a id="initializeLogIfNecessary(Boolean,Boolean):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#initializeLogIfNecessary(isInterpreter:Boolean,silent:Boolean):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">initializeLogIfNecessary</span><span class="params">(<span name="isInterpreter">isInterpreter: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="silent">silent: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#initializeLogIfNecessary" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="initializeLogIfNecessary(isInterpreter:Boolean):Unit" class="anchorToMember"></a><a id="initializeLogIfNecessary(Boolean):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#initializeLogIfNecessary(isInterpreter:Boolean):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">initializeLogIfNecessary</span><span class="params">(<span name="isInterpreter">isInterpreter: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="scala.Any#isInstanceOf" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="isInstanceOf[T0]:Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#isInstanceOf[T0]:Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>Any</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#isTraceEnabled" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="isTraceEnabled():Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#isTraceEnabled():Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">isTraceEnabled</span><span class="params">()</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#log" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="log:org.slf4j.Logger" class="anchorToMember"></a><a id="log:Logger" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#log:org.slf4j.Logger" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logDebug" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logDebug(msg:=>String,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logDebug(=>String,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logDebug(msg:=>String,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logDebug</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logDebug" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logDebug(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logDebug(LogEntry,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logDebug(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logDebug</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logDebug" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logDebug(entry:org.apache.spark.internal.LogEntry):Unit" class="anchorToMember"></a><a id="logDebug(LogEntry):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logDebug(entry:org.apache.spark.internal.LogEntry):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logDebug</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logDebug" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logDebug(msg:=>String):Unit" class="anchorToMember"></a><a id="logDebug(=>String):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logDebug(msg:=>String):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logDebug</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logError" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logError(msg:=>String,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logError(=>String,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logError(msg:=>String,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logError</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logError" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logError(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logError(LogEntry,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logError(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logError</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logError" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logError(entry:org.apache.spark.internal.LogEntry):Unit" class="anchorToMember"></a><a id="logError(LogEntry):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logError(entry:org.apache.spark.internal.LogEntry):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logError</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logError" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logError(msg:=>String):Unit" class="anchorToMember"></a><a id="logError(=>String):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logError(msg:=>String):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logError</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logInfo" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logInfo(msg:=>String,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logInfo(=>String,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logInfo(msg:=>String,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logInfo</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logInfo" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logInfo(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logInfo(LogEntry,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logInfo(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logInfo</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logInfo" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logInfo(entry:org.apache.spark.internal.LogEntry):Unit" class="anchorToMember"></a><a id="logInfo(LogEntry):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logInfo(entry:org.apache.spark.internal.LogEntry):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logInfo</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logInfo" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logInfo(msg:=>String):Unit" class="anchorToMember"></a><a id="logInfo(=>String):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logInfo(msg:=>String):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logInfo</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logName" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logName:String" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logName:String" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logName</span><span class="result">: <a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/lang/String.html#java.lang.String" name="java.lang.String" id="java.lang.String" class="extype">String</a></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logTrace" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logTrace(msg:=>String,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logTrace(=>String,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logTrace(msg:=>String,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logTrace</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logTrace" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logTrace(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logTrace(LogEntry,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logTrace(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logTrace</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logTrace" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logTrace(entry:org.apache.spark.internal.LogEntry):Unit" class="anchorToMember"></a><a id="logTrace(LogEntry):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logTrace(entry:org.apache.spark.internal.LogEntry):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logTrace</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logTrace" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logTrace(msg:=>String):Unit" class="anchorToMember"></a><a id="logTrace(=>String):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logTrace(msg:=>String):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logTrace</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logWarning" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logWarning(msg:=>String,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logWarning(=>String,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logWarning(msg:=>String,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logWarning</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logWarning" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logWarning(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" class="anchorToMember"></a><a id="logWarning(LogEntry,Throwable):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logWarning(entry:org.apache.spark.internal.LogEntry,throwable:Throwable):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logWarning</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>, <span name="throwable">throwable: <span name="scala.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logWarning" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logWarning(entry:org.apache.spark.internal.LogEntry):Unit" class="anchorToMember"></a><a id="logWarning(LogEntry):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logWarning(entry:org.apache.spark.internal.LogEntry):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logWarning</span><span class="params">(<span name="entry">entry: <span name="org.apache.spark.internal.LogEntry" class="extype">LogEntry</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#logWarning" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="logWarning(msg:=>String):Unit" class="anchorToMember"></a><a id="logWarning(=>String):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#logWarning(msg:=>String):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">logWarning</span><span class="params">(<span name="msg">msg: => <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li><li class="indented0 " name="scala.AnyRef#ne" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="ne(x$1:AnyRef):Boolean" class="anchorToMember"></a><a id="ne(AnyRef):Boolean" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#ne(x$1:AnyRef):Boolean" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">ne</span><span class="params">(<span name="arg0">arg0: <span name="scala.AnyRef" class="extype">AnyRef</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd></dl></div></li><li class="indented0 " name="scala.AnyRef#notify" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="notify():Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#notify():Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd><span class="name">@IntrinsicCandidate</span><span class="args">()</span> <span class="name">@native</span><span class="args">()</span> </dd></dl></div></li><li class="indented0 " name="scala.AnyRef#notifyAll" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="notifyAll():Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#notifyAll():Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd><span class="name">@IntrinsicCandidate</span><span class="args">()</span> <span class="name">@native</span><span class="args">()</span> </dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#registerAvroSchemas" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="registerAvroSchemas(schemas:org.apache.avro.Schema*):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="registerAvroSchemas(Schema*):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#registerAvroSchemas(schemas:org.apache.avro.Schema*):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">registerAvroSchemas</span><span class="params">(<span name="schemas">schemas: <span name="org.apache.avro.Schema" class="extype">Schema</span>*</span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Use Kryo serialization and register the given set of Avro schemas so that the generic |
| record serializer can decrease network IO |
| </p></li><li class="indented0 " name="org.apache.spark.SparkConf#registerKryoClasses" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="registerKryoClasses(classes:Array[Class[_]]):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="registerKryoClasses(Array[Class[_]]):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#registerKryoClasses(classes:Array[Class[_]]):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">registerKryoClasses</span><span class="params">(<span name="classes">classes: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Predef.Class" class="extype">Class</span>[_]]</span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Use Kryo serialization and register the given set of classes with Kryo.</p><div class="fullcomment"><div class="comment cmt"><p>Use Kryo serialization and register the given set of classes with Kryo. |
| If called multiple times, this will append the classes from all calls together. |
| </p></div></div></li><li class="indented0 " name="org.apache.spark.SparkConf#remove" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="remove(key:String):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="remove(String):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#remove(key:String):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">remove</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Remove a parameter from the configuration</p></li><li class="indented0 " name="org.apache.spark.SparkConf#set" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="set(key:String,value:String):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="set(String,String):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#set(key:String,value:String):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">set</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="value">value: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set a configuration variable.</p></li><li class="indented0 " name="org.apache.spark.SparkConf#setAll" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="setAll(settings:Iterable[(String,String)]):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setAll(Iterable[(String,String)]):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setAll(settings:Iterable[(String,String)]):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setAll</span><span class="params">(<span name="settings">settings: <span name="scala.Iterable" class="extype">Iterable</span>[(<span name="scala.Predef.String" class="extype">String</span>, <span name="scala.Predef.String" class="extype">String</span>)]</span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set multiple parameters together</p></li><li class="indented0 " name="org.apache.spark.SparkConf#setAppName" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="setAppName(name:String):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setAppName(String):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setAppName(name:String):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setAppName</span><span class="params">(<span name="name">name: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set a name for your application.</p><div class="fullcomment"><div class="comment cmt"><p>Set a name for your application. Shown in the Spark web UI.</p></div></div></li><li class="indented0 " name="org.apache.spark.SparkConf#setExecutorEnv" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="setExecutorEnv(variables:Array[(String,String)]):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setExecutorEnv(Array[(String,String)]):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setExecutorEnv(variables:Array[(String,String)]):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setExecutorEnv</span><span class="params">(<span name="variables">variables: <span name="scala.Array" class="extype">Array</span>[(<span name="scala.Predef.String" class="extype">String</span>, <span name="scala.Predef.String" class="extype">String</span>)]</span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set multiple environment variables to be used when launching executors.</p><div class="fullcomment"><div class="comment cmt"><p>Set multiple environment variables to be used when launching executors. |
| (Java-friendly version.) |
| </p></div></div></li><li class="indented0 " name="org.apache.spark.SparkConf#setExecutorEnv" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="setExecutorEnv(variables:Seq[(String,String)]):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setExecutorEnv(Seq[(String,String)]):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setExecutorEnv(variables:Seq[(String,String)]):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setExecutorEnv</span><span class="params">(<span name="variables">variables: <span name="scala.Seq" class="extype">Seq</span>[(<span name="scala.Predef.String" class="extype">String</span>, <span name="scala.Predef.String" class="extype">String</span>)]</span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set multiple environment variables to be used when launching executors.</p><div class="fullcomment"><div class="comment cmt"><p>Set multiple environment variables to be used when launching executors. |
| These variables are stored as properties of the form spark.executorEnv.VAR_NAME |
| (for example spark.executorEnv.PATH) but this method makes them easier to set. |
| </p></div></div></li><li class="indented0 " name="org.apache.spark.SparkConf#setExecutorEnv" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="setExecutorEnv(variable:String,value:String):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setExecutorEnv(String,String):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setExecutorEnv(variable:String,value:String):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setExecutorEnv</span><span class="params">(<span name="variable">variable: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="value">value: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set an environment variable to be used when launching executors for this application.</p><div class="fullcomment"><div class="comment cmt"><p>Set an environment variable to be used when launching executors for this application. |
| These variables are stored as properties of the form spark.executorEnv.VAR_NAME |
| (for example spark.executorEnv.PATH) but this method makes them easier to set. |
| </p></div></div></li><li class="indented0 " name="org.apache.spark.SparkConf#setIfMissing" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="setIfMissing(key:String,value:String):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setIfMissing(String,String):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setIfMissing(key:String,value:String):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setIfMissing</span><span class="params">(<span name="key">key: <span name="scala.Predef.String" class="extype">String</span></span>, <span name="value">value: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set a parameter if it isn't already configured</p></li><li class="indented0 " name="org.apache.spark.SparkConf#setJars" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="setJars(jars:Array[String]):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setJars(Array[String]):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setJars(jars:Array[String]):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setJars</span><span class="params">(<span name="jars">jars: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Predef.String" class="extype">String</span>]</span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set JAR files to distribute to the cluster.</p><div class="fullcomment"><div class="comment cmt"><p>Set JAR files to distribute to the cluster. (Java-friendly version.)</p></div></div></li><li class="indented0 " name="org.apache.spark.SparkConf#setJars" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="setJars(jars:Seq[String]):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setJars(Seq[String]):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setJars(jars:Seq[String]):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setJars</span><span class="params">(<span name="jars">jars: <span name="scala.Seq" class="extype">Seq</span>[<span name="scala.Predef.String" class="extype">String</span>]</span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set JAR files to distribute to the cluster.</p></li><li class="indented0 " name="org.apache.spark.SparkConf#setMaster" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="setMaster(master:String):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setMaster(String):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setMaster(master:String):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setMaster</span><span class="params">(<span name="master">master: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">The master URL to connect to, such as "local" to run locally with one thread, "local[4]" to |
| run locally with 4 cores, or "spark://master:7077" to run on a Spark standalone cluster.</p></li><li class="indented0 " name="org.apache.spark.SparkConf#setSparkHome" group="Ungrouped" fullComment="no" data-isabs="false" visbl="pub"><a id="setSparkHome(home:String):org.apache.spark.SparkConf" class="anchorToMember"></a><a id="setSparkHome(String):SparkConf" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#setSparkHome(home:String):org.apache.spark.SparkConf" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">setSparkHome</span><span class="params">(<span name="home">home: <span name="scala.Predef.String" class="extype">String</span></span>)</span><span class="result">: <a href="" name="org.apache.spark.SparkConf" id="org.apache.spark.SparkConf" class="extype">SparkConf</a></span></span><p class="shortcomment cmt">Set the location where Spark is installed on worker nodes.</p></li><li class="indented0 " name="scala.AnyRef#synchronized" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="synchronized[T0](x$1:=>T0):T0" class="anchorToMember"></a><a id="synchronized[T0](=>T0):T0" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#synchronized[T0](x$1:=>T0):T0" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: => <span name="java.lang.AnyRef.synchronized.T0" class="extype">T0</span></span>)</span><span class="result">: <span name="java.lang.AnyRef.synchronized.T0" class="extype">T0</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd></dl></div></li><li class="indented0 " name="org.apache.spark.SparkConf#toDebugString" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="toDebugString:String" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#toDebugString:String" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">toDebugString</span><span class="result">: <span name="scala.Predef.String" class="extype">String</span></span></span><p class="shortcomment cmt">Return a string listing all keys and values, one per line.</p><div class="fullcomment"><div class="comment cmt"><p>Return a string listing all keys and values, one per line. This is useful to print the |
| configuration out for debugging. |
| </p></div></div></li><li class="indented0 " name="scala.AnyRef#toString" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="toString():String" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#toString():String" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">toString</span><span class="params">()</span><span class="result">: <a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/lang/String.html#java.lang.String" name="java.lang.String" id="java.lang.String" class="extype">String</a></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div></li><li class="indented0 " name="scala.AnyRef#wait" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="wait(x$1:Long,x$2:Int):Unit" class="anchorToMember"></a><a id="wait(Long,Int):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#wait(x$1:Long,x$2:Int):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd><span class="name">@throws</span><span class="args">(<span><span class="defval">classOf[java.lang.InterruptedException]</span></span>)</span> </dd></dl></div></li><li class="indented0 " name="scala.AnyRef#wait" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="wait(x$1:Long):Unit" class="anchorToMember"></a><a id="wait(Long):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#wait(x$1:Long):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd><span class="name">@throws</span><span class="args">(<span><span class="defval">classOf[java.lang.InterruptedException]</span></span>)</span> <span class="name">@native</span><span class="args">()</span> </dd></dl></div></li><li class="indented0 " name="scala.AnyRef#wait" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="pub"><a id="wait():Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#wait():Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier">final </span> <span class="kind">def</span></span> <span class="symbol"><span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd><span class="name">@throws</span><span class="args">(<span><span class="defval">classOf[java.lang.InterruptedException]</span></span>)</span> </dd></dl></div></li><li class="indented0 " name="org.apache.spark.internal.Logging#withLogContext" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="withLogContext(context:java.util.HashMap[String,String])(body:=>Unit):Unit" class="anchorToMember"></a><a id="withLogContext(HashMap[String,String])(=>Unit):Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#withLogContext(context:java.util.HashMap[String,String])(body:=>Unit):Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name">withLogContext</span><span class="params">(<span name="context">context: <a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/util/HashMap.html#java.util.HashMap" name="java.util.HashMap" id="java.util.HashMap" class="extype">HashMap</a>[<span name="scala.Predef.String" class="extype">String</span>, <span name="scala.Predef.String" class="extype">String</span>]</span>)</span><span class="params">(<span name="body">body: => <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>Logging</dd></dl></div></li></ol></div><div class="values members"><h3>Deprecated Value Members</h3><ol><li class="indented0 " name="scala.AnyRef#finalize" group="Ungrouped" fullComment="yes" data-isabs="false" visbl="prt"><a id="finalize():Unit" class="anchorToMember"></a> <span class="permalink"><a href="../../../org/apache/spark/SparkConf.html#finalize():Unit" title="Permalink"><i class="material-icons"></i></a></span> <span class="modifier_kind"><span class="modifier"></span> <span class="kind">def</span></span> <span class="symbol"><span class="name deprecated" title="Deprecated: (Since version 9)">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span></span><div class="fullcomment"><dl class="attributes block"><dt>Attributes</dt><dd>protected[<span name="java.lang" class="extype">lang</span>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd><span class="name">@throws</span><span class="args">(<span><span class="symbol">classOf[java.lang.Throwable]</span></span>)</span> <span class="name">@Deprecated</span> </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 9)</i></p></dd></dl></div></li></ol></div></div><div id="inheritedMembers"><div name="java.io.Serializable" class="parent"><h3>Inherited from <a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/io/Serializable.html#java.io.Serializable" name="java.io.Serializable" id="java.io.Serializable" class="extype">Serializable</a></h3></div><div name="org.apache.spark.internal.Logging" class="parent"><h3>Inherited from <span name="org.apache.spark.internal.Logging" class="extype">Logging</span></h3></div><div name="java.lang.Cloneable" class="parent"><h3>Inherited from <a href="https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/lang/Cloneable.html#java.lang.Cloneable" name="java.lang.Cloneable" id="java.lang.Cloneable" class="extype">Cloneable</a></h3></div><div name="scala.AnyRef" class="parent"><h3>Inherited from <span name="scala.AnyRef" class="extype">AnyRef</span></h3></div><div name="scala.Any" class="parent"><h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3></div></div><div id="groupedMembers"><div name="Ungrouped" class="group"><h3>Ungrouped</h3></div></div></div><div id="tooltip"></div><div id="footer"></div></body></div></div></div></body></html> |
