Google Git
Sign in
apache / spark-website / f7fc275b5cd176e4d65d70f1b933e7fcce370584 / . / site / docs / 4.0.0-preview1 / api / java / org / apache / spark / package-summary.html
blob: bd8796021e84a08bad105459de72cdfbd9901cad [file] [log] [blame]
<!DOCTYPE HTML>
<html lang="en">
<head>
<!-- Generated by javadoc (17) on Tue May 28 17:21:12 UTC 2024 -->
<title>org.apache.spark (Spark 4.0.0-preview1 JavaDoc)</title>
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="dc.created" content="2024-05-28">
<meta name="description" content="declaration: package: org.apache.spark">
<meta name="generator" content="javadoc/PackageWriterImpl">
<link rel="stylesheet" type="text/css" href="../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../script-dir/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../jquery-ui.overrides.css" title="Style">
<script type="text/javascript" src="../../../script.js"></script>
<script type="text/javascript" src="../../../script-dir/jquery-3.6.1.min.js"></script>
<script type="text/javascript" src="../../../script-dir/jquery-ui.min.js"></script>
</head>
<body class="package-declaration-page">
<script type="text/javascript">var evenRowColor = "even-row-color";
var oddRowColor = "odd-row-color";
var tableTab = "table-tab";
var activeTableTab = "active-table-tab";
var pathtoroot = "../../../";
loadScripts(document, 'script');</script>
<noscript>
<div>JavaScript is disabled on your browser.</div>
</noscript>
<div class="flex-box">
<header role="banner" class="flex-header">
<nav role="navigation">
<!-- ========= START OF TOP NAVBAR ======= -->
<div class="top-nav" id="navbar-top">
<div class="skip-nav"><a href="#skip-navbar-top" title="Skip navigation links">Skip navigation links</a></div>
<ul id="navbar-top-firstrow" class="nav-list" title="Navigation">
<li><a href="../../../index.html">Overview</a></li>
<li class="nav-bar-cell1-rev">Package</li>
<li>Class</li>
<li><a href="../../../deprecated-list.html">Deprecated</a></li>
<li><a href="../../../index-all.html">Index</a></li>
<li><a href="../../../help-doc.html#package">Help</a></li>
</ul>
</div>
<div class="sub-nav">
<div>
<ul class="sub-nav-list">
<li>Package:&nbsp;</li>
<li><a href="#package-description">Description</a>&nbsp;|&nbsp;</li>
<li>Related Packages&nbsp;|&nbsp;</li>
<li><a href="#class-summary">Classes and Interfaces</a></li>
</ul>
</div>
<div class="nav-list-search"><label for="search-input">SEARCH:</label>
<input type="text" id="search-input" value="search" disabled="disabled">
<input type="reset" id="reset-button" value="reset" disabled="disabled">
</div>
</div>
<!-- ========= END OF TOP NAVBAR ========= -->
<span class="skip-nav" id="skip-navbar-top"></span></nav>
</header>
<div class="flex-content">
<main role="main">
<div class="header">
<h1 title="Package org.apache.spark" class="title">Package org.apache.spark</h1>
</div>
<hr>
<div class="package-signature">package <span class="element-name">org.apache.spark</span></div>
<section class="package-description" id="package-description">
<div class="block">Core Spark classes in Scala. A few classes here, such as
<a href="storage/StorageLevel.html" title="class in org.apache.spark.storage"><code>StorageLevel</code></a>, are also used in Java, but the
<a href="api/java/package-summary.html"><code>org.apache.spark.api.java</code></a> package contains the main Java API.</div>
</section>
<section class="summary">
<ul class="summary-list">
<li>
<div id="class-summary">
<div class="table-tabs" role="tablist" aria-orientation="horizontal"><button id="class-summary-tab0" role="tab" aria-selected="true" aria-controls="class-summary.tabpanel" tabindex="0" onkeydown="switchTab(event)" onclick="show('class-summary', 'class-summary', 2)" class="active-table-tab">All Classes and Interfaces</button><button id="class-summary-tab1" role="tab" aria-selected="false" aria-controls="class-summary.tabpanel" tabindex="-1" onkeydown="switchTab(event)" onclick="show('class-summary', 'class-summary-tab1', 2)" class="table-tab">Interfaces</button><button id="class-summary-tab2" role="tab" aria-selected="false" aria-controls="class-summary.tabpanel" tabindex="-1" onkeydown="switchTab(event)" onclick="show('class-summary', 'class-summary-tab2', 2)" class="table-tab">Classes</button><button id="class-summary-tab3" role="tab" aria-selected="false" aria-controls="class-summary.tabpanel" tabindex="-1" onkeydown="switchTab(event)" onclick="show('class-summary', 'class-summary-tab3', 2)" class="table-tab">Enum Classes</button><button id="class-summary-tab5" role="tab" aria-selected="false" aria-controls="class-summary.tabpanel" tabindex="-1" onkeydown="switchTab(event)" onclick="show('class-summary', 'class-summary-tab5', 2)" class="table-tab">Exceptions</button></div>
<div id="class-summary.tabpanel" role="tabpanel">
<div class="summary-table two-column-summary" aria-labelledby="class-summary-tab0">
<div class="table-header col-first">Class</div>
<div class="table-header col-last">Description</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="Aggregator.html" title="class in org.apache.spark">Aggregator</a>&lt;K,<wbr>V,<wbr>C&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
A set of functions used to aggregate data.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="BarrierCoordinatorMessage.html" title="interface in org.apache.spark">BarrierCoordinatorMessage</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="BarrierTaskContext.html" title="class in org.apache.spark">BarrierTaskContext</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: Experimental ::
A <a href="TaskContext.html" title="class in org.apache.spark"><code>TaskContext</code></a> with extra contextual info and tooling for tasks in a barrier stage.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="BarrierTaskInfo.html" title="class in org.apache.spark">BarrierTaskInfo</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: Experimental ::
Carries all task infos of a barrier task.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="CleanAccum.html" title="class in org.apache.spark">CleanAccum</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="CleanBroadcast.html" title="class in org.apache.spark">CleanBroadcast</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="CleanCheckpoint.html" title="class in org.apache.spark">CleanCheckpoint</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="CleanerListener.html" title="interface in org.apache.spark">CleanerListener</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">Listener class used when any item has been cleaned by the Cleaner class.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="CleanRDD.html" title="class in org.apache.spark">CleanRDD</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="CleanShuffle.html" title="class in org.apache.spark">CleanShuffle</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="CleanSparkListener.html" title="class in org.apache.spark">CleanSparkListener</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="CleanupTask.html" title="interface in org.apache.spark">CleanupTask</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">Classes that represent cleaning tasks.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="CleanupTaskWeakReference.html" title="class in org.apache.spark">CleanupTaskWeakReference</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">A WeakReference associated with a CleanupTask.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ComplexFutureAction.html" title="class in org.apache.spark">ComplexFutureAction</a>&lt;T&gt;</div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">A <a href="FutureAction.html" title="interface in org.apache.spark"><code>FutureAction</code></a> for actions that could trigger multiple Spark jobs.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="ContextAwareIterator.html" title="class in org.apache.spark">ContextAwareIterator</a>&lt;T&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab2">Deprecated.
<div class="deprecation-comment">since 4.0.0 as its only usage for Python evaluation is now extinct</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ContextBarrierId.html" title="class in org.apache.spark">ContextBarrierId</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">For each barrier stage attempt, only at most one barrier() call can be active at any time, thus
we can use (stageId, stageAttemptId) to identify the stage attempt where the barrier() call is
from.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="Dependency.html" title="class in org.apache.spark">Dependency</a>&lt;T&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Base class for dependencies.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ErrorClassesJsonReader.html" title="class in org.apache.spark">ErrorClassesJsonReader</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">A reader to load error information from one or more JSON files.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="ErrorInfo.html" title="class in org.apache.spark">ErrorInfo</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">Information associated with an error class.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ErrorMessageFormat.html" title="class in org.apache.spark">ErrorMessageFormat</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="ErrorStateInfo.html" title="class in org.apache.spark">ErrorStateInfo</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">Information associated with an error state / SQLSTATE.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ErrorSubInfo.html" title="class in org.apache.spark">ErrorSubInfo</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">Information associated with an error subclass.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="ExceptionFailure.html" title="class in org.apache.spark">ExceptionFailure</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Task failed due to a runtime exception.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ExecutorLostFailure.html" title="class in org.apache.spark">ExecutorLostFailure</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
The task failed because the executor that it was running on was lost.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="ExecutorRegistered.html" title="class in org.apache.spark">ExecutorRegistered</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ExecutorRemoved.html" title="class in org.apache.spark">ExecutorRemoved</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="ExpireDeadHosts.html" title="class in org.apache.spark">ExpireDeadHosts</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="FetchFailed.html" title="class in org.apache.spark">FetchFailed</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Task failed to fetch shuffle data from a remote node.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab1"><a href="FutureAction.html" title="interface in org.apache.spark">FutureAction</a>&lt;T&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab1">
<div class="block">A future for the result of an action to support cancellation.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="HashPartitioner.html" title="class in org.apache.spark">HashPartitioner</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">A <a href="Partitioner.html" title="class in org.apache.spark"><code>Partitioner</code></a> that implements hash-based partitioning using
Java's <code>Object.hashCode</code>.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="InternalAccumulator.html" title="class in org.apache.spark">InternalAccumulator</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">A collection of fields and methods concerned with internal accumulators that represent
task level metrics.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="InternalAccumulator.input$.html" title="class in org.apache.spark">InternalAccumulator.input$</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="InternalAccumulator.output$.html" title="class in org.apache.spark">InternalAccumulator.output$</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="InternalAccumulator.shuffleRead$.html" title="class in org.apache.spark">InternalAccumulator.shuffleRead$</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="InternalAccumulator.shuffleWrite$.html" title="class in org.apache.spark">InternalAccumulator.shuffleWrite$</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="InterruptibleIterator.html" title="class in org.apache.spark">InterruptibleIterator</a>&lt;T&gt;</div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
An iterator that wraps around an existing iterator to provide task killing functionality.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab3"><a href="JobExecutionStatus.html" title="enum class in org.apache.spark">JobExecutionStatus</a></div>
<div class="col-last even-row-color class-summary class-summary-tab3">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="JobSubmitter.html" title="interface in org.apache.spark">JobSubmitter</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">Handle via which a "run" function passed to a <a href="ComplexFutureAction.html" title="class in org.apache.spark"><code>ComplexFutureAction</code></a>
can submit jobs for execution.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab1"><a href="MapOutputTrackerMasterMessage.html" title="interface in org.apache.spark">MapOutputTrackerMasterMessage</a></div>
<div class="col-last even-row-color class-summary class-summary-tab1">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="MapOutputTrackerMessage.html" title="interface in org.apache.spark">MapOutputTrackerMessage</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="NarrowDependency.html" title="class in org.apache.spark">NarrowDependency</a>&lt;T&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Base class for dependencies where each partition of the child RDD depends on a small number
of partitions of the parent RDD.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="OneToOneDependency.html" title="class in org.apache.spark">OneToOneDependency</a>&lt;T&gt;</div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Represents a one-to-one dependency between partitions of the parent and child RDDs.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab1"><a href="Partition.html" title="interface in org.apache.spark">Partition</a></div>
<div class="col-last even-row-color class-summary class-summary-tab1">
<div class="block">An identifier for a partition in an RDD.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="Partitioner.html" title="class in org.apache.spark">Partitioner</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">An object that defines how the elements in a key-value pair RDD are partitioned by key.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab1"><a href="PartitionEvaluator.html" title="interface in org.apache.spark">PartitionEvaluator</a>&lt;T,<wbr>U&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab1">
<div class="block">An evaluator for computing RDD partitions.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="PartitionEvaluatorFactory.html" title="interface in org.apache.spark">PartitionEvaluatorFactory</a>&lt;T,<wbr>U&gt;</div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">A factory to create <a href="PartitionEvaluator.html" title="interface in org.apache.spark"><code>PartitionEvaluator</code></a>.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab1"><a href="QueryContext.html" title="interface in org.apache.spark">QueryContext</a></div>
<div class="col-last even-row-color class-summary class-summary-tab1">
<div class="block">Query context of a <a href="SparkThrowable.html" title="interface in org.apache.spark"><code>SparkThrowable</code></a>.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab3"><a href="QueryContextType.html" title="enum class in org.apache.spark">QueryContextType</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab3">
<div class="block">The type of <a href="QueryContext.html" title="interface in org.apache.spark"><code>QueryContext</code></a>.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="RangeDependency.html" title="class in org.apache.spark">RangeDependency</a>&lt;T&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Represents a one-to-one dependency between ranges of partitions in the parent and child RDDs.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="RangePartitioner.html" title="class in org.apache.spark">RangePartitioner</a>&lt;K,<wbr>V&gt;</div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">A <a href="Partitioner.html" title="class in org.apache.spark"><code>Partitioner</code></a> that partitions sortable records by range into roughly
equal ranges.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="RequestMethod.html" title="class in org.apache.spark">RequestMethod</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="Resubmitted.html" title="class in org.apache.spark">Resubmitted</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
A <code>org.apache.spark.scheduler.ShuffleMapTask</code> that completed successfully earlier, but we
lost the executor before the stage completed.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SerializableWritable.html" title="class in org.apache.spark">SerializableWritable</a>&lt;T extends org.apache.hadoop.io.Writable&gt;</div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="ShuffleDependency.html" title="class in org.apache.spark">ShuffleDependency</a>&lt;K,<wbr>V,<wbr>C&gt;</div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Represents a dependency on the output of a shuffle stage.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="ShuffleStatus.html" title="class in org.apache.spark">ShuffleStatus</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">Helper class used by the <code>MapOutputTrackerMaster</code> to perform bookkeeping for a single
ShuffleMapStage.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="SimpleFutureAction.html" title="class in org.apache.spark">SimpleFutureAction</a>&lt;T&gt;</div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">A <a href="FutureAction.html" title="interface in org.apache.spark"><code>FutureAction</code></a> holding the result of an action that triggers a single job.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SparkBuildInfo.html" title="class in org.apache.spark">SparkBuildInfo</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="SparkConf.html" title="class in org.apache.spark">SparkConf</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">Configuration for a Spark application.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SparkContext.html" title="class in org.apache.spark">SparkContext</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">Main entry point for Spark functionality.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="SparkEnv.html" title="class in org.apache.spark">SparkEnv</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Holds all the runtime environment objects for a running Spark instance (either master or worker),
including the serializer, RpcEnv, block manager, map output tracker, etc.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab5"><a href="SparkException.html" title="class in org.apache.spark">SparkException</a></div>
<div class="col-last even-row-color class-summary class-summary-tab5">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="SparkExecutorInfo.html" title="interface in org.apache.spark">SparkExecutorInfo</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">Exposes information about Spark Executors.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SparkExecutorInfoImpl.html" title="class in org.apache.spark">SparkExecutorInfoImpl</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="SparkFiles.html" title="class in org.apache.spark">SparkFiles</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">Resolves paths to files added through <code>SparkContext.addFile()</code>.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SparkFirehoseListener.html" title="class in org.apache.spark">SparkFirehoseListener</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">Class that allows users to receive all SparkListener events.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="SparkJobInfo.html" title="interface in org.apache.spark">SparkJobInfo</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">Exposes information about Spark Jobs.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SparkJobInfoImpl.html" title="class in org.apache.spark">SparkJobInfoImpl</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="SparkMasterRegex.html" title="class in org.apache.spark">SparkMasterRegex</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">A collection of regexes for extracting information from the master string.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab1"><a href="SparkStageInfo.html" title="interface in org.apache.spark">SparkStageInfo</a></div>
<div class="col-last even-row-color class-summary class-summary-tab1">
<div class="block">Exposes information about Spark Stages.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="SparkStageInfoImpl.html" title="class in org.apache.spark">SparkStageInfoImpl</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SparkStatusTracker.html" title="class in org.apache.spark">SparkStatusTracker</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">Low-level status reporting APIs for monitoring job and stage progress.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="SparkThrowable.html" title="interface in org.apache.spark">SparkThrowable</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">Interface mixed into Throwables thrown from Spark.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="SparkThrowableHelper.html" title="class in org.apache.spark">SparkThrowableHelper</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">Companion object used by instances of <a href="SparkThrowable.html" title="interface in org.apache.spark"><code>SparkThrowable</code></a> to access error class information and
construct error messages.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="SpillListener.html" title="class in org.apache.spark">SpillListener</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">A <code>SparkListener</code> that detects whether spills have occurred in Spark jobs.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="StopMapOutputTracker.html" title="class in org.apache.spark">StopMapOutputTracker</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="Success.html" title="class in org.apache.spark">Success</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Task succeeded.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="TaskCommitDenied.html" title="class in org.apache.spark">TaskCommitDenied</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Task requested the driver to commit, but was denied.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="TaskContext.html" title="class in org.apache.spark">TaskContext</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">Contextual information about a task which can be read or mutated during
execution.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab1"><a href="TaskEndReason.html" title="interface in org.apache.spark">TaskEndReason</a></div>
<div class="col-last even-row-color class-summary class-summary-tab1">
<div class="block">:: DeveloperApi ::
Various possible reasons why a task ended.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab1"><a href="TaskFailedReason.html" title="interface in org.apache.spark">TaskFailedReason</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab1">
<div class="block">:: DeveloperApi ::
Various possible reasons why a task failed.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="TaskKilled.html" title="class in org.apache.spark">TaskKilled</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
Task was killed intentionally and needs to be rescheduled.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab5"><a href="TaskKilledException.html" title="class in org.apache.spark">TaskKilledException</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab5">
<div class="block">:: DeveloperApi ::
Exception thrown when a task is explicitly killed (i.e., task failure is expected).</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="TaskResultLost.html" title="class in org.apache.spark">TaskResultLost</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
The task finished successfully, but the result was lost from the executor's block manager before
it was fetched.</div>
</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="TaskSchedulerIsSet.html" title="class in org.apache.spark">TaskSchedulerIsSet</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">An event that SparkContext uses to notify HeartbeatReceiver that SparkContext.taskScheduler is
created.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="TaskState.html" title="class in org.apache.spark">TaskState</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">&nbsp;</div>
<div class="col-first odd-row-color class-summary class-summary-tab2"><a href="TestUtils.html" title="class in org.apache.spark">TestUtils</a></div>
<div class="col-last odd-row-color class-summary class-summary-tab2">
<div class="block">Utilities for tests.</div>
</div>
<div class="col-first even-row-color class-summary class-summary-tab2"><a href="UnknownReason.html" title="class in org.apache.spark">UnknownReason</a></div>
<div class="col-last even-row-color class-summary class-summary-tab2">
<div class="block">:: DeveloperApi ::
We don't know why the task ended -- for example, because of a ClassNotFound exception when
deserializing the task result.</div>
</div>
</div>
</div>
</div>
</li>
</ul>
</section>
</main>
</div>
</div>
<script defer="defer" type="text/javascript" src="../../../lib/jquery.js"></script><script defer="defer" type="text/javascript" src="../../../lib/api-javadocs.js"></script></body>
</html>