blob: c5088f6a8f5ff66be7141521e2d1b3f00b2d18a3 [file] [log] [blame]
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
<link rel="icon" href="/favicon.ico" type="image/x-icon">
<title>Documentation</title>
<!-- Bootstrap core CSS -->
<link href="/assets/css/bootstrap.min.css" rel="stylesheet">
<!-- Bootstrap theme -->
<link href="/assets/css/bootstrap-theme.min.css" rel="stylesheet">
<!-- Custom styles for this template -->
<link rel="stylesheet" href="http://fortawesome.github.io/Font-Awesome/assets/font-awesome/css/font-awesome.css">
<link href="/css/style.css" rel="stylesheet">
<link href="/assets/css/owl.theme.css" rel="stylesheet">
<link href="/assets/css/owl.carousel.css" rel="stylesheet">
<script type="text/javascript" src="/assets/js/jquery.min.js"></script>
<script type="text/javascript" src="/assets/js/bootstrap.min.js"></script>
<script type="text/javascript" src="/assets/js/owl.carousel.min.js"></script>
<script type="text/javascript" src="/assets/js/storm.js"></script>
<!-- Just for debugging purposes. Don't actually copy these 2 lines! -->
<!--[if lt IE 9]><script src="../../assets/js/ie8-responsive-file-warning.js"></script><![endif]-->
<!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
<!--[if lt IE 9]>
<script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
<script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
<![endif]-->
</head>
<body>
<header>
<div class="container-fluid">
<div class="row">
<div class="col-md-5">
<a href="/index.html"><img src="/images/logo.png" class="logo" /></a>
</div>
<div class="col-md-5">
<h1>Version: 2.1.0</h1>
</div>
<div class="col-md-2">
<a href="/downloads.html" class="btn-std btn-block btn-download">Download</a>
</div>
</div>
</div>
</header>
<!--Header End-->
<!--Navigation Begin-->
<div class="navbar" role="banner">
<div class="container-fluid">
<div class="navbar-header">
<button class="navbar-toggle" type="button" data-toggle="collapse" data-target=".bs-navbar-collapse">
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
</div>
<nav class="collapse navbar-collapse bs-navbar-collapse" role="navigation">
<ul class="nav navbar-nav">
<li><a href="/index.html" id="home">Home</a></li>
<li><a href="/getting-help.html" id="getting-help">Getting Help</a></li>
<li><a href="/about/integrates.html" id="project-info">Project Information</a></li>
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown" id="documentation">Documentation <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="/releases/2.3.0/index.html">2.3.0</a></li>
<li><a href="/releases/2.2.0/index.html">2.2.0</a></li>
<li><a href="/releases/2.1.0/index.html">2.1.0</a></li>
<li><a href="/releases/2.0.0/index.html">2.0.0</a></li>
<li><a href="/releases/1.2.3/index.html">1.2.3</a></li>
</ul>
</li>
<li><a href="/talksAndVideos.html">Talks and Slideshows</a></li>
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown" id="contribute">Community <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="/contribute/Contributing-to-Storm.html">Contributing</a></li>
<li><a href="/contribute/People.html">People</a></li>
<li><a href="/contribute/BYLAWS.html">ByLaws</a></li>
</ul>
</li>
<li><a href="/2021/09/27/storm230-released.html" id="news">News</a></li>
</ul>
</nav>
</div>
</div>
<div class="container-fluid">
<h1 class="page-title">Documentation</h1>
<div class="row">
<div class="col-md-12">
<!-- Documentation -->
<p class="post-meta"></p>
<div class="documentation-content"><h3 id="basics-of-storm">Basics of Storm</h3>
<ul>
<li><a href="javadocs/index.html">Javadoc</a></li>
<li><a href="Tutorial.html">Tutorial</a></li>
<li><a href="Concepts.html">Concepts</a></li>
<li><a href="Storm-Scheduler.html">Scheduler</a></li>
<li><a href="Configuration.html">Configuration</a></li>
<li><a href="Guaranteeing-message-processing.html">Guaranteeing message processing</a></li>
<li><a href="Daemon-Fault-Tolerance.html">Daemon Fault Tolerance</a></li>
<li><a href="Command-line-client.html">Command line client</a></li>
<li><a href="STORM-UI-REST-API.html">REST API</a></li>
<li><a href="Understanding-the-parallelism-of-a-Storm-topology.html">Understanding the parallelism of a Storm topology</a></li>
<li><a href="FAQ.html">FAQ</a></li>
</ul>
<h3 id="layers-on-top-of-storm">Layers on top of Storm</h3>
<h4 id="trident">Trident</h4>
<p>Trident is an alternative interface to Storm. It provides exactly-once processing, &quot;transactional&quot; datastore persistence, and a set of common stream analytics operations.</p>
<ul>
<li><a href="Trident-tutorial.html">Trident Tutorial</a> -- basic concepts and walkthrough</li>
<li><a href="Trident-API-Overview.html">Trident API Overview</a> -- operations for transforming and orchestrating data</li>
<li><a href="Trident-state.html">Trident State</a> -- exactly-once processing and fast, persistent aggregation</li>
<li><a href="Trident-spouts.html">Trident spouts</a> -- transactional and non-transactional data intake</li>
<li><a href="Trident-RAS-API.html">Trident RAS API</a> -- using the Resource Aware Scheduler with Trident.</li>
</ul>
<h4 id="streams-api">Streams API</h4>
<p>Stream APIs is another alternative interface to Storm. It provides a typed API for expressing streaming computations and supports functional style operations.</p>
<p>NOTE: Streams API is an <code>experimental</code> feature, and further works might break backward compatibility.
We&#39;re also notifying it via annotating classes with marker interface <code>@InterfaceStability.Unstable</code>. </p>
<ul>
<li><a href="Stream-API.html">Streams API</a></li>
</ul>
<h4 id="sql">SQL</h4>
<p>The Storm SQL integration allows users to run SQL queries over streaming data in Storm. </p>
<p>NOTE: Storm SQL is an <code>experimental</code> feature, so the internals of Storm SQL and supported features are subject to change.
But small change will not affect the user experience. We will notify the user when breaking UX change is introduced.</p>
<ul>
<li><a href="storm-sql.html">Storm SQL overview</a></li>
<li><a href="storm-sql-example.html">Storm SQL example</a></li>
<li><a href="storm-sql-reference.html">Storm SQL reference</a></li>
<li><a href="storm-sql-internal.html">Storm SQL internal</a></li>
</ul>
<h4 id="flux">Flux</h4>
<ul>
<li><a href="flux.html">Flux Data Driven Topology Builder</a></li>
</ul>
<h3 id="setup-and-deploying">Setup and Deploying</h3>
<ul>
<li><a href="Setting-up-a-Storm-cluster.html">Setting up a Storm cluster</a></li>
<li><a href="Local-mode.html">Local mode</a></li>
<li><a href="Troubleshooting.html">Troubleshooting</a></li>
<li><a href="Running-topologies-on-a-production-cluster.html">Running topologies on a production cluster</a></li>
<li><a href="Maven.html">Building Storm</a> with Maven</li>
<li><a href="SECURITY.html">Setting up a Secure Cluster</a></li>
<li><a href="cgroups_in_storm.html">CGroup Enforcement</a></li>
<li><a href="Pacemaker.html">Pacemaker reduces load on zookeeper for large clusters</a></li>
<li><a href="Resource_Aware_Scheduler_overview.html">Resource Aware Scheduler</a></li>
<li><a href="ClusterMetrics.html">Daemon Metrics/Monitoring</a></li>
<li><a href="windows-users-guide.html">Windows users guide</a></li>
<li><a href="Classpath-handling.html">Classpath handling</a></li>
</ul>
<h3 id="intermediate">Intermediate</h3>
<ul>
<li><a href="Serialization.html">Serialization</a></li>
<li><a href="Common-patterns.html">Common patterns</a></li>
<li><a href="DSLs-and-multilang-adapters.html">DSLs and multilang adapters</a></li>
<li><a href="Using-non-JVM-languages-with-Storm.html">Using non-JVM languages with Storm</a></li>
<li><a href="Distributed-RPC.html">Distributed RPC</a></li>
<li><a href="Hooks.html">Hooks</a></li>
<li><a href="Metrics.html">Metrics (Deprecated)</a></li>
<li><a href="metrics_v2.html">Metrics V2</a></li>
<li><a href="State-checkpointing.html">State Checkpointing</a></li>
<li><a href="Windowing.html">Windowing</a></li>
<li><a href="Joins.html">Joining Streams</a></li>
<li><a href="distcache-blobstore.html">Blobstore(Distcache)</a></li>
</ul>
<h3 id="debugging">Debugging</h3>
<ul>
<li><a href="dynamic-log-level-settings.html">Dynamic Log Level Settings</a></li>
<li><a href="Logs.html">Searching Worker Logs</a></li>
<li><a href="dynamic-worker-profiling.html">Worker Profiling</a></li>
<li><a href="Eventlogging.html">Event Logging</a></li>
</ul>
<h3 id="integration-with-external-systems-and-other-libraries">Integration With External Systems, and Other Libraries</h3>
<ul>
<li><a href="storm-kafka-client.html">Apache Kafka Integration</a></li>
<li><a href="storm-hbase.html">Apache HBase Integration</a></li>
<li><a href="storm-hdfs.html">Apache HDFS Integration</a></li>
<li><a href="storm-hive.html">Apache Hive Integration</a></li>
<li><a href="storm-solr.html">Apache Solr Integration</a></li>
<li><a href="storm-cassandra.html">Apache Cassandra Integration</a></li>
<li><a href="storm-rocketmq.html">Apache RocketMQ Integration</a></li>
<li><a href="storm-jdbc.html">JDBC Integration</a></li>
<li><a href="storm-jms.html">JMS Integration</a></li>
<li><a href="storm-mqtt.html">MQTT Integration</a></li>
<li><a href="storm-redis.html">Redis Integration</a></li>
<li><a href="storm-eventhubs.html">Event Hubs Intergration</a></li>
<li><a href="storm-elasticsearch.html">Elasticsearch Integration</a></li>
<li><a href="storm-mongodb.html">Mongodb Integration</a></li>
<li><a href="storm-opentsdb.html">OpenTSDB Integration</a></li>
<li><a href="storm-kinesis.html">Kinesis Integration</a></li>
<li><a href="storm-pmml.html">PMML Integration</a></li>
<li><a href="Kestrel-and-Storm.html">Kestrel Integration</a></li>
</ul>
<h4 id="container-resource-management-system-integration">Container, Resource Management System Integration</h4>
<ul>
<li><a href="https://github.com/yahoo/storm-yarn">YARN Integration</a></li>
<li><a href="https://github.com/mesos/storm">Mesos Integration</a></li>
<li><a href="https://hub.docker.com/_/storm/">Docker Integration</a></li>
<li><a href="https://github.com/kubernetes/examples/tree/master/staging/storm">Kubernetes Integration</a></li>
</ul>
<h3 id="advanced">Advanced</h3>
<ul>
<li><a href="Defining-a-non-jvm-language-dsl-for-storm.html">Defining a non-JVM language DSL for Storm</a></li>
<li><a href="Multilang-protocol.html">Multilang protocol</a> (how to provide support for another language)</li>
<li><a href="Implementation-docs.html">Implementation docs</a></li>
<li><a href="storm-metricstore.html">Storm Metricstore</a></li>
</ul>
</div>
</div>
</div>
</div>
<footer>
<div class="container-fluid">
<div class="row">
<div class="col-md-3">
<div class="footer-widget">
<h5>Meetups</h5>
<ul class="latest-news">
<li><a href="http://www.meetup.com/Apache-Storm-Apache-Kafka/">Apache Storm & Apache Kafka</a> <span class="small">(Sunnyvale, CA)</span></li>
<li><a href="http://www.meetup.com/Apache-Storm-Kafka-Users/">Apache Storm & Kafka Users</a> <span class="small">(Seattle, WA)</span></li>
<li><a href="http://www.meetup.com/New-York-City-Storm-User-Group/">NYC Storm User Group</a> <span class="small">(New York, NY)</span></li>
<li><a href="http://www.meetup.com/Bay-Area-Stream-Processing">Bay Area Stream Processing</a> <span class="small">(Emeryville, CA)</span></li>
<li><a href="http://www.meetup.com/Boston-Storm-Users/">Boston Realtime Data</a> <span class="small">(Boston, MA)</span></li>
<li><a href="http://www.meetup.com/storm-london">London Storm User Group</a> <span class="small">(London, UK)</span></li>
<!-- <li><a href="http://www.meetup.com/Apache-Storm-Kafka-Users/">Seatle, WA</a> <span class="small">(27 Jun 2015)</span></li> -->
</ul>
</div>
</div>
<div class="col-md-3">
<div class="footer-widget">
<h5>About Apache Storm</h5>
<p>Apache Storm integrates with any queueing system and any database system. Apache Storm's spout abstraction makes it easy to integrate a new queuing system. Likewise, integrating Apache Storm with database systems is easy.</p>
</div>
</div>
<div class="col-md-3">
<div class="footer-widget">
<h5>First Look</h5>
<ul class="footer-list">
<li><a href="/releases/current/Rationale.html">Rationale</a></li>
<li><a href="/releases/current/Tutorial.html">Tutorial</a></li>
<li><a href="/releases/current/Setting-up-development-environment.html">Setting up development environment</a></li>
<li><a href="/releases/current/Creating-a-new-Storm-project.html">Creating a new Apache Storm project</a></li>
</ul>
</div>
</div>
<div class="col-md-3">
<div class="footer-widget">
<h5>Documentation</h5>
<ul class="footer-list">
<li><a href="/releases/current/index.html">Index</a></li>
<li><a href="/releases/current/javadocs/index.html">Javadoc</a></li>
<li><a href="/releases/current/FAQ.html">FAQ</a></li>
</ul>
</div>
</div>
</div>
<hr/>
<div class="row">
<div class="col-md-12">
<p align="center">Copyright © 2019 <a href="http://www.apache.org">Apache Software Foundation</a>. All Rights Reserved.
<br>Apache Storm, Apache, the Apache feather logo, and the Apache Storm project logos are trademarks of The Apache Software Foundation.
<br>All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
</div>
</div>
</div>
</footer>
<!--Footer End-->
<!-- Scroll to top -->
<span class="totop"><a href="#"><i class="fa fa-angle-up"></i></a></span>
</body>
</html>