src/doc/4.0-rc2/architecture/overview.html - cassandra-website - Git at Google



 <!DOCTYPE html>
 <html class="writer-html5" lang="en" >
 <head>
   <meta charset="utf-8" />

   <meta name="viewport" content="width=device-width, initial-scale=1.0" />

   <title>Overview &mdash; Apache Cassandra Documentation v4.0-rc2</title>


   <link rel="stylesheet" href="../_static/css/theme.css" type="text/css" />
   <link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
     <link rel="stylesheet" href="../_static/extra.css" type="text/css" />


   <!--[if lt IE 9]>
     <script src="../_static/js/html5shiv.min.js"></script>
   <![endif]-->


       <script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
         <script src="../_static/jquery.js"></script>
         <script src="../_static/underscore.js"></script>
         <script src="../_static/doctools.js"></script>

     <script type="text/javascript" src="../_static/js/theme.js"></script>


     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
     <link rel="next" title="Dynamo" href="dynamo.html" />
     <link rel="prev" title="Architecture" href="index.html" />
 </head>

 <body class="wy-body-for-nav">


   <div class="wy-grid-for-nav">

     <nav data-toggle="wy-nav-shift" class="wy-nav-side">
       <div class="wy-side-scroll">
         <div class="wy-side-nav-search" >


             <a href="../index.html" class="icon icon-home"> Apache Cassandra


           </a>


               <div class="version">
                 4.0-rc2
               </div>


 <div role="search">
   <form id="rtd-search-form" class="wy-form" action="../search.html" method="get">
     <input type="text" name="q" placeholder="Search docs" />
     <input type="hidden" name="check_keywords" value="yes" />
     <input type="hidden" name="area" value="default" />
   </form>
 </div>


         </div>


         <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">


               <ul class="current">
 <li class="toctree-l1"><a class="reference internal" href="../getting_started/index.html">Getting Started</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../new/index.html">New Features in Apache Cassandra 4.0</a></li>
 <li class="toctree-l1 current"><a class="reference internal" href="index.html">Architecture</a><ul class="current">
 <li class="toctree-l2 current"><a class="current reference internal" href="#">Overview</a><ul>
 <li class="toctree-l3"><a class="reference internal" href="#features">Features</a></li>
 <li class="toctree-l3"><a class="reference internal" href="#operating">Operating</a></li>
 </ul>
 </li>
 <li class="toctree-l2"><a class="reference internal" href="dynamo.html">Dynamo</a></li>
 <li class="toctree-l2"><a class="reference internal" href="storage_engine.html">Storage Engine</a></li>
 <li class="toctree-l2"><a class="reference internal" href="guarantees.html">Guarantees</a></li>
 </ul>
 </li>
 <li class="toctree-l1"><a class="reference internal" href="../cql/index.html">The Cassandra Query Language (CQL)</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../data_modeling/index.html">Data Modeling</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../configuration/index.html">Configuring Cassandra</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../operating/index.html">Operating Cassandra</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../tools/index.html">Cassandra Tools</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../troubleshooting/index.html">Troubleshooting</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../development/index.html">Contributing to Cassandra</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../faq/index.html">Frequently Asked Questions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../plugins/index.html">Third-Party Plugins</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../bugs.html">Reporting Bugs</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../contactus.html">Contact us</a></li>
 </ul>


         </div>

       </div>
     </nav>

     <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">


       <nav class="wy-nav-top" aria-label="top navigation">

           <i data-toggle="wy-nav-top" class="fa fa-bars"></i>
           <a href="../index.html">Apache Cassandra</a>

       </nav>


       <div class="wy-nav-content">

         <div class="rst-content">


 <div role="navigation" aria-label="breadcrumbs navigation">

   <ul class="wy-breadcrumbs">

       <li><a href="../index.html" class="icon icon-home"></a> &raquo;</li>

           <li><a href="index.html">Architecture</a> &raquo;</li>

       <li>Overview</li>


       <li class="wy-breadcrumbs-aside">


             <a href="../_sources/architecture/overview.rst.txt" rel="nofollow"> View page source</a>


       </li>

   </ul>


   <hr/>
 </div>
           <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
            <div itemprop="articleBody">

   <div class="section" id="overview">
 <span id="id1"></span><h1>Overview<a class="headerlink" href="#overview" title="Permalink to this headline">¶</a></h1>
 <p>Apache Cassandra is an open source, distributed, NoSQL database. It presents
 a partitioned wide column storage model with eventually consistent semantics.</p>
 <p>Apache Cassandra was initially designed at <a class="reference external" href="https://www.cs.cornell.edu/projects/ladis2009/papers/lakshman-ladis2009.pdf">Facebook</a>
 using a staged event-driven architecture (<a class="reference external" href="http://www.sosp.org/2001/papers/welsh.pdf">SEDA</a>) to implement a combination of
 Amazon’s <a class="reference external" href="http://courses.cse.tamu.edu/caverlee/csce438/readings/dynamo-paper.pdf">Dynamo</a>
 distributed storage and replication techniques combined with Google’s <a class="reference external" href="https://static.googleusercontent.com/media/research.google.com/en//archive/bigtable-osdi06.pdf">Bigtable</a>
 data and storage engine model. Dynamo and Bigtable were both developed to meet
 emerging requirements for scalable, reliable and highly available storage
 systems, but each had areas that could be improved.</p>
 <p>Cassandra was designed as a best in class combination of both systems to meet
 emerging large scale, both in data footprint and query volume, storage
 requirements. As applications began to require full global replication and
 always available low-latency reads and writes, it became imperative to design a
 new kind of database model as the relational database systems of the time
 struggled to meet the new requirements of global scale applications.</p>
 <p>Systems like Cassandra are designed for these challenges and seek the
 following design objectives:</p>
 <ul class="simple">
 <li><p>Full multi-master database replication</p></li>
 <li><p>Global availability at low latency</p></li>
 <li><p>Scaling out on commodity hardware</p></li>
 <li><p>Linear throughput increase with each additional processor</p></li>
 <li><p>Online load balancing and cluster growth</p></li>
 <li><p>Partitioned key-oriented queries</p></li>
 <li><p>Flexible schema</p></li>
 </ul>
 <div class="section" id="features">
 <h2>Features<a class="headerlink" href="#features" title="Permalink to this headline">¶</a></h2>
 <p>Cassandra provides the Cassandra Query Language (CQL), an SQL-like language,
 to create and update database schema and access data. CQL allows users to
 organize data within a cluster of Cassandra nodes using:</p>
 <ul class="simple">
 <li><p><strong>Keyspace</strong>: defines how a dataset is replicated, for example in which
 datacenters and how many copies. Keyspaces contain tables.</p></li>
 <li><p><strong>Table</strong>: defines the typed schema for a collection of partitions. Cassandra
 tables have flexible addition of new columns to tables with zero downtime.
 Tables contain partitions, which contain partitions, which contain columns.</p></li>
 <li><p><strong>Partition</strong>: defines the mandatory part of the primary key all rows in
 Cassandra must have. All performant queries supply the partition key in
 the query.</p></li>
 <li><p><strong>Row</strong>: contains a collection of columns identified by a unique primary key
 made up of the partition key and optionally additional clustering keys.</p></li>
 <li><p><strong>Column</strong>: A single datum with a type which belong to a row.</p></li>
 </ul>
 <p>CQL supports numerous advanced features over a partitioned dataset such as:</p>
 <ul class="simple">
 <li><p>Single partition lightweight transactions with atomic compare and set
 semantics.</p></li>
 <li><p>User-defined types, functions and aggregates</p></li>
 <li><p>Collection types including sets, maps, and lists.</p></li>
 <li><p>Local secondary indices</p></li>
 <li><p>(Experimental) materialized views</p></li>
 </ul>
 <p>Cassandra explicitly chooses not to implement operations that require cross
 partition coordination as they are typically slow and hard to provide highly
 available global semantics. For example Cassandra does not support:</p>
 <ul class="simple">
 <li><p>Cross partition transactions</p></li>
 <li><p>Distributed joins</p></li>
 <li><p>Foreign keys or referential integrity.</p></li>
 </ul>
 </div>
 <div class="section" id="operating">
 <h2>Operating<a class="headerlink" href="#operating" title="Permalink to this headline">¶</a></h2>
 <p>Apache Cassandra configuration settings are configured in the <code class="docutils literal notranslate"><span class="pre">cassandra.yaml</span></code>
 file that can be edited by hand or with the aid of configuration management tools.
 Some settings can be manipulated live using an online interface, but others
 require a restart of the database to take effect.</p>
 <p>Cassandra provides tools for managing a cluster. The <code class="docutils literal notranslate"><span class="pre">nodetool</span></code> command
 interacts with Cassandra’s live control interface, allowing runtime manipulation
 of many settings from <code class="docutils literal notranslate"><span class="pre">cassandra.yaml</span></code>. The <code class="docutils literal notranslate"><span class="pre">auditlogviewer</span></code> is used
 to view the audit logs. The  <code class="docutils literal notranslate"><span class="pre">fqltool</span></code> is used to view, replay and compare
 full query logs.  The <code class="docutils literal notranslate"><span class="pre">auditlogviewer</span></code> and <code class="docutils literal notranslate"><span class="pre">fqltool</span></code> are new tools in
 Apache Cassandra 4.0.</p>
 <p>In addition, Cassandra supports out of the box atomic snapshot functionality,
 which presents a point in time snapshot of Cassandra’s data for easy
 integration with many backup tools. Cassandra also supports incremental backups
 where data can be backed up as it is written.</p>
 <p>Apache Cassandra 4.0 has added several new features including virtual tables.
 transient replication, audit logging, full query logging, and support for Java
 11. Two of these features are experimental: transient replication and Java 11
 support.</p>
 </div>
 </div>


            </div>

           </div>
           <footer>
     <div class="rst-footer-buttons" role="navigation" aria-label="footer navigation">
         <a href="dynamo.html" class="btn btn-neutral float-right" title="Dynamo" accesskey="n" rel="next">Next <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
         <a href="index.html" class="btn btn-neutral float-left" title="Architecture" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> Previous</a>
     </div>

   <hr/>

   <div role="contentinfo">
     <p>
         &#169; Copyright 2020, The Apache Cassandra team.

     </p>
   </div>


     Built with <a href="https://www.sphinx-doc.org/">Sphinx</a> using a

     <a href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>

     provided by <a href="https://readthedocs.org">Read the Docs</a>.

 </footer>
         </div>
       </div>

     </section>

   </div>


   <script type="text/javascript">
       jQuery(function () {
           SphinxRtdTheme.Navigation.enable(true);
       });
   </script>


 </body>
 </html>


	<!DOCTYPE html>
	<html class="writer-html5" lang="en" >
	<head>
	<meta charset="utf-8" />

	<meta name="viewport" content="width=device-width, initial-scale=1.0" />

	<title>Overview — Apache Cassandra Documentation v4.0-rc2</title>



	<link rel="stylesheet" href="../_static/css/theme.css" type="text/css" />
	<link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
	<link rel="stylesheet" href="../_static/extra.css" type="text/css" />










	<!--[if lt IE 9]>
	<script src="../_static/js/html5shiv.min.js"></script>
	<![endif]-->


	<script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
	<script src="../_static/jquery.js"></script>
	<script src="../_static/underscore.js"></script>
	<script src="../_static/doctools.js"></script>

	<script type="text/javascript" src="../_static/js/theme.js"></script>


	<link rel="index" title="Index" href="../genindex.html" />
	<link rel="search" title="Search" href="../search.html" />
	<link rel="next" title="Dynamo" href="dynamo.html" />
	<link rel="prev" title="Architecture" href="index.html" />
	</head>

	<body class="wy-body-for-nav">


	<div class="wy-grid-for-nav">

	<nav data-toggle="wy-nav-shift" class="wy-nav-side">
	<div class="wy-side-scroll">
	<div class="wy-side-nav-search" >



	<a href="../index.html" class="icon icon-home"> Apache Cassandra



	</a>




	<div class="version">
	4.0-rc2
	</div>




	<div role="search">
	<form id="rtd-search-form" class="wy-form" action="../search.html" method="get">
	<input type="text" name="q" placeholder="Search docs" />
	<input type="hidden" name="check_keywords" value="yes" />
	<input type="hidden" name="area" value="default" />
	</form>
	</div>


	</div>


	<div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">






	<ul class="current">
	<li class="toctree-l1"><a class="reference internal" href="../getting_started/index.html">Getting Started</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../new/index.html">New Features in Apache Cassandra 4.0</a></li>
	<li class="toctree-l1 current"><a class="reference internal" href="index.html">Architecture</a><ul class="current">
	<li class="toctree-l2 current"><a class="current reference internal" href="#">Overview</a><ul>
	<li class="toctree-l3"><a class="reference internal" href="#features">Features</a></li>
	<li class="toctree-l3"><a class="reference internal" href="#operating">Operating</a></li>
	</ul>
	</li>
	<li class="toctree-l2"><a class="reference internal" href="dynamo.html">Dynamo</a></li>
	<li class="toctree-l2"><a class="reference internal" href="storage_engine.html">Storage Engine</a></li>
	<li class="toctree-l2"><a class="reference internal" href="guarantees.html">Guarantees</a></li>
	</ul>
	</li>
	<li class="toctree-l1"><a class="reference internal" href="../cql/index.html">The Cassandra Query Language (CQL)</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../data_modeling/index.html">Data Modeling</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../configuration/index.html">Configuring Cassandra</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../operating/index.html">Operating Cassandra</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../tools/index.html">Cassandra Tools</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../troubleshooting/index.html">Troubleshooting</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../development/index.html">Contributing to Cassandra</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../faq/index.html">Frequently Asked Questions</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../plugins/index.html">Third-Party Plugins</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../bugs.html">Reporting Bugs</a></li>
	<li class="toctree-l1"><a class="reference internal" href="../contactus.html">Contact us</a></li>
	</ul>



	</div>

	</div>
	</nav>

	<section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">


	<nav class="wy-nav-top" aria-label="top navigation">

	<i data-toggle="wy-nav-top" class="fa fa-bars"></i>
	<a href="../index.html">Apache Cassandra</a>

	</nav>


	<div class="wy-nav-content">

	<div class="rst-content">



















	<div role="navigation" aria-label="breadcrumbs navigation">

	<ul class="wy-breadcrumbs">

	<li><a href="../index.html" class="icon icon-home"></a> »</li>

	<li><a href="index.html">Architecture</a> »</li>

	<li>Overview</li>


	<li class="wy-breadcrumbs-aside">


	<a href="../_sources/architecture/overview.rst.txt" rel="nofollow"> View page source</a>


	</li>

	</ul>


	<hr/>
	</div>
	<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
	<div itemprop="articleBody">

	<div class="section" id="overview">
	<span id="id1"></span><h1>Overview<a class="headerlink" href="#overview" title="Permalink to this headline">¶</a></h1>
	<p>Apache Cassandra is an open source, distributed, NoSQL database. It presents
	a partitioned wide column storage model with eventually consistent semantics.</p>
	<p>Apache Cassandra was initially designed at <a class="reference external" href="https://www.cs.cornell.edu/projects/ladis2009/papers/lakshman-ladis2009.pdf">Facebook</a>
	using a staged event-driven architecture (<a class="reference external" href="http://www.sosp.org/2001/papers/welsh.pdf">SEDA</a>) to implement a combination of
	Amazon’s <a class="reference external" href="http://courses.cse.tamu.edu/caverlee/csce438/readings/dynamo-paper.pdf">Dynamo</a>
	distributed storage and replication techniques combined with Google’s <a class="reference external" href="https://static.googleusercontent.com/media/research.google.com/en//archive/bigtable-osdi06.pdf">Bigtable</a>
	data and storage engine model. Dynamo and Bigtable were both developed to meet
	emerging requirements for scalable, reliable and highly available storage
	systems, but each had areas that could be improved.</p>
	<p>Cassandra was designed as a best in class combination of both systems to meet
	emerging large scale, both in data footprint and query volume, storage
	requirements. As applications began to require full global replication and
	always available low-latency reads and writes, it became imperative to design a
	new kind of database model as the relational database systems of the time
	struggled to meet the new requirements of global scale applications.</p>
	<p>Systems like Cassandra are designed for these challenges and seek the
	following design objectives:</p>
	<ul class="simple">
	<li><p>Full multi-master database replication</p></li>
	<li><p>Global availability at low latency</p></li>
	<li><p>Scaling out on commodity hardware</p></li>
	<li><p>Linear throughput increase with each additional processor</p></li>
	<li><p>Online load balancing and cluster growth</p></li>
	<li><p>Partitioned key-oriented queries</p></li>
	<li><p>Flexible schema</p></li>
	</ul>
	<div class="section" id="features">
	<h2>Features<a class="headerlink" href="#features" title="Permalink to this headline">¶</a></h2>
	<p>Cassandra provides the Cassandra Query Language (CQL), an SQL-like language,
	to create and update database schema and access data. CQL allows users to
	organize data within a cluster of Cassandra nodes using:</p>
	<ul class="simple">
	<li><p><strong>Keyspace</strong>: defines how a dataset is replicated, for example in which
	datacenters and how many copies. Keyspaces contain tables.</p></li>
	<li><p><strong>Table</strong>: defines the typed schema for a collection of partitions. Cassandra
	tables have flexible addition of new columns to tables with zero downtime.
	Tables contain partitions, which contain partitions, which contain columns.</p></li>
	<li><p><strong>Partition</strong>: defines the mandatory part of the primary key all rows in
	Cassandra must have. All performant queries supply the partition key in
	the query.</p></li>
	<li><p><strong>Row</strong>: contains a collection of columns identified by a unique primary key
	made up of the partition key and optionally additional clustering keys.</p></li>
	<li><p><strong>Column</strong>: A single datum with a type which belong to a row.</p></li>
	</ul>
	<p>CQL supports numerous advanced features over a partitioned dataset such as:</p>
	<ul class="simple">
	<li><p>Single partition lightweight transactions with atomic compare and set
	semantics.</p></li>
	<li><p>User-defined types, functions and aggregates</p></li>
	<li><p>Collection types including sets, maps, and lists.</p></li>
	<li><p>Local secondary indices</p></li>
	<li><p>(Experimental) materialized views</p></li>
	</ul>
	<p>Cassandra explicitly chooses not to implement operations that require cross
	partition coordination as they are typically slow and hard to provide highly
	available global semantics. For example Cassandra does not support:</p>
	<ul class="simple">
	<li><p>Cross partition transactions</p></li>
	<li><p>Distributed joins</p></li>
	<li><p>Foreign keys or referential integrity.</p></li>
	</ul>
	</div>
	<div class="section" id="operating">
	<h2>Operating<a class="headerlink" href="#operating" title="Permalink to this headline">¶</a></h2>
	<p>Apache Cassandra configuration settings are configured in the <code class="docutils literal notranslate"><span class="pre">cassandra.yaml</span></code>
	file that can be edited by hand or with the aid of configuration management tools.
	Some settings can be manipulated live using an online interface, but others
	require a restart of the database to take effect.</p>
	<p>Cassandra provides tools for managing a cluster. The <code class="docutils literal notranslate"><span class="pre">nodetool</span></code> command
	interacts with Cassandra’s live control interface, allowing runtime manipulation
	of many settings from <code class="docutils literal notranslate"><span class="pre">cassandra.yaml</span></code>. The <code class="docutils literal notranslate"><span class="pre">auditlogviewer</span></code> is used
	to view the audit logs. The <code class="docutils literal notranslate"><span class="pre">fqltool</span></code> is used to view, replay and compare
	full query logs. The <code class="docutils literal notranslate"><span class="pre">auditlogviewer</span></code> and <code class="docutils literal notranslate"><span class="pre">fqltool</span></code> are new tools in
	Apache Cassandra 4.0.</p>
	<p>In addition, Cassandra supports out of the box atomic snapshot functionality,
	which presents a point in time snapshot of Cassandra’s data for easy
	integration with many backup tools. Cassandra also supports incremental backups
	where data can be backed up as it is written.</p>
	<p>Apache Cassandra 4.0 has added several new features including virtual tables.
	transient replication, audit logging, full query logging, and support for Java
	11. Two of these features are experimental: transient replication and Java 11
	support.</p>
	</div>
	</div>


	</div>

	</div>
	<footer>
	<div class="rst-footer-buttons" role="navigation" aria-label="footer navigation">
	<a href="dynamo.html" class="btn btn-neutral float-right" title="Dynamo" accesskey="n" rel="next">Next <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
	<a href="index.html" class="btn btn-neutral float-left" title="Architecture" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> Previous</a>
	</div>

	<hr/>

	<div role="contentinfo">
	<p>
	© Copyright 2020, The Apache Cassandra team.

	</p>
	</div>



	Built with <a href="https://www.sphinx-doc.org/">Sphinx</a> using a

	<a href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>

	provided by <a href="https://readthedocs.org">Read the Docs</a>.

	</footer>
	</div>
	</div>

	</section>

	</div>


	<script type="text/javascript">
	jQuery(function () {
	SphinxRtdTheme.Navigation.enable(true);
	});
	</script>






	</body>
	</html>