<!--
 ▄▄▄       ██▓███   ▄▄▄       ▄████▄   ██░ ██ ▓█████     ██▓  ▄████  ███▄    █  ██▓▄▄▄█████▓▓█████
▒████▄    ▓██░  ██▒▒████▄    ▒██▀ ▀█  ▓██░ ██▒▓█   ▀    ▓██▒ ██▒ ▀█▒ ██ ▀█   █ ▓██▒▓  ██▒ ▓▒▓█   ▀
▒██  ▀█▄  ▓██░ ██▓▒▒██  ▀█▄  ▒▓█    ▄ ▒██▀▀██░▒███      ▒██▒▒██░▄▄▄░▓██  ▀█ ██▒▒██▒▒ ▓██░ ▒░▒███
░██▄▄▄▄██ ▒██▄█▓▒ ▒░██▄▄▄▄██ ▒▓▓▄ ▄██▒░▓█ ░██ ▒▓█  ▄    ░██░░▓█  ██▓▓██▒  ▐▌██▒░██░░ ▓██▓ ░ ▒▓█  ▄
 ▓█   ▓██▒▒██▒ ░  ░ ▓█   ▓██▒▒ ▓███▀ ░░▓█▒░██▓░▒████▒   ░██░░▒▓███▀▒▒██░   ▓██░░██░  ▒██▒ ░ ░▒████▒
 ▒▒   ▓▒█░▒▓▒░ ░  ░ ▒▒   ▓▒█░░ ░▒ ▒  ░ ▒ ░░▒░▒░░ ▒░ ░   ░▓   ░▒   ▒ ░ ▒░   ▒ ▒ ░▓    ▒ ░░   ░░ ▒░ ░
  ▒   ▒▒ ░░▒ ░       ▒   ▒▒ ░  ░  ▒    ▒ ░▒░ ░ ░ ░  ░    ▒ ░  ░   ░ ░ ░░   ░ ▒░ ▒ ░    ░     ░ ░  ░
  ░   ▒   ░░         ░   ▒   ░         ░  ░░ ░   ░       ▒ ░░ ░   ░    ░   ░ ░  ▒ ░  ░         ░
      ░  ░               ░  ░░ ░       ░  ░  ░   ░  ░    ░        ░          ░  ░              ░  ░
-->

<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.  See the NOTICE file
distributed with this work for additional information
regarding copyright ownership.  The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License.  You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied.  See the License for the
specific language governing permissions and limitations
under the License.
-->

<!DOCTYPE html>
<html>
<head>
    <meta charset="utf-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <title>Apache Ignite - Shared Memory Layer for Spark</title>
    <link media="all" rel="stylesheet" href="/css/all.css">
    <link href="https://netdna.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.css" rel="stylesheet">
    <link media="all" rel="stylesheet" href="/css/syntaxhighlighter.css">
    <link href='https://fonts.googleapis.com/css?family=Open+Sans:400,300,300italic,400italic,600,600italic,700,700italic,800,800italic' rel='stylesheet' type='text/css'>

    <!--#include virtual="/includes/sh.html" -->
</head>
<body>
<div id="wrapper">
    <!--#include virtual="/includes/header.html" -->

    <main id="main" role="main" class="container">
        <section id="shared-memory-layer" class="page-section">
            <div class="col-sm-12 col-md-12 col-xs-12" style="padding:0 0 10px 0;">
                <div class="col-sm-6 col-md-6 col-xs-12" style="padding-left:0; padding-right:0">
                    <h2 class="first">Shared Memory Layer for Spark</h2>
                    <p>
                        Apache Ignite provides an implementation of Spark RDD abstraction which allows to easily
                        share state in memory across multiple Spark jobs, either within the same application
                        or between different Spark applications.
                    </p>
                    <div class="page-heading">Shared RDDs</div>
                    <p>
                        <code>IgniteRDD</code> is an implementation of native Spark RDD
                        and DataFrame APIs which, in addition to all the standard RDD
                        functionality, also shares the state of the RDD across other
                        Spark jobs, applications and workers.
                    </p>
                    <p>
                        Depending on the pre-configured deployment mode, the shared state may either exist only
                        during the lifespan of a Spark application (<code>embedded mode</code>), or it may out-survive
                        the Spark application (<code>standalone mode</code>), in which case the state can be shared across
                        multiple Spark applications.
                    </p>
                </div>

                <div class="col-sm-6 col-md-6 col-xs-12" style="padding-right:0">
                    <img class="first img-responsive" src="/images/spark-ignite-rdd.png" width="440px" style="float:right;"/>
                </div>
            </div>

            <div class="page-heading">In-Memory File System</div>
            <p>
                One of unique capabilities of Ignite is a distributed in-memory file system called
                Ignite File System (IGFS). IGFS delivers similar functionality to Hadoop HDFS, but
                only in memory. In fact, in addition to its own APIs, IGFS implements Hadoop FileSystem API
                and can be transparently plugged into Hadoop or Spark deployments.
            </p>
            <p>
                IGFS splits the data from each file into separate data blocks and stores them in
                a distributed in-memory cache. However, unlike Hadoop HDFS, IGFS does not need a name node
                and automatically determines file data locality using a hashing function.
            </p>
            <p>
                <a href="https://apacheignite-fs.readme.io/docs/ignitecontext-igniterdd" target="docs">
                    <b>Configure Shared Memory Layer <i class="fa fa-angle-double-right"></i></b>
                </a>
            </p>
        </section>
    </main>

    <!--#include virtual="/includes/footer.html" -->
</div>
<!--#include virtual="/includes/scripts.html" -->
</body>
</html>