content/0.11/index.html - falcon - Git at Google

 <!DOCTYPE html>
 <!--
  | Generated by Apache Maven Doxia at 2018-03-12
  | Rendered using Apache Maven Fluido Skin 1.3.0
 -->
 <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
   <head>
     <meta charset="UTF-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" />
     <meta name="Date-Revision-yyyymmdd" content="20180312" />
     <meta http-equiv="Content-Language" content="en" />
     <title>Falcon - Falcon - Feed management and data processing platform</title>
     <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" />
     <link rel="stylesheet" href="./css/site.css" />
     <link rel="stylesheet" href="./css/print.css" media="print" />


     <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script>


 <script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script>

             </head>
         <body class="topBarDisabled">


         <div class="container">
           <div id="banner">
         <div class="pull-left">
                                 <div id="bannerLeft">
                                                                                                 <img src="images/falcon-logo.png"  alt="Apache Falcon" width="200px" height="45px"/>
                 </div>
                       </div>
         <div class="pull-right">  </div>
         <div class="clear"><hr/></div>
       </div>

       <div id="breadcrumbs">
         <ul class="breadcrumb">


                               <li class="">
                     <a href="index.html" title="Falcon">
         Falcon</a>
         </li>
       <li class="divider ">/</li>
         <li class="">Falcon - Feed management and data processing platform</li>


                   <li id="publishDate" class="pull-right">Last Published: 2018-03-12</li> <li class="divider pull-right">|</li>
               <li id="projectVersion" class="pull-right">Version: 0.11</li>

                             </ul>
       </div>


         <div id="bodyColumn" >

             <div class="section">
 <h2>Falcon - Feed management and data processing platform<a name="Falcon_-_Feed_management_and_data_processing_platform"></a></h2>
 <p>Falcon is a feed processing and feed management system aimed at making it easier for end consumers to onboard their feed processing and feed management on hadoop clusters.</p></div>
 <div class="section">
 <h3>Why?<a name="Why"></a></h3>
 <p></p>
 <ul>
 <li>Establishes relationship between various data and processing elements on a Hadoop environment</li></ul>
 <p></p>
 <ul>
 <li>Feed management services such as feed retention, replications across clusters, archival etc.</li></ul>
 <p></p>
 <ul>
 <li>Easy to onboard new workflows/pipelines, with support for late data handling, retry policies</li></ul>
 <p></p>
 <ul>
 <li>Integration with metastore/catalog such as Hive/HCatalog</li></ul>
 <p></p>
 <ul>
 <li>Provide notification to end customer based on availability of feed groups</li></ul>(logical group of related feeds, which are likely to be used together)
 <p></p>
 <ul>
 <li>Enables use cases for local processing in colo and global aggregations</li></ul>
 <p></p>
 <ul>
 <li>Captures Lineage information for feeds and processes</li></ul></div>
 <div class="section">
 <h2>Getting Started<a name="Getting_Started"></a></h2>
 <p>Start with these simple steps to install an falcon instance <a href="./InstallationSteps.html">Simple setup</a>. Also refer to Falcon architecture and documentation in <a href="./FalconDocumentation.html">Documentation</a>. <a href="./OnBoarding.html">On boarding</a> describes steps to on-board a pipeline to Falcon. It also gives a sample pipeline for reference. <a href="./EntitySpecification.html">Entity Specification</a> gives complete details of all Falcon entities.</p>
 <p><a href="./Falconcli/FalconCLI.html">Falcon CLI</a> implements <a href="./Restapi/ResourceList.html">Falcon's RESTful API</a> and describes various options for the command line utility provided by Falcon.</p>
 <p>Falcon provides OOTB <a href="./HiveIntegration.html">lifecycle management for Tables in Hive (HCatalog)</a> such as table replication for BCP and table eviction. Falcon also enforces <a href="./Security.html">Security</a> on protected resources and enables SSL.</p>
 <p><a name="LicenseInfo"></a></p></div>
 <div class="section">
 <h2>Licensing Information<a name="Licensing_Information"></a></h2>
 <p>Falcon is distributed under <a class="externalLink" href="http://www.apache.org/licenses/LICENSE-2.0">Apache License 2.0</a>.</p></div>
                   </div>
           </div>

     <hr/>

     <footer>
             <div class="container">
               <div class="row span12">Copyright &copy;                    2013-2018
                         <a href="http://www.apache.org">Apache Software Foundation</a>.
             All Rights Reserved.

       </div>


                 <p id="poweredBy" class="pull-right">
                           <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
         <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" />
       </a>
               </p>

                 </div>
     </footer>
   </body>
 </html>
	<!DOCTYPE html>
	<!--
	\| Generated by Apache Maven Doxia at 2018-03-12
	\| Rendered using Apache Maven Fluido Skin 1.3.0
	-->
	<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
	<head>
	<meta charset="UTF-8" />
	<meta name="viewport" content="width=device-width, initial-scale=1.0" />
	<meta name="Date-Revision-yyyymmdd" content="20180312" />
	<meta http-equiv="Content-Language" content="en" />
	<title>Falcon - Falcon - Feed management and data processing platform</title>
	<link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" />
	<link rel="stylesheet" href="./css/site.css" />
	<link rel="stylesheet" href="./css/print.css" media="print" />


	<script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script>



	<script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script>

	</head>
	<body class="topBarDisabled">




	<div class="container">
	<div id="banner">
	<div class="pull-left">
	<div id="bannerLeft">
	<img src="images/falcon-logo.png" alt="Apache Falcon" width="200px" height="45px"/>
	</div>
	</div>
	<div class="pull-right"> </div>
	<div class="clear"><hr/></div>
	</div>

	<div id="breadcrumbs">
	<ul class="breadcrumb">


	<li class="">
	<a href="index.html" title="Falcon">
	Falcon</a>
	</li>
	<li class="divider ">/</li>
	<li class="">Falcon - Feed management and data processing platform</li>



	<li id="publishDate" class="pull-right">Last Published: 2018-03-12</li> <li class="divider pull-right">\|</li>
	<li id="projectVersion" class="pull-right">Version: 0.11</li>

	</ul>
	</div>



	<div id="bodyColumn" >

	<div class="section">
	<h2>Falcon - Feed management and data processing platform<a name="Falcon_-_Feed_management_and_data_processing_platform"></a></h2>
	<p>Falcon is a feed processing and feed management system aimed at making it easier for end consumers to onboard their feed processing and feed management on hadoop clusters.</p></div>
	<div class="section">
	<h3>Why?<a name="Why"></a></h3>
	<p></p>
	<ul>
	<li>Establishes relationship between various data and processing elements on a Hadoop environment</li></ul>
	<p></p>
	<ul>
	<li>Feed management services such as feed retention, replications across clusters, archival etc.</li></ul>
	<p></p>
	<ul>
	<li>Easy to onboard new workflows/pipelines, with support for late data handling, retry policies</li></ul>
	<p></p>
	<ul>
	<li>Integration with metastore/catalog such as Hive/HCatalog</li></ul>
	<p></p>
	<ul>
	<li>Provide notification to end customer based on availability of feed groups</li></ul>(logical group of related feeds, which are likely to be used together)
	<p></p>
	<ul>
	<li>Enables use cases for local processing in colo and global aggregations</li></ul>
	<p></p>
	<ul>
	<li>Captures Lineage information for feeds and processes</li></ul></div>
	<div class="section">
	<h2>Getting Started<a name="Getting_Started"></a></h2>
	<p>Start with these simple steps to install an falcon instance <a href="./InstallationSteps.html">Simple setup</a>. Also refer to Falcon architecture and documentation in <a href="./FalconDocumentation.html">Documentation</a>. <a href="./OnBoarding.html">On boarding</a> describes steps to on-board a pipeline to Falcon. It also gives a sample pipeline for reference. <a href="./EntitySpecification.html">Entity Specification</a> gives complete details of all Falcon entities.</p>
	<p><a href="./Falconcli/FalconCLI.html">Falcon CLI</a> implements <a href="./Restapi/ResourceList.html">Falcon's RESTful API</a> and describes various options for the command line utility provided by Falcon.</p>
	<p>Falcon provides OOTB <a href="./HiveIntegration.html">lifecycle management for Tables in Hive (HCatalog)</a> such as table replication for BCP and table eviction. Falcon also enforces <a href="./Security.html">Security</a> on protected resources and enables SSL.</p>
	<p><a name="LicenseInfo"></a></p></div>
	<div class="section">
	<h2>Licensing Information<a name="Licensing_Information"></a></h2>
	<p>Falcon is distributed under <a class="externalLink" href="http://www.apache.org/licenses/LICENSE-2.0">Apache License 2.0</a>.</p></div>
	</div>
	</div>

	<hr/>

	<footer>
	<div class="container">
	<div class="row span12">Copyright © 2013-2018
	<a href="http://www.apache.org">Apache Software Foundation</a>.
	All Rights Reserved.

	</div>


	<p id="poweredBy" class="pull-right">
	<a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
	<img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" />
	</a>
	</p>

	</div>
	</footer>
	</body>
	</html>