| commit | 8054727ce160bf7e9707cee86b6ea2b77897a26e | [log] [tgz] |
|---|---|---|
| author | Pracheer Agarwal <pracheer.agarwal@inmobi.com> | Mon Jan 02 16:54:48 2017 +0530 |
| committer | Pallavi Rao <pallavi.rao@inmobi.com> | Mon Jan 02 16:54:48 2017 +0530 |
| tree | 313cde392a2b32d5827eaeb98550fb4b033afe4d | |
| parent | 9fdfe713f8d72e63fb45aaed93071cbde39b9eec [diff] |
FALCON-2197 enable and disable functionalities for extensions Author: Pracheer Agarwal <pracheer.agarwal@inmobi.com> Author: Pracheer Agarwal <pracheeragarwal@gmail.com> Reviewers: @sandeepSamudrala,@pallavi-rao Closes #328 from PracheerAgarwal/enableDisable and squashes the following commits: f141efc [Pracheer Agarwal] back merge dd6f9e9 [Pracheer Agarwal] back merge 7f17079 [Pracheer Agarwal] back merge 26b182f [Pracheer Agarwal] EC_UNRELATED_TYPES error fixes 5e60c83 [Pracheer Agarwal] checkstyle errors 3100641 [Pracheer Agarwal] bug fixes e9fabdf [Pracheer Agarwal] squashing the commits f4a08c8 [Pracheer Agarwal] # This is a combination of 3 commits. # This is the 1st commit message: FALCON-2197, status flag added for extensions for enable/disable funcnality 0793f2e [Pracheer Agarwal] FALCON-2221 back merge 62271b3 [Pracheer Agarwal] FALCON-2221 bug fixes for extension job submit ab830e4 [Pracheer Agarwal] FALCON-2197 adding disabled check for an extension while submitting jobs c47613a [Pracheer Agarwal] FALCON-2197 adding disabled check for an extension while submitting jobs 2d9fc53 [Pracheer Agarwal] FALCON-2197, extension flag value changed b39aea2 [Pracheer Agarwal] FALCON-2197, status flag added for extensions for enable/disable funcnality f885602 [Pracheer Agarwal] FALCON-2197, setting the default status flag for extensions 8a0c245 [Pracheer Agarwal] FALCON-2197, enable and disable functionalities for extensions 46042fd [Pracheer Agarwal] Merge branch 'master' of https://github.com/PracheerAgarwal/falcon daa3ffc [Pracheer Agarwal] FALCON-2225 extension owner added for trusted extensions 622cae4 [Pracheer Agarwal] FALCON-2225 extension owner added for trusted extensions
Falcon is a feed processing and feed management system aimed at making it easier for end consumers to onboard their feed processing and feed management on hadoop clusters.
Dependencies across various data processing pipelines are not easy to establish. Gaps here typically leads to either incorrect/partial processing or expensive reprocessing. Repeated duplicate definition of a single feed multiple times can lead to inconsistencies / issues.
Input data may not arrive always on time and it is required to kick off the processing without waiting for all data to arrive and accommodate late data separately
Feed management services such as feed retention, replications across clusters, archival etc are tasks that are burdensome on individual pipeline owners and better offered as a service for all customers.
It should be easy to onboard new workflows/pipelines
Smoother integration with metastore/catalog
Provide notification to end customer based on availability of feed groups (logical group of related feeds, which are likely to be used together)
You can find the documentation on Apache Falcon website.
Before opening a pull request, please go through the Contributing to Apache Falcon wiki. It lists steps that are required before creating a PR and the conventions that we follow. If you are looking for issues to pick up then you can look at starter tasks or open tasks
You can download release notes of previous releases from the following links.