Google Git
Sign in
apache / falcon / 3f1e0479213d74a71ed69d8877fc6a479e34b1e1
commit3f1e0479213d74a71ed69d8877fc6a479e34b1e1[log] [tgz]
authorPracheer Agarwal <pracheer.agarwal@inmobi.com>Tue Dec 27 14:13:29 2016 +0530
committerPallavi Rao <pallavi.rao@inmobi.com>Tue Dec 27 14:13:29 2016 +0530
treef8400ee9b1db7c0306b858b875b0657adb314dd2
parent9946758eac38d985a0c50fddee4267e8e320f7a2 [diff]
FALCON-2224 Change return type of extension APIs to APIResult

Author: Pracheer Agarwal <pracheer.agarwal@inmobi.com>

Reviewers: @sandeepSamudrala, @pallavi-rao

Closes #330 from PracheerAgarwal/APIResult and squashes the following commits:

2f62d03 [Pracheer Agarwal] resolved merge conficts
1c0d6fb [Pracheer Agarwal] resolved merge conficts
8e058e7 [Pracheer Agarwal] removed unused imports
ff1dbb4 [Pracheer Agarwal] FALCON-2224 added getExtensionDetail and getExtensions to AbstractFalconClient
533d507 [Pracheer Agarwal] FALCON-2224, Change return type of extension APIs to APIResult
46042fd [Pracheer Agarwal] Merge branch 'master' of https://github.com/PracheerAgarwal/falcon
daa3ffc [Pracheer Agarwal] FALCON-2225 extension owner added for trusted extensions
622cae4 [Pracheer Agarwal] FALCON-2225 extension owner added for trusted extensions
8 files changed
tree: f8400ee9b1db7c0306b858b875b0657adb314dd2
  1. acquisition/
  2. addons/
  3. archival/
  4. build-tools/
  5. cli/
  6. client/
  7. common/
  8. common-types/
  9. distro/
  10. docs/
  11. examples/
  12. extensions/
  13. falcon-regression/
  14. falcon-ui/
  15. hadoop-dependencies/
  16. html5-ui/
  17. lifecycle/
  18. messaging/
  19. metrics/
  20. monitoring/
  21. oozie/
  22. oozie-el-extensions/
  23. prism/
  24. release-docs/
  25. replication/
  26. rerun/
  27. retention/
  28. scheduler/
  29. shell/
  30. src/
  31. test-tools/
  32. test-util/
  33. titan/
  34. unit/
  35. webapp/
  36. .gitignore
  37. .reviewboardrc
  38. CHANGES.txt
  39. falcon_merge_pr.py
  40. Installation-steps.txt
  41. LICENSE.txt
  42. NOTICE.txt
  43. pom.xml
  44. README.md
README.md

Apache Falcon

Falcon is a feed processing and feed management system aimed at making it easier for end consumers to onboard their feed processing and feed management on hadoop clusters.

Why Apache Falcon?

  • Dependencies across various data processing pipelines are not easy to establish. Gaps here typically leads to either incorrect/partial processing or expensive reprocessing. Repeated duplicate definition of a single feed multiple times can lead to inconsistencies / issues.

  • Input data may not arrive always on time and it is required to kick off the processing without waiting for all data to arrive and accommodate late data separately

  • Feed management services such as feed retention, replications across clusters, archival etc are tasks that are burdensome on individual pipeline owners and better offered as a service for all customers.

  • It should be easy to onboard new workflows/pipelines

  • Smoother integration with metastore/catalog

  • Provide notification to end customer based on availability of feed groups (logical group of related feeds, which are likely to be used together)

Online Documentation

You can find the documentation on Apache Falcon website.

How to Contribute

Before opening a pull request, please go through the Contributing to Apache Falcon wiki. It lists steps that are required before creating a PR and the conventions that we follow. If you are looking for issues to pick up then you can look at starter tasks or open tasks

Release Notes

You can download release notes of previous releases from the following links.

0.8

0.7