Google Git
Sign in
apache / gobblin / refs/heads/revert-1223-master
commit9bcbfa2b0cfc553d0c42ccf1e17ce66424fb86cb[log] [tgz]
authorYingDai <ydai1124@users.noreply.github.com>Fri Sep 02 15:07:57 2016 -0700
committerGitHub <noreply@github.com>Fri Sep 02 15:07:57 2016 -0700
tree0be5795d8f2d23609e52ec54b4c42d3406ff309f
parent041fc719e7cf4ba8170ae1c4ad9fcd8e09c27afd [diff]
Revert "Initial commit for releasing 0.8.0"
1 file changed
tree: 0be5795d8f2d23609e52ec54b4c42d3406ff309f
  1. bin/
  2. conf/
  3. gobblin-admin/
  4. gobblin-api/
  5. gobblin-audit/
  6. gobblin-aws/
  7. gobblin-azkaban/
  8. gobblin-cluster/
  9. gobblin-compaction/
  10. gobblin-config-management/
  11. gobblin-core/
  12. gobblin-data-management/
  13. gobblin-distribution/
  14. gobblin-docs/
  15. gobblin-example/
  16. gobblin-hive-registration/
  17. gobblin-kafka/
  18. gobblin-metastore/
  19. gobblin-metrics/
  20. gobblin-oozie/
  21. gobblin-rest-service/
  22. gobblin-runtime/
  23. gobblin-salesforce/
  24. gobblin-test/
  25. gobblin-test-harness/
  26. gobblin-tunnel/
  27. gobblin-utility/
  28. gobblin-yarn/
  29. gradle/
  30. ligradle/
  31. maven-sonatype/
  32. travis/
  33. .gitignore
  34. .travis.yml
  35. build.gradle
  36. CHANGELOG.md
  37. defaultEnvironment.gradle
  38. gradle.properties
  39. gradlew
  40. gradlew.bat
  41. LICENSE
  42. mkdocs.yml
  43. NOTICE
  44. README.md
  45. readthedocs.yml
  46. settings.gradle
README.md

Gobblin Build Status Documentation Status

Gobblin is a universal data ingestion framework for extracting, transforming, and loading large volume of data from a variety of data sources, e.g., databases, rest APIs, FTP/SFTP servers, filers, etc., onto Hadoop. Gobblin handles the common routine tasks required for all data ingestion ETLs, including job/task scheduling, task partitioning, error handling, state management, data quality checking, data publishing, etc. Gobblin ingests data from different data sources in the same execution framework, and manages metadata of different sources all in one place. This, combined with other features such as auto scalability, fault tolerance, data quality assurance, extensibility, and the ability of handling data model evolution, makes Gobblin an easy-to-use, self-serving, and efficient data ingestion framework.

Quick Links

  • Documentation: Check out the Gobblin documentation for a complete description of Gobblin's features
  • Powered By: Check out the list of companies known to use Gobblin
  • Architecture: The Gobblin Architecture page has a full explanation of Gobblin's architecture
  • Getting Started with Gobblin: Refer to the Getting Started Guide on how to get started with Gobblin
  • Building Gobblin: Refer to the page Building Gobblin for directions on how to build Gobblin
  • Javadocs: The full JavaDocs for each released version of Gobblin can be found here