Google Git
Sign in
apache / gobblin / refs/heads/0.15.0-rc1
commitdec03666692a2aa20307fd5266538023a85348bc[log] [tgz]
authorsuvasude <suvasude@linkedin.biz>Tue Oct 13 13:11:42 2020 -0700
committersuvasude <suvasude@linkedin.biz>Tue Oct 13 13:11:42 2020 -0700
tree54ca10d4fd429d643460fb98e0956841eb41baff
parent655b8ebcf5a570d34559003ced7005531d04fcb3 [diff]
[GOBBLIN-1288] Update CHANGELOG[]

Closes #3127 from sv2000/updateChangeLog
1 file changed
tree: 54ca10d4fd429d643460fb98e0956841eb41baff
  1. .github/
  2. bin/
  3. buildSrc/
  4. conf/
  5. config/
  6. dev/
  7. gobblin-admin/
  8. gobblin-all/
  9. gobblin-api/
  10. gobblin-audit/
  11. gobblin-aws/
  12. gobblin-binary-management/
  13. gobblin-cluster/
  14. gobblin-compaction/
  15. gobblin-config-management/
  16. gobblin-core/
  17. gobblin-core-base/
  18. gobblin-data-management/
  19. gobblin-distribution/
  20. gobblin-docker/
  21. gobblin-docs/
  22. gobblin-example/
  23. gobblin-hive-registration/
  24. gobblin-kubernetes/
  25. gobblin-metastore/
  26. gobblin-metrics-libs/
  27. gobblin-modules/
  28. gobblin-oozie/
  29. gobblin-rest-service/
  30. gobblin-restli/
  31. gobblin-runtime/
  32. gobblin-runtime-hadoop/
  33. gobblin-salesforce/
  34. gobblin-service/
  35. gobblin-test/
  36. gobblin-test-harness/
  37. gobblin-test-utils/
  38. gobblin-tunnel/
  39. gobblin-utility/
  40. gobblin-yarn/
  41. gradle/
  42. ligradle/
  43. maven-nexus/
  44. maven-sonatype/
  45. travis/
  46. .codecov_bash
  47. .dockerignore
  48. .gitignore
  49. .travis.yml
  50. build.gradle
  51. CHANGELOG.md
  52. defaultEnvironment.gradle
  53. DISCLAIMER
  54. gobblin-flavored-build.gradle
  55. gradle.properties
  56. gradlew
  57. gradlew.bat
  58. HEADER
  59. LICENSE
  60. mkdocs.yml
  61. NOTICE
  62. query_github_issues.py
  63. README.md
  64. readthedocs.yml
  65. settings.gradle
README.md

Apache Gobblin

Build Status Documentation Status Maven Central Stack Overflow Get on Slack codecov.io

Apache Gobblin is a universal data ingestion framework for extracting, transforming, and loading large volume of data from a variety of data sources: databases, rest APIs, FTP/SFTP servers, filers, etc., onto Hadoop.

Apache Gobblin handles the common routine tasks required for all data ingestion ETLs, including job/task scheduling, task partitioning, error handling, state management, data quality checking, data publishing, etc.

Gobblin ingests data from different data sources in the same execution framework, and manages metadata of different sources all in one place. This, combined with other features such as auto scalability, fault tolerance, data quality assurance, extensibility, and the ability of handling data model evolution, makes Gobblin an easy-to-use, self-serving, and efficient data ingestion framework.

Requirements

  • Java >= 1.8
  • gradle-wrapper.jar version 2.13

If building the distribution with tests turned on:

  • Maven version 3.5.3

Instructions to download gradle wrapper

Run the following command for downloading the gradle-wrapper.jar from Gobblin git repository to gradle/wrapper directory.

wget --no-check-certificate -P gradle/wrapper https://github.com/apache/incubator-gobblin/raw/0.12.0/gradle/wrapper/gradle-wrapper.jar (or) curl --insecure -L https://github.com/apache/incubator-gobblin/raw/0.12.0/gradle/wrapper/gradle-wrapper.jar > gradle/wrapper/gradle-wrapper.jar

Alternatively, you can download it manually from: https://github.com/apache/incubator-gobblin/blob/0.12.0/gradle/wrapper/gradle-wrapper.jar

Make sure that you download it to gradle/wrapper directory.

Instructions to run Apache RAT (Release Audit Tool)

  1. Extract the archive file to your local directory.
  2. Download gradle-wrapper.jar (version 2.13) and place it in the gradle/wrapper folder. See ‘Instructions to download gradle wrapper’ above.
  3. Run ./gradlew rat. Report will be generated under build/rat/rat-report.html

Instructions to build the distribution

  1. Extract the archive file to your local directory.
  2. Download gradle-wrapper.jar (version 2.13) and place it in the gradle/wrapper folder. See ‘Instructions to download gradle wrapper’ above.
  3. Skip tests and build the distribution: Run ./gradlew build -x findbugsMain -x test -x rat -x checkstyleMain The distribution will be created in build/gobblin-distribution/distributions directory. (or)
  4. Run tests and build the distribution (requires Maven): Run ./gradlew build The distribution will be created in build/gobblin-distribution/distributions directory.

Quick Links