commit | 83c325d3bdb7ae29139171446bb43075878ff266 | [log] [tgz] |
---|---|---|
author | Zihan Li <zihli@linkedin.com> | Wed May 15 17:20:38 2024 -0700 |
committer | GitHub <noreply@github.com> | Wed May 15 17:20:38 2024 -0700 |
tree | b7af394c47dd2e903779b940c371b41b19d0e83a | |
parent | 2b2769f999582e2ed33c9201e7d4812ced672880 [diff] |
[GOBBLIN-2068]Make offset range in Gobblin Metadata pipeline configurable (#3949) * address comments * use connectionmanager when httpclient is not cloesable * [GOBBLIN-2068]Make offset range in Gobblin Metadata pipeline configurable * address comments * change variable name --------- Co-authored-by: Zihan Li <zihli@zihli-mn2.linkedin.biz>
Apache Gobblin is a highly scalable data management solution for structured and byte-oriented data in heterogeneous data ecosystems.
If building the distribution with tests turned on:
If you are going to build Gobblin from the source distribution, run the following command for downloading the gradle-wrapper.jar from Gobblin git repository to gradle/wrapper directory (replace GOBBLIN_VERSION in the URL with the version you downloaded).
wget --no-check-certificate -P gradle/wrapper https://github.com/apache/gobblin/raw/${GOBBLIN_VERSION}/gradle/wrapper/gradle-wrapper.jar
(or)
curl --insecure -L https://github.com/apache/gobblin/raw/${GOBBLIN_VERSION}/gradle/wrapper/gradle-wrapper.jar > gradle/wrapper/gradle-wrapper.jar
Alternatively, you can download it manually from: https://github.com/apache/gobblin/blob/${GOBBLIN_VERSION}/gradle/wrapper/gradle-wrapper.jar
Make sure that you download it to gradle/wrapper directory.
./gradlew rat
. Report will be generated under build/rat/rat-report.html./gradlew build -x findbugsMain -x test -x rat -x checkstyleMain
The distribution will be created in build/gobblin-distribution/distributions directory. (or)./gradlew build
The distribution will be created in build/gobblin-distribution/distributions directory.