Google Git
Sign in
apache / gravitino / refs/tags/kerberos-hive-ci-v0.1.4
tagef963d3b4d8f2bd6754f0fe3b6d4ee70b9279ea8
taggeryuqi <yuqi@datastrato.com>Mon Jul 22 15:10:17 2024 +0800
object2a2a190819315a6d67c8d5c83cbef216cbaff88c 
Release Kerberos Hive CI image v0.1.4
commit2a2a190819315a6d67c8d5c83cbef216cbaff88c[log] [tgz]
authorQi Yu <yuqi@datastrato.com>Mon Jul 22 15:08:50 2024 +0800
committerGitHub <noreply@github.com>Mon Jul 22 15:08:50 2024 +0800
treeb9f8a94d34b0552855ee0535143f10ce2d10b3e6
parent7d8f43476df34f0531e309246c96155f4a6af99a [diff]
[#4111] Limit port ranges in docker to reduce possible port conflicts for Hive docker. (#4106)

### What changes were proposed in this pull request?

1. Increase the timeout time for checking if Hive is writable from the
30s to 150 seconds.
2. Add some log information.  
3. Fix potential issues with port occupation for DataNode and NameNode.

### Why are the changes needed?

To improve CI stability. 
Fix: #4111 

### Does this PR introduce _any_ user-facing change?

N/A.

### How was this patch tested?

Existing test.
7 files changed
tree: b9f8a94d34b0552855ee0535143f10ce2d10b3e6
  1. .github/
  2. api/
  3. bin/
  4. catalogs/
  5. clients/
  6. common/
  7. conf/
  8. core/
  9. dev/
  10. docs/
  11. flink-connector/
  12. gradle/
  13. integration-test/
  14. integration-test-common/
  15. licenses/
  16. meta/
  17. rfc/
  18. scripts/
  19. server/
  20. server-common/
  21. spark-connector/
  22. trino-connector/
  23. web/
  24. .asf.yaml
  25. .gitattributes
  26. .gitignore
  27. build.gradle.kts
  28. CODE_OF_CONDUCT.md
  29. CONTRIBUTING.md
  30. DISCLAIMER_WIP.txt
  31. GOVERNANCE.md
  32. gradle.properties
  33. gradlew
  34. LICENSE
  35. LICENSE.bin
  36. MAINTAINERS.md
  37. NOTICE
  38. NOTICE.bin
  39. README.md
  40. ROADMAP.md
  41. SECURITY.md
  42. settings.gradle.kts
README.md

Apache Gravitino (incubating)

GitHub Actions Build GitHub Actions Integration Test License Contributors Release Open Issues Last Committed OpenSSF Best Practices

Introduction

Apache Gravitino is a high-performance, geo-distributed, and federated metadata lake. It manages the metadata directly in different sources, types, and regions. It also provides users with unified metadata access for data and AI assets.

Gravitino Architecture

Gravitino aims to provide several key features:

  • Single Source of Truth for multi-regional data with geo-distributed architecture support.
  • Unified Data and AI asset management for both users and engines.
  • Security in one place, centralizing the security for different sources.
  • Built-in data management and data access management.

Contributing to Apache Gravitino

Gravitino is open source software available under the Apache 2.0 license. For information on how to contribute to Gravitino please see the Contribution guidelines.

Online documentation

You can find the latest Gravitino documentation in the doc folder. This README file only contains basic setup instructions.

Building Apache Gravitino

You can build Gravitino using Gradle. Currently you can build Gravitino on Linux and macOS, Windows isn't supported.

To build Gravitino, please run:

./gradlew clean build -x test

If you want to build a distribution package, please run:

./gradlew compileDistribution -x test

to build a distribution package.

Or:

./gradlew assembleDistribution -x test

to build a compressed distribution package.

The directory distribution contains the generated binary distribution package.

For the details of building and testing Gravitino, please see How to build Gravitino.

Quick start

Configure and start the Apache Gravitino server

If you already have a binary distribution package, go to the directory of the decompressed package.

Before starting the Gravitino server, please configure the Gravitino server configuration file. The configuration file, gravitino.conf, is in the conf directory and follows the standard property file format. You can modify the configuration within this file.

To start the Gravitino server, please run:

./bin/gravitino.sh start

To stop the Gravitino server, please run:

./bin/gravitino.sh stop

Alternatively, to run the Gravitino server in frontend, please run:

./bin/gravitino.sh run

And press CTRL+C to stop the Gravitino server.

Using Trino with Apache Gravitino

Gravitino provides a Trino connector to access the metadata in Gravitino. To use Trino with Gravitino, please follow the trino-gravitino-connector doc.

Development guide

  1. How to build Gravitino
  2. How to test Gravitino
  3. How to publish Docker images

License

Gravitino is under the Apache License Version 2.0, See the LICENSE for the details.

ASF Incubator disclaimer

Apache Gravitino is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

Apache®, Apache Gravitino™, Apache Hadoop®, Apache Hive™, Apache Iceberg™, Apache Kafka®, Apache Spark™, Apache Submarine™, Apache Thrift™ and Apache Zeppelin™ are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.