Google Git
Sign in
apache / incubator-hugegraph-computer / 89a8f9b1f78ea78b8b9f29ad64ba5aeafff3bfac
commit89a8f9b1f78ea78b8b9f29ad64ba5aeafff3bfac[log] [tgz]
authorimbajin <jin@apache.org>Mon Dec 11 15:07:38 2023 +0800
committerGitHub <noreply@github.com>Mon Dec 11 15:07:38 2023 +0800
tree4b29a123fc0144d451db928ed034ac7d6d149c7d
parente0b484a65e2244ec49ef8bbc14185acd99dbc436 [diff]
refact(core): adaptor for common 1.2 & fix a string of possible CI problem (#286)

* chore(ci): update common 1.2 & upgrade action version

* replace HTTP_CODE

* Update codeql-analysis.yml

* Update pom.xml

* use docker image for server

* update webmockserver version to adapt okhttp4.x

* remove useless client

* Revert "remove useless client"

This reverts commit 3e894d34e31ce2a9e0366c0c8dd7cb66af6cc7cb.

* chore: replace loading data with docker & fix AssertThrows

* update loader image name

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* change path

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* fix name

* Update load-data-into-hugegraph.sh

* update ci logic

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update load-data-into-hugegraph.sh

* Update WorkerServiceTest.java

* update data path

* refactor WorkerServer

* update  the WokerService init & close logic

* Update MasterService.java

* CI passed & revert the ignore

* Update MessageRecvManagerTest.java

* enable 3rd party check

* Update license-checker.yml

* Update computer-core/src/main/java/org/apache/hugegraph/computer/core/worker/WorkerService.java

Co-authored-by: Cong Zhao <zhaocong@apache.org>

* Update MasterService.java

* tiny fix

---------

Co-authored-by: Cong Zhao <zhaocong@apache.org>
23 files changed
tree: 4b29a123fc0144d451db928ed034ac7d6d149c7d
  1. .github/
  2. computer-algorithm/
  3. computer-api/
  4. computer-core/
  5. computer-dist/
  6. computer-driver/
  7. computer-k8s/
  8. computer-k8s-operator/
  9. computer-test/
  10. computer-yarn/
  11. .asf.yaml
  12. .gitattributes
  13. .gitignore
  14. .licenserc.yaml
  15. checkstyle.xml
  16. DISCLAIMER
  17. LICENSE
  18. NOTICE
  19. pom.xml
  20. README.md
README.md

Apache HugeGraph-Computer

License Build Status codecov Docker Pulls

The hugegraph-computer is a distributed graph processing system for hugegraph. It is an implementation of Pregel. It runs on Kubernetes or YARN framework.

Features

  • Support distributed MPP graph computing, and integrates with HugeGraph as graph input/output storage.
  • Based on BSP(Bulk Synchronous Parallel) model, an algorithm performs computing through multiple parallel iterations, every iteration is a superstep.
  • Auto memory management. The framework will never be OOM(Out of Memory) since it will split some data to disk if it doesn't have enough memory to hold all the data.
  • The part of edges or the messages of super node can be in memory, so you will never lose it.
  • You can load the data from HDFS or HugeGraph, output the results to HDFS or HugeGraph, or adapt any other systems manually as needed.
  • Easy to develop a new algorithm. You just need to focus on a vertex only processing just like as in a single server, without worrying about message transfer and memory/storage management.

Learn More

The project homepage contains more information about hugegraph-computer.

And here are links of other repositories:

  1. hugegraph-server (graph's core component - OLTP server)
  2. hugegraph-toolchain (include loader/dashboard/tool/client)
  3. hugegraph-commons (include common & rpc module)
  4. hugegraph-website (include doc & website code)

Note

  • If some classes under computer-k8s cannot be found, you need to execute mvn clean install in advance to generate corresponding classes.

Contributing

Welcome to contribute, please see How to Contribute for more information

Note: It's recommended to use GitHub Desktop to greatly simplify the PR and commit process.

License

hugegraph-computer is licensed under Apache 2.0 License.

Contact Us