Google Git
Sign in
apache / incubator-hugegraph-computer

HugeGraph Computer - A distributed graph processing system for hugegraph (OLAP)

Mirrored from https://github.com/apache/incubator-hugegraph-computer.git
Clone this repo:

Branches

Tags

  1. 024d1aa chore: reduce mail to dev list (#255) by imbajin · 2 days ago master
  2. fcc3b56 doc(k8s): add building note for missing classes (#254) by conghuhu · 2 days ago
  3. 0b3c0b4 feat(core): isolate namespace for different input data source (#252) by Aaron Wang · 2 days ago
  4. e62ff3f doc: update readme & add QR code (#249) by M · 5 days ago
  5. be54f7d fix: superstep not take effect (#237) by YangJiaqi · 5 days ago

Apache HugeGraph-Computer

License Build Status codecov Docker Pulls

The hugegraph-computer is a distributed graph processing system for hugegraph. It is an implementation of Pregel. It runs on Kubernetes or YARN framework.

Features

  • Support distributed MPP graph computing, and integrates with HugeGraph as graph input/output storage.
  • Based on BSP(Bulk Synchronous Parallel) model, an algorithm performs computing through multiple parallel iterations, every iteration is a superstep.
  • Auto memory management. The framework will never be OOM(Out of Memory) since it will split some data to disk if it doesn't have enough memory to hold all the data.
  • The part of edges or the messages of super node can be in memory, so you will never lose it.
  • You can load the data from HDFS or HugeGraph, output the results to HDFS or HugeGraph, or adapt any other systems manually as needed.
  • Easy to develop a new algorithm. You just need to focus on a vertex only processing just like as in a single server, without worrying about message transfer and memory/storage management.

Learn More

The project homepage contains more information about hugegraph-computer.

And here are links of other repositories:

  1. hugegraph-server (graph's core component - OLTP server)
  2. hugegraph-toolchain (include loader/dashboard/tool/client)
  3. hugegraph-commons (include common & rpc module)
  4. hugegraph-website (include doc & website code)

Note

  • If some classes under computer-k8s cannot be found, you need to execute mvn clean install in advance to generate corresponding classes.

Contributing

Welcome to contribute, please see How to Contribute for more information

Note: It's recommended to use GitHub Desktop to greatly simplify the PR and commit process.

License

hugegraph-computer is licensed under Apache 2.0 License.

Contact Us