Google Git
Sign in
apache / helix / ae22186c92a7b46c0056edb7de7149cd1e05bb6a
commitae22186c92a7b46c0056edb7de7149cd1e05bb6a[log] [tgz]
authorHunter Lee <hulee@linkedin.com>Mon Nov 04 18:04:34 2019 -0800
committerJiajun Wang <1803880+jiajunwang@users.noreply.github.com>Fri Feb 07 12:24:22 2020 -0800
tree69ec63fe8af971f8dd8bac0e3b4d875f6d5a8034
parentc2b7ac72bae6baa10899a451ffe1bc01342ec8fe [diff]
Avoid redundant writes in AssignmentMetadataStore (#564)

For the WAGED rebalancer, we persist the cluster's mapping via AssignmentMetadataStore every pipeline. However, if there are no changes made to the new assignment from the old assignment, this write is not necessary. This diff checks whether they are equal and skips the write if old and new assignments are the same.
2 files changed
tree: 69ec63fe8af971f8dd8bac0e3b4d875f6d5a8034
  1. helix-admin-webapp/
  2. helix-agent/
  3. helix-core/
  4. helix-front/
  5. helix-rest/
  6. recipes/
  7. scripts/
  8. website/
  9. .gitignore
  10. build
  11. bump-up.command
  12. deploySite.sh
  13. helix-style-intellij.xml
  14. helix-style.xml
  15. hpost-review.sh
  16. LICENSE
  17. NOTICE
  18. pom.xml
  19. README.md
README.md

Apache Helix

Helix is part of the Apache Software Foundation.

Project page: http://helix.apache.org/

Mailing list: http://helix.apache.org/mail-lists.html

Build

mvn clean install package -DskipTests

WHAT IS HELIX

Helix is a generic cluster management framework used for automatic management of partitioned, replicated and distributed resources hosted on a cluster of nodes. Helix provides the following features:

  1. Automatic assignment of resource/partition to nodes
  2. Node failure detection and recovery
  3. Dynamic addition of Resources
  4. Dynamic addition of nodes to the cluster
  5. Pluggable distributed state machine to manage the state of a resource via state transitions
  6. Automatic load balancing and throttling of transitions