| commit | 3f237dff5a4582f25e8c284286d87e49eca22d84 | [log] [tgz] |
|---|---|---|
| author | Jiajun Wang <1803880+jiajunwang@users.noreply.github.com> | Fri Oct 25 21:56:46 2019 -0700 |
| committer | Jiajun Wang <1803880+jiajunwang@users.noreply.github.com> | Fri Feb 07 12:24:22 2020 -0800 |
| tree | 140f13027988f906f0187c62699962a01ac4acb1 | |
| parent | f48f4d2f1bd96bb0a1aa6147e4d864c0654c7e8d [diff] |
Refactor soft constraints to simply the algorithm and fix potential issues. (#520) * Refactor soft constraints to simply the algorithm and fix potential issues. 1. Check for zero weight so as to avoid unnecessary calculations. 2. Simply the soft constraint interfaces and implementations. Avoid duplicate code. 3. Adjust partition movements constraint logic to reduce the chance of moving partition when the baseline and best possible assignment diverge. 4. Estimate utilization in addition to the other usage estimation. The estimation will be used as a base when calculating the capacity usage score. This is to ensure the algorithm treats different clusters with different overall usage in the same way. 5. Fix the issue that high utilization calculation does not consider the current proposed replica usage. 6. Use Sigmoid to calculate usage-based soft constraints score. This enhances the assignment result of the algorithm. 7. Adjust the related test cases.
Helix is part of the Apache Software Foundation.
Project page: http://helix.apache.org/
Mailing list: http://helix.apache.org/mail-lists.html
mvn clean install package -DskipTests
Helix is a generic cluster management framework used for automatic management of partitioned, replicated and distributed resources hosted on a cluster of nodes. Helix provides the following features: