tree 039bbe18a425ad5e5ebfd73156b45bc050244e6f
parent c9a02a2e9fa3ec50a2a8c3611d62a2a334b5bab3
author Matthias Boehm <mboehm7@gmail.com> 1597945580 +0200
committer Matthias Boehm <mboehm7@gmail.com> 1597946653 +0200

[SYSTEMDS-2624] Cleanup federated workers for repeated execution

This patch fixes the cleanup of federated workers to perform a full
cleanup of variables and execution context before and after every
execution. This change now enables keeping the federated workers as
standing executors and launch repeated coordinator jobs without any
conflicts of existing variables or unnecessary memory pressure and
evictions. Furthermore this also adds related Kmeans tests with multiple
runs (and reset ID sequences to provoke conflicts) as well as PCA tests
with more than two workers.