tree 5356fe184b16f815d8df200cf7219735f00abe75
parent f308d56c560df52785e52456ece60ac74de49672
author Matthias Boehm <mboehm7@gmail.com> 1604163954 +0100
committer Matthias Boehm <mboehm7@gmail.com> 1604164732 +0100

[SYSTEMDS-2679] Fix dim size propagation for federated data ops

This patch fixes two issues that where encountered in federated
parameter servers. First, we fixed null pointer executions in the
cleanup of parallelized RDDs for the case of redundant cleanups. Second,
we fixed the size propagation for federated DataOps which so far was
never refreshed during recompilation after initial parsing. Each of
these fixes alone would already solve the reported bug, but the fixed
size propagation is important for all federated use cases in default
hybrid execution mode.