tree e9b8d041feb5bf5f00bf0a8c8b4b3e40ce6de1aa
parent 1c0efe31a827884e8bf297e97ca5cbed9d13c93a
author Matthias Boehm <mboehm7@gmail.com> 1521755239 -0700
committer Matthias Boehm <mboehm7@gmail.com> 1521755239 -0700

[SYSTEMML-2204] Fix deregistration of parallelized RDDs on cleanup

This patch fixes the meta data handling of parallelized RDDs to allow
for proper deregistration during cleanup (e.g., on rmvar). With this
patch, we avoid unnecessarily conservative guarded parallelize by
correctly reflecting the currently consumed memory of live RDDs in the
driver.