tree 3d0be75077d82c19c744a02e26014ed8ede705f6
parent 7adaa97d3ddf4e192ae42fea88f6911a7f747343
author Julia Wang <jwang98052@yahoo.com> 1481679217 -0800
committer Mariia Mykhailova <mariia@apache.org> 1481917016 -0800

[REEF-1511] Add timeout for Task shutdown during IMRU recovery

During IMRU FT recovery sometimes the tasks that are supposed
to be closed by driver don't report back, causing the system hang.
This change adds a timeout for tasks closed by driver, so that
evaluators of unresponsive tasks are shut down after timeout.

The average task closing time is recorded in the TaskManager.
This number is a reference to define the timeout on the fly.
In case the average number is accessed before the data is accumulated,
or the average number is too low in some scenarios, we have
a configurable MinTaskWaitingForCloseTimeout to ensure that
the driver waits long enough before killing the evaluators.

JIRA:
  [REEF-1511](https://issues.apache.org/jira/browse/REEF-1511)

Pull request:
  This closes #1201