tree d6070d7dfbbee4d4fa6443ca4ae3f720af7f4f3b
parent 220d75cacb49754cfdbac9da54eba4a116c9d1fb
author Sergiy Matusevych <motus@apache.org> 1477978455 -0700
committer Markus Weimer <weimer@apache.org> 1478116124 -0700

[REEF-1658] Gracefully shut down all threads at the end of the REEF job

This work is part of "REEF as a library" project
[REEF-1561](https://issues.apache.org/jira/browse/REEF-1561)

Summary of changes:
  * Close the `EvaluatorIdlenessThreadPool` in `DriverRuntimeStopHandler`
  * Make `EvaluatorIdlenessThreadPool` `AutoCloseable` to close the local thread
    pool
  * Implement `EvaluatorManager.shutdown()` method and call it when removing
    evaluator from `Evaluators`
  * Make sure `.close()` methods never throw in `DispatchingEStage` and
    `EvaluatorMessageDispatcher`
  * Give better thread names in `EvaluatorIdlenessThreadPool`
  * Improve logging and error handling in `.close()` methods in all path of the
    driver shutdown

JIRA:
  [REEF-1658](https://issues.apache.org/jira/browse/REEF-1658)

Pull Request:
  This closes #1175