| commit | 55e0cfc856c4f3940bedd6539de67a709e723c00 | [log] [tgz] |
|---|---|---|
| author | Sergiy Matusevych <motus@apache.org> | Mon Oct 31 22:34:15 2016 -0700 |
| committer | Markus Weimer <weimer@apache.org> | Wed Nov 02 12:48:44 2016 -0700 |
| tree | d6070d7dfbbee4d4fa6443ca4ae3f720af7f4f3b | |
| parent | 220d75cacb49754cfdbac9da54eba4a116c9d1fb [diff] |
[REEF-1658] Gracefully shut down all threads at the end of the REEF job This work is part of "REEF as a library" project [REEF-1561](https://issues.apache.org/jira/browse/REEF-1561) Summary of changes: * Close the `EvaluatorIdlenessThreadPool` in `DriverRuntimeStopHandler` * Make `EvaluatorIdlenessThreadPool` `AutoCloseable` to close the local thread pool * Implement `EvaluatorManager.shutdown()` method and call it when removing evaluator from `Evaluators` * Make sure `.close()` methods never throw in `DispatchingEStage` and `EvaluatorMessageDispatcher` * Give better thread names in `EvaluatorIdlenessThreadPool` * Improve logging and error handling in `.close()` methods in all path of the driver shutdown JIRA: [REEF-1658](https://issues.apache.org/jira/browse/REEF-1658) Pull Request: This closes #1175
Apache REEF™ (Retainable Evaluator Execution Framework) is a library for developing portable applications for cluster resource managers such as Apache Hadoop YARN or Apache Mesos. For example, Microsoft Azure Stream Analytics is built on REEF and Hadoop.
Detailed information on REEF can be found in the following places:
The developer mailing list is the best way to reach REEF‘s developers when the above aren’t sufficient.
| Component | OS | Status |
|---|---|---|
| REEF Java | Ubuntu |  |
| REEF.NET | Windows |
| Java | .NET | |
|---|---|---|
| Build & run unit tests | java\BUILD.md | cs\BUILD.md |
