| commit | 0d78bf8220a012c5d1b83db930ed431cfd521572 | [log] [tgz] |
|---|---|---|
| author | Julia Wang <jwang98052@yahoo.com> | Tue Nov 29 19:20:04 2016 -0800 |
| committer | Mariia Mykhailova <mariia@apache.org> | Fri Dec 02 16:33:35 2016 -0800 |
| tree | 52b6531ab127b8e414502ec2f174024339071f23 | |
| parent | dd14f091050b9e8f22cff3627a8be686fd91350e [diff] |
[REEF-1680] Increasing default retry time in WaitingForRegistration In IMRU, update task doesn't need to do data load but mapper do. That means we need to set sufficient retry time in WaitingForRegistration, at least more than data loading time. Current setting is about 4 min. But for big data, it can be 25 minutes. Previously we hesitated to increase this number because WaitingForRegistration happened in Task constructor. Before we get IRunningTask event, there is no way to cancel a long waiting task in failure cases. Now we have moved WaitingForRegistration out of task constructor and added cancellation token so that we can cancel the waiting if failure happens. This change increases the waiting time to 30min. JIRA: [REEF-1680](https://issues.apache.org/jira/browse/REEF-1680) Pull request: This closes #1194
Apache REEF™ (Retainable Evaluator Execution Framework) is a library for developing portable applications for cluster resource managers such as Apache Hadoop YARN or Apache Mesos. For example, Microsoft Azure Stream Analytics is built on REEF and Hadoop.
Detailed information on REEF can be found in the following places:
The developer mailing list is the best way to reach REEF‘s developers when the above aren’t sufficient.
| Component | OS | Status |
|---|---|---|
| REEF Java | Ubuntu |  |
| REEF.NET | Windows |
| Java | .NET | |
|---|---|---|
| Build & run unit tests | java\BUILD.md | cs\BUILD.md |
