| commit | 881f52f50e8d5020ffbdb52fbb73de162b7467ca | [log] [tgz] |
|---|---|---|
| author | Robert Newson <rnewson@apache.org> | Fri Sep 04 12:38:11 2020 +0100 |
| committer | Robert Newson <rnewson@apache.org> | Fri Sep 04 18:20:21 2020 +0100 |
| tree | 3e1e9f4aa8d361fbf66cac82475e3bf2ac48c606 | |
| parent | e7822a5390de398ae032a0f632ec3c9a89a10864 [diff] |
Add option to delay responses until the end When set, every response is sent once fully generated on the server side. This increases memory usage on the nodes but simplifies error handling for the client as it eliminates the possibility that the response will be deliberately terminated midway through due to a timeout. The config value can be changed at runtime without impacting any in-flight responses.