Date: 2019-10-02
Accepted (lazy consensus) & implemented
Superceded by 16. Distributed WorkQueue
By switching the task manager to a distributed implementation, we need to be able to run a Task
on any node of the cluster.
For the time being we will keep the sequential execution property of the task manager. This is an intermediate milestone toward the final implementation which will drop this property.
Created
events are pushed into. This queue will be exclusive and events will be consumed serially. Technically this means the queue will be consumed with a prefetch = 1
. The queue will listen to the worker on the same node and will ack the message only once it is finished (Completed
, Failed
, Cancelled
).