This module contains a fork of a JRaft project 1
The main entry point is JRaftServerImpl, which starts server node for handling RAFT messages. Responsible for managing one or many RAFT replication groups, see NodeImpl.
A RAFT node represents a single group node, which can be voting or non-voting (so called learner).
The implementation uses several thread pools and threads for different purposes.
Each node can work in shared pools mode or start it‘s dedicated set of pools. When using many groups it’s recommended to use shared mode, otherwise, threads count may be too big.
Shared pools can be passed to NodeOptions as parameter values.
Currently, the following pools are used:
A pool for processing short-lived asynchronous tasks. Should never be blocked.
A scheduled executor for running delayed or repeating tasks.
A default pool for handling RAFT requests. Should never be blocked.
A default pool for handling RAFT responses. Should never be blocked.
A pool of single thread executors. Used only if a replication pipelining is enabled. Handles append entries requests and responses (used by the replication flow). Threads are started on demand. Each replication pair (leader-follower) uses dedicated single thread executor from the pool, so all messages between replication peer pairs are processed sequentially.
A striped disruptor for batching FSM (finite state machine) user tasks.
A striped disruptor for batching read requests before doing read index request.
A striped disruptor for delivering log entries to a storage.
A striped disruptor for FSM callbacks.
A timer for periodic snapshot creation.
A timer to handle election timeout on followers.
A timer to handle vote timeout when a leader was not confirmed by majority.
A timer to process leader step down condition.
onSnapshotSave and onSnapshotLoad are called from a FSMCaller disruptor thread. So, snapshot creation must be delegated to another thread/executor to avoid blocking the progress. All other snapshot related messages are processed in Request/Response pools.
[1] JRaft repository ↩