Apache YuniKorn - A Universal Scheduler
Apache YuniKorn is a light-weight, universal resource scheduler for container orchestrator systems. It was created to achieve fine-grained resource sharing for various workloads efficiently on a large scale, multi-tenant, and cloud-native environment. YuniKorn brings a unified, cross-platform, scheduling experience for mixed workloads that consist of stateless batch workloads and stateful services.
YuniKorn now supports K8s and can be deployed as a custom K8s scheduler. YuniKorn's architecture design also allows adding different shim layer and adopt to different ResourceManager implementation including Apache Hadoop YARN, or any other systems.
Feature highlights
- Gang scheduling
- Application and queue aware preemption
- Hierarchy Resource Queues
- Application aware scheduling
- Job Ordering and Queuing
- High throughput scheduling
- Default Kubernetes workload compatible (daemonsets, jobs, deployments etc)
Read the complete list of features from here.
Web UI
YuniKorn has builtin web UIs for queue hierarchies and apps. See below:
Supported K8s versions
| K8s Version | Supported from version | Support ended |
|---|---|---|
| 1.12.x (or earlier) | - | - |
| 1.13.x | 0.8.0 | 0.10.0 |
| 1.14.x | 0.8.0 | 0.10.0 |
| 1.15.x | 0.8.0 | 0.10.0 |
| 1.16.x | 0.10.0 | 0.11.0 |
| 1.17.x | 0.10.0 | 0.11.0 |
| 1.18.x | 0.10.0 | 0.11.0 |
| 1.19.x | 0.11.0 | 1.0.0 |
| 1.20.x | 0.12.1 | 1.2.0 |
| 1.21.x | 0.12.1 | 1.3.0 |
| 1.22.x | 0.12.2 | 1.3.0 |
| 1.23.x | 0.12.2 | 1.3.0 |
| 1.24.x | 1.0.0 | - |
| 1.25.x | 1.2.0 | - |
| 1.26.x | 1.2.0 | - |
| 1.27.x | 1.4.0 | - |
| 1.28.x | 1.4.0 | - |
| 1.29.x | 1.5.0 | - |