blob: 18d55d4a991cd11155a4129f9c3118d07e5f1191 [file] [view]
---
title: compare
parent: Command Reference
grand_parent: Reference
nav_order: 20
---
# compare
Compares results from two benchmark runs.
## Syntax
```bash
solr-orbit compare --baseline BASELINE_ID --contender CONTENDER_ID
```
## Options
| Option | Description |
|--------|-------------|
| `--baseline` | Test execution ID of the baseline run |
| `--contender` | Test execution ID of the contender run |
| `--percentiles` | Comma-separated list of latency percentiles to report (e.g., `50,90,99,99.9`) |
| `--results-format` | Output format: `markdown` (default) or `csv` |
| `--results-numbers-align` | Column alignment in the output table: `right` (default), `left`, `center`, or `decimal` |
| `--results-file` | Write the comparison table to a file in addition to console output |
| `--show-in-results` | Which values to include: `available` (default), `all-percentiles`, or `all` |
## Example
```bash
solr-orbit compare \
--baseline 20240101T120000Z \
--contender 20240115T120000Z
```
The output shows the delta between baseline and contender for each metric:
```
| Metric | Baseline | Contender | Diff |
|----------------------|----------|-----------|--------|
| bulk-index (50th ms) | 14.2 | 12.3 | -13.4% |
| bulk-index (docs/s) | 4200 | 4500 | +7.1% |
| search (50th ms) | 6.1 | 5.1 | -16.4% |
| search (ops/s) | 105 | 120 | +14.3% |
```
Negative differences in latency and positive differences in throughput indicate improvement.