Compares results from two benchmark runs.
solr-orbit compare --baseline BASELINE_ID --contender CONTENDER_ID
| Option | Description |
|---|---|
--baseline | Test execution ID of the baseline run |
--contender | Test execution ID of the contender run |
--percentiles | Comma-separated list of latency percentiles to report (e.g., 50,90,99,99.9) |
--results-format | Output format: markdown (default) or csv |
--results-numbers-align | Column alignment in the output table: right (default), left, center, or decimal |
--results-file | Write the comparison table to a file in addition to console output |
--show-in-results | Which values to include: available (default), all-percentiles, or all |
solr-orbit compare \ --baseline 20240101T120000Z \ --contender 20240115T120000Z
The output shows the delta between baseline and contender for each metric:
| Metric | Baseline | Contender | Diff | |----------------------|----------|-----------|--------| | bulk-index (50th ms) | 14.2 | 12.3 | -13.4% | | bulk-index (docs/s) | 4200 | 4500 | +7.1% | | search (50th ms) | 6.1 | 5.1 | -16.4% | | search (ops/s) | 105 | 120 | +14.3% |
Negative differences in latency and positive differences in throughput indicate improvement.