The Apache Avro performance test harness is powered by OpenJDK JMH. JMH is a Java harness for building, running, and analysing nano/micro/milli/macro benchmarks written in Java.
usage: Perf [--help] [--mi <measurementIterations>] [--test <test>] [--wi <warmupIterations>]
| Test Suite | Package |
|---|---|
| Native Type Tests | org.apache.avro.perf.test.basic.* |
| Generic Datum Tests | org.apache.avro.perf.test.generic.* |
| Record Tests | org.apache.avro.perf.test.record.* |
| Reflection Datum Tests | org.apache.avro.perf.test.reflect.* |
-- Run all tests in a package Perf --test org.apache.avro.perf.test.reflect.* --mi 2 --wi 2 -- Run a specific test Perf --test org.apache.avro.perf.test.basic.IntTest --mi 3 --wi 3 -- Run all tests (measurementIterations=3, warmupIterations=3) Perf
JMH makes several warm ups, iterations etc. to make sure the results are not completely random. The more runs you have, the more accurate the performance information.
For best results, not other applications should be running while it runs the benchmarks. If your computer is running other applications, these applications may take time from the CPU and give incorrect (lower) performance numbers.
From the JMH Framework:
The performance results are just data. To gain reusable insights, you need to follow up on why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial experiments, perform baseline and negative tests that provide experimental control, make sure the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. Do not assume the numbers tell you what you want them to tell.