Metrics

DataFusion operators expose runtime metrics so you can understand where time is spent and how much data flows through the pipeline. See more in EXPLAIN ANALYZE.

Common Metrics

BaselineMetrics

BaselineMetrics are available in most physical operators to capture common measurements.

MetricDescription
elapsed_computeCPU time the operator actively spends processing work.
output_rowsTotal number of rows the operator produces.
output_bytesMemory usage of all output batches. Note: This value may be overestimated. If multiple output RecordBatch instances share underlying memory buffers, their sizes will be counted multiple times.

Operator-specific Metrics

TODO