| Query (id=ec40891fe759aca3:3081ad8200000000): |
| DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Summary: |
| Session ID: 3d44010dd05364df:6980cb4578e82ca6 |
| Session Type: HIVESERVER2 |
| HiveServer2 Protocol Version: V6 |
| Start Time: 2020-12-15 20:07:15.868283000 |
| End Time: 2020-12-15 20:07:15.984473000 |
| Query Type: SET |
| Query State: FINISHED |
| Impala Query State: FINISHED |
| Query Status: OK |
| Impala Version: impalad version 4.0.0-SNAPSHOT DEBUG (build f7212f2361611fea183e12153886257a844e0ff1) |
| User: tarmstrong |
| Connected User: tarmstrong |
| Delegated User: |
| Network Address: ::ffff:127.0.0.1:46162 |
| Default Db: default |
| Sql Statement: set all |
| Coordinator: tarmstrong-Precision-7540:27000 |
| Query Options (set by configuration): TIMEZONE=America/Los_Angeles |
| Query Options (set by configuration and planner): TIMEZONE=America/Los_Angeles |
| Query Compilation: 73.824ms |
| - Metadata of all 0 tables cached: 29.383ms (29.383ms) |
| - Analysis finished: 52.427ms (23.043ms) |
| - Authorization finished (noop): 54.727ms (2.300ms) |
| - Planning finished: 73.824ms (19.097ms) |
| Query Timeline: 115.998ms |
| - Query submitted: 0.000ns (0.000ns) |
| - Planning finished: 111.998ms (111.998ms) |
| - Rows available: 111.998ms (0.000ns) |
| - Unregister query: 115.998ms (3.999ms) |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Frontend: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| ImpalaServer: |
| - ClientFetchWaitTimer: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - NumRowsFetched: 0 (0) |
| - NumRowsFetchedFromCache: 0 (0) |
| - RowMaterializationRate: 0 |
| - RowMaterializationTimer: 0.000ns |
| - TotalTime: 0.000ns |
| Query (id=454fb5fa46498311:3afee31900000000): |
| DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Summary: |
| Session ID: 3d44010dd05364df:6980cb4578e82ca6 |
| Session Type: HIVESERVER2 |
| HiveServer2 Protocol Version: V6 |
| Start Time: 2020-12-15 20:07:21.735626000 |
| End Time: 2020-12-15 20:07:23.286577000 |
| Query Type: QUERY |
| Query State: FINISHED |
| Impala Query State: FINISHED |
| Query Status: OK |
| Impala Version: impalad version 4.0.0-SNAPSHOT DEBUG (build f7212f2361611fea183e12153886257a844e0ff1) |
| User: tarmstrong |
| Connected User: tarmstrong |
| Delegated User: |
| Network Address: ::ffff:127.0.0.1:46162 |
| Default Db: default |
| Sql Statement: SELECT COUNT(*), ss_sold_date_sk FROM tpcds_parquet.store_sales GROUP BY ss_sold_date_sk |
| Coordinator: tarmstrong-Precision-7540:27000 |
| Query Options (set by configuration): MT_DOP=4,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (f7212f2) built on Tue 15 Dec 2020 04:06:17 PM PST,PREAGG_BYTES_LIMIT=0,SORT_RUN_BYTES_LIMIT=0,TARGETED_KUDU_SCAN_RANGE_LENGTH=0 |
| Query Options (set by configuration and planner): MT_DOP=4,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (f7212f2) built on Tue 15 Dec 2020 04:06:17 PM PST,PREAGG_BYTES_LIMIT=0,SORT_RUN_BYTES_LIMIT=0,TARGETED_KUDU_SCAN_RANGE_LENGTH=0 |
| Plan: |
| ---------------- |
| Max Per-Host Resource Reservation: Memory=16.25MB Threads=9 |
| Per-Host Resource Estimates: Memory=145MB |
| Analyzed query: SELECT count(*), ss_sold_date_sk FROM tpcds_parquet.store_sales |
| GROUP BY ss_sold_date_sk |
| |
| F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 |
| | Per-Instance Resources: mem-estimate=199.12KB mem-reservation=0B thread-reservation=1 |
| PLAN-ROOT SINK |
| | output exprs: count(*), ss_sold_date_sk |
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 |
| | |
| 04:EXCHANGE [UNPARTITIONED] |
| | mem-estimate=199.12KB mem-reservation=0B thread-reservation=0 |
| | tuple-ids=1 row-size=12B cardinality=1.82K |
| | in pipelines: 03(GETNEXT) |
| | |
| F01:PLAN FRAGMENT [HASH(ss_sold_date_sk)] hosts=3 instances=12 |
| Per-Instance Resources: mem-estimate=10.19MB mem-reservation=1.94MB thread-reservation=1 |
| 03:AGGREGATE [FINALIZE] |
| | output: count:merge(*) |
| | group by: ss_sold_date_sk |
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 |
| | tuple-ids=1 row-size=12B cardinality=1.82K |
| | in pipelines: 03(GETNEXT), 00(OPEN) |
| | |
| 02:EXCHANGE [HASH(ss_sold_date_sk)] |
| | mem-estimate=199.12KB mem-reservation=0B thread-reservation=0 |
| | tuple-ids=1 row-size=12B cardinality=1.82K |
| | in pipelines: 00(GETNEXT) |
| | |
| F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=12 |
| Per-Instance Resources: mem-estimate=26.00MB mem-reservation=2.12MB thread-reservation=1 |
| 01:AGGREGATE [STREAMING] |
| | output: sum_init_zero(tpcds_parquet.store_sales.stats: num_rows) |
| | group by: ss_sold_date_sk |
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 |
| | tuple-ids=1 row-size=12B cardinality=1.82K |
| | in pipelines: 00(GETNEXT) |
| | |
| 00:SCAN HDFS [tpcds_parquet.store_sales, RANDOM] |
| HDFS partitions=1824/1824 files=1824 size=196.95MB |
| stored statistics: |
| table: rows=2.88M size=196.95MB |
| partitions: 1824/1824 rows=2.88M |
| columns: all |
| extrapolated-rows=disabled max-scan-range-rows=130.09K |
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 |
| tuple-ids=0 row-size=12B cardinality=2.88M |
| in pipelines: 00(GETNEXT) |
| ---------------- |
| Estimated Per-Host Mem: 152014464 |
| Request Pool: default-pool |
| Per Host Min Memory Reservation: tarmstrong-Precision-7540:27002(16.25 MB) tarmstrong-Precision-7540:27000(16.25 MB) tarmstrong-Precision-7540:27001(16.25 MB) |
| Per Host Number of Fragment Instances: tarmstrong-Precision-7540:27002(8) tarmstrong-Precision-7540:27000(9) tarmstrong-Precision-7540:27001(8) |
| Admission result: Admitted immediately |
| Cluster Memory Admitted: 434.92 MB |
| Executor Group: default |
| ExecSummary: |
| Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail |
| --------------------------------------------------------------------------------------------------------------------------------- |
| F02:ROOT 1 1 3.999ms 3.999ms 0 0 |
| 04:EXCHANGE 1 1 3.999ms 3.999ms 1.82K 1.82K 1.19 MB 199.12 KB UNPARTITIONED |
| F01:EXCHANGE SENDER 3 12 333.329us 3.999ms 9.84 KB 0 |
| 03:AGGREGATE 3 12 4.333ms 11.999ms 1.82K 1.82K 2.15 MB 10.00 MB FINALIZE |
| 02:EXCHANGE 3 12 333.329us 3.999ms 1.82K 1.82K 112.00 KB 199.12 KB HASH(ss_sold_date_sk) |
| F00:EXCHANGE SENDER 3 12 1.666ms 3.999ms 166.12 KB 0 |
| 01:AGGREGATE 3 12 5.999ms 11.999ms 1.82K 1.82K 2.02 MB 10.00 MB STREAMING |
| 00:SCAN HDFS 3 12 1s017ms 1s023ms 1.82K 2.88M 132.00 KB 16.00 MB tpcds_parquet.store_sales |
| Errors: |
| Query Compilation: 284.144ms |
| - Metadata of all 1 tables cached: 5.857ms (5.857ms) |
| - Analysis finished: 17.866ms (12.009ms) |
| - Authorization finished (noop): 18.208ms (341.943us) |
| - Value transfer graph computed: 34.199ms (15.991ms) |
| - Single node plan created: 189.134ms (154.934ms) |
| - Runtime filters computed: 194.459ms (5.324ms) |
| - Distributed plan created: 195.676ms (1.217ms) |
| - Parallel plans created: 198.019ms (2.342ms) |
| - Planning finished: 284.144ms (86.125ms) |
| Query Timeline: 1s547ms |
| - Query submitted: 0.000ns (0.000ns) |
| - Planning finished: 311.996ms (311.996ms) |
| - Submit for admission: 311.996ms (0.000ns) |
| - Completed admission: 327.996ms (15.999ms) |
| - Ready to start on 3 backends: 327.996ms (0.000ns) |
| - All 3 execution backends (25 fragment instances) started: 343.996ms (15.999ms) |
| - Rows available: 1s515ms (1s171ms) |
| - First row fetched: 1s523ms (7.999ms) |
| - Last row fetched: 1s531ms (7.999ms) |
| - Released admission control resources: 1s547ms (15.999ms) |
| - Unregister query: 1s547ms (0.000ns) |
| - AdmissionControlTimeSinceLastUpdate: 80.000ms |
| - ComputeScanRangeAssignmentTimer: 15.999ms |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Frontend: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| ImpalaServer: |
| - ClientFetchWaitTimer: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - NumRowsFetched: 1.82K (1824) |
| - NumRowsFetchedFromCache: 0 (0) |
| - RowMaterializationRate: 57.00 K/sec |
| - RowMaterializationTimer: 31.999ms |
| - TotalTime: 0.000ns |
| Execution Profile 454fb5fa46498311:3afee31900000000: |
| Number of filters: 0 |
| Filter routing table: |
| ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp |
| ---------------------------------------------------------------------------------------------------------------------------------------- |
| Backend startup latencies: Count: 3, min / max: 9ms / 14ms, 25th %-ile: 9ms, 50th %-ile: 10ms, 75th %-ile: 10ms, 90th %-ile: 14ms, 95th %-ile: 14ms, 99.9th %-ile: 14ms |
| Slowest backend to start up: tarmstrong-Precision-7540:27000 |
| Per Node Peak Memory Usage: tarmstrong-Precision-7540:27000(18.04 MB) tarmstrong-Precision-7540:27001(17.93 MB) tarmstrong-Precision-7540:27002(18.07 MB) |
| Per Node Bytes Read: tarmstrong-Precision-7540:27000(47.32 MB) tarmstrong-Precision-7540:27001(47.47 MB) tarmstrong-Precision-7540:27002(47.31 MB) |
| Per Node User Time: tarmstrong-Precision-7540:27000(438.892ms) tarmstrong-Precision-7540:27001(423.542ms) tarmstrong-Precision-7540:27002(434.199ms) |
| Per Node System Time: tarmstrong-Precision-7540:27000(38.589ms) tarmstrong-Precision-7540:27001(21.919ms) tarmstrong-Precision-7540:27002(18.074ms) |
| - ExchangeScanRatio: 0.00 |
| - FiltersReceived: 0 (0) |
| - FinalizationTimer: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - InnerNodeSelectivityRatio: 1.03 |
| - NumBackends: 3 (3) |
| - NumCompletedBackends: 3 (3) |
| - NumFragmentInstances: 25 (25) |
| - NumFragments: 3 (3) |
| - TotalBytesRead: 142.10 MB (149006243) |
| - TotalBytesSent: 48.74 KB (49910) |
| - TotalCpuTime: 1s375ms |
| - TotalInnerBytesSent: 24.68 KB (25269) |
| - TotalScanBytesSent: 24.06 KB (24641) |
| - TotalTime: 1s219ms |
| Per Node Profiles: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| tarmstrong-Precision-7540:27000: |
| - AdmissionSlots: 4 (4) |
| - BloomFilterBytes: 0 |
| - InactiveTotalTime: 0.000ns |
| - ScratchBytesRead: 0 |
| - ScratchBytesWritten: 0 |
| - ScratchFileUsedBytes: 0 |
| - ScratchReads: 0 (0) |
| - ScratchWrites: 0 (0) |
| - TotalEncryptionTime: 0.000ns |
| - TotalReadBlockTime: 0.000ns |
| - TotalTime: 0.000ns |
| - UncompressedScratchBytesWritten: 0 |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 0 |
| - CumulativeAllocations: 0 (0) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 0 |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 0 |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - ReservationLimit: 0 |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| JVM: |
| - GcCount: 1 (1) |
| - GcNumInfoThresholdExceeded: 0 (0) |
| - GcNumWarnThresholdExceeded: 0 (0) |
| - GcTimeMillis: 36ms |
| - GcTotalExtraSleepTimeMillis: 0 |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Fragment F02: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 14 (14) |
| - CodegenTotalWallClockTime: 27.999ms |
| - CodegenSysTime: 3.550ms |
| - CodegenUserTime: 21.303ms |
| - CodegenVoluntaryContextSwitches: 3 (3) |
| - CompileTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 3.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 11.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 2 (2) |
| - NumInstructions: 35 (35) |
| - OptimizationTime: 3.999ms |
| - PeakMemoryUsage: 17.50 KB (17920) |
| - PrepareTime: 15.999ms |
| - TotalTime: 27.999ms |
| Fragment F01: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 3 (3) |
| - CodegenTotalWallClockTime: 79.999ms |
| - CodegenSysTime: 3.829ms |
| - CodegenUserTime: 76.066ms |
| - CodegenVoluntaryContextSwitches: 1 (1) |
| - CompileTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 3.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 59.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 38 (38) |
| - NumInstructions: 757 (757) |
| - OptimizationTime: 47.999ms |
| - PeakMemoryUsage: 378.50 KB (387584) |
| - PrepareTime: 19.999ms |
| - TotalTime: 79.999ms |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 9 (9) |
| - CodegenTotalWallClockTime: 83.999ms |
| - CodegenSysTime: 0.000ns |
| - CodegenUserTime: 81.527ms |
| - CodegenVoluntaryContextSwitches: 1 (1) |
| - CompileTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 7.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 63.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 54 (54) |
| - NumInstructions: 1.31K (1306) |
| - OptimizationTime: 51.999ms |
| - PeakMemoryUsage: 653.00 KB (668672) |
| - PrepareTime: 19.999ms |
| - TotalTime: 83.999ms |
| tarmstrong-Precision-7540:27001: |
| - AdmissionSlots: 4 (4) |
| - BloomFilterBytes: 0 |
| - InactiveTotalTime: 0.000ns |
| - ScratchBytesRead: 0 |
| - ScratchBytesWritten: 0 |
| - ScratchFileUsedBytes: 0 |
| - ScratchReads: 0 (0) |
| - ScratchWrites: 0 (0) |
| - TotalEncryptionTime: 0.000ns |
| - TotalReadBlockTime: 0.000ns |
| - TotalTime: 0.000ns |
| - UncompressedScratchBytesWritten: 0 |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 0 |
| - CumulativeAllocations: 0 (0) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 0 |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 0 |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - ReservationLimit: 0 |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| JVM: |
| - GcCount: 1 (1) |
| - GcNumInfoThresholdExceeded: 0 (0) |
| - GcNumWarnThresholdExceeded: 0 (0) |
| - GcTimeMillis: 9ms |
| - GcTotalExtraSleepTimeMillis: 0 |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Fragment F01: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 8 (8) |
| - CodegenTotalWallClockTime: 83.999ms |
| - CodegenSysTime: 0.000ns |
| - CodegenUserTime: 80.364ms |
| - CodegenVoluntaryContextSwitches: 13 (13) |
| - CompileTime: 7.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 3.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 67.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 38 (38) |
| - NumInstructions: 757 (757) |
| - OptimizationTime: 55.999ms |
| - PeakMemoryUsage: 378.50 KB (387584) |
| - PrepareTime: 15.999ms |
| - TotalTime: 83.999ms |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 9 (9) |
| - CodegenTotalWallClockTime: 83.999ms |
| - CodegenSysTime: 0.000ns |
| - CodegenUserTime: 82.410ms |
| - CodegenVoluntaryContextSwitches: 24 (24) |
| - CompileTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 3.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 67.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 54 (54) |
| - NumInstructions: 1.31K (1306) |
| - OptimizationTime: 55.999ms |
| - PeakMemoryUsage: 653.00 KB (668672) |
| - PrepareTime: 15.999ms |
| - TotalTime: 83.999ms |
| tarmstrong-Precision-7540:27002: |
| - AdmissionSlots: 4 (4) |
| - BloomFilterBytes: 0 |
| - InactiveTotalTime: 0.000ns |
| - ScratchBytesRead: 0 |
| - ScratchBytesWritten: 0 |
| - ScratchFileUsedBytes: 0 |
| - ScratchReads: 0 (0) |
| - ScratchWrites: 0 (0) |
| - TotalEncryptionTime: 0.000ns |
| - TotalReadBlockTime: 0.000ns |
| - TotalTime: 0.000ns |
| - UncompressedScratchBytesWritten: 0 |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 0 |
| - CumulativeAllocations: 0 (0) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 0 |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 0 |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - ReservationLimit: 0 |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| JVM: |
| - GcCount: 1 (1) |
| - GcNumInfoThresholdExceeded: 0 (0) |
| - GcNumWarnThresholdExceeded: 0 (0) |
| - GcTimeMillis: 5ms |
| - GcTotalExtraSleepTimeMillis: 0 |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Fragment F01: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 14 (14) |
| - CodegenTotalWallClockTime: 71.999ms |
| - CodegenSysTime: 0.000ns |
| - CodegenUserTime: 71.265ms |
| - CodegenVoluntaryContextSwitches: 9 (9) |
| - CompileTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 3.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 51.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 38 (38) |
| - NumInstructions: 757 (757) |
| - OptimizationTime: 43.999ms |
| - PeakMemoryUsage: 378.50 KB (387584) |
| - PrepareTime: 19.999ms |
| - TotalTime: 71.999ms |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 11 (11) |
| - CodegenTotalWallClockTime: 111.998ms |
| - CodegenSysTime: 3.875ms |
| - CodegenUserTime: 104.646ms |
| - CodegenVoluntaryContextSwitches: 13 (13) |
| - CompileTime: 7.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 7.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 87.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 54 (54) |
| - NumInstructions: 1.31K (1306) |
| - OptimizationTime: 71.999ms |
| - PeakMemoryUsage: 653.00 KB (668672) |
| - PrepareTime: 23.999ms |
| - TotalTime: 111.998ms |
| Averaged Fragment F02:(Total: 1s151ms, non-child: 27.999ms, % non-child: 2.43%) |
| split sizes: min: 0, max: 0, avg: 0, stddev: 0 |
| completion times: min:1s203ms max:1s203ms mean: 1s203ms stddev:0.000ns |
| execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec |
| num instances: 1 |
| Instances: |
| [0] Instance 454fb5fa46498311:3afee31900000000 (host=tarmstrong-Precision-7540:27000) |
| Last report received time[0]: 2020-12-15 20:07:23.281 |
| - MemoryUsage[0] (500.000ms): 8.00 KB, 8.00 KB, 8.00 KB |
| Fragment Instance Lifecycle Event Timeline[0]: 1s151ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s135ms (1s135ms) |
| - First Batch Produced: 1s143ms (7.999ms) |
| - First Batch Sent: 1s143ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (7.999ms) |
| - AverageThreadTokens: 0.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s203ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 1.20 MB (1253376) |
| - PeakReservation: 0 |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 1.82K (1824) |
| - TotalNetworkReceiveTime: 1s115ms |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 18 (18) |
| - TotalThreadsTotalWallClockTime: 1s151ms |
| - TotalThreadsSysTime: 7.415ms |
| - TotalThreadsUserTime: 25.953ms |
| - TotalThreadsVoluntaryContextSwitches: 81 (81) |
| - TotalTime: 1s151ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 15.999ms |
| - ExecTreeExecTime: 11.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s135ms |
| - ExecTreeOpenTime: 1s107ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| PLAN_ROOT_SINK:(Total: 3.999ms, non-child: 3.999ms, % non-child: 100.00%) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 0 |
| - RowsSent: 1.82K (1824) |
| - RowsSentRate: 456.00 K/sec |
| - TotalTime: 3.999ms |
| EXCHANGE_NODE (id=4):(Total: 1s119ms, non-child: 3.999ms, % non-child: 0.36%) |
| Node Lifecycle Event Timeline[0]: 1s151ms |
| - Open Started: 27.999ms (27.999ms) |
| - Open Finished: 1s135ms (1s107ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s143ms (7.999ms) |
| - Last Batch Returned: 1s147ms (3.999ms) |
| - Closed: 1s151ms (3.999ms) |
| - ConvertRowBatchTime: 3.999ms |
| - InactiveTotalTime: 1s115ms |
| - PeakMemoryUsage: 1.19 MB (1245184) |
| - RowsReturned: 1.82K (1824) |
| - RowsReturnedRate: 1.63 K/sec |
| - TotalTime: 1s119ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 3.00 MB (3145728) |
| - CumulativeAllocations: 384 (384) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 1.19 MB (1245184) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.19 MB (1245184) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued[0] (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s107ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 37.41 KB (38304) |
| - TotalGetBatchTime: 1s115ms |
| - DataWaitTime: 1s115ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived[0] (500.000ms): 0, 0, 0 |
| - DeferredQueueSize[0] (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 93.798us ; Min: 36.876us ; Max: 725.513us ; Number of samples: 192) |
| - DeserializeRowBatchTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 192 (192) |
| - TotalBatchesReceived: 192 (192) |
| - TotalBytesReceived: 24.68 KB (25269) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Coordinator Fragment F02: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000000 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Fragment Instance Lifecycle Event Timeline: 1s151ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s135ms (1s135ms) |
| - First Batch Produced: 1s143ms (7.999ms) |
| - First Batch Sent: 1s143ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (7.999ms) |
| - MemoryUsage (500.000ms): 8.00 KB, 8.00 KB, 8.00 KB |
| - AverageThreadTokens: 0.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s203ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 1.20 MB (1253376) |
| - PeakReservation: 0 |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 1.82K (1824) |
| - TotalNetworkReceiveTime: 1s115ms |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 18 (18) |
| - TotalThreadsTotalWallClockTime: 1s151ms |
| - TotalThreadsSysTime: 7.415ms |
| - TotalThreadsUserTime: 25.953ms |
| - TotalThreadsVoluntaryContextSwitches: 81 (81) |
| - TotalTime: 1s151ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 15.999ms |
| - ExecTreeExecTime: 11.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s135ms |
| - ExecTreeOpenTime: 1s107ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| PLAN_ROOT_SINK: |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 0 |
| - RowsSent: 1.82K (1824) |
| - RowsSentRate: 456.00 K/sec |
| - TotalTime: 3.999ms |
| EXCHANGE_NODE (id=4): |
| Node Lifecycle Event Timeline: 1s151ms |
| - Open Started: 27.999ms (27.999ms) |
| - Open Finished: 1s135ms (1s107ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s143ms (7.999ms) |
| - Last Batch Returned: 1s147ms (3.999ms) |
| - Closed: 1s151ms (3.999ms) |
| - ConvertRowBatchTime: 3.999ms |
| - InactiveTotalTime: 1s115ms |
| - PeakMemoryUsage: 1.19 MB (1245184) |
| - RowsReturned: 1.82K (1824) |
| - RowsReturnedRate: 1.63 K/sec |
| - TotalTime: 1s119ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 3.00 MB (3145728) |
| - CumulativeAllocations: 384 (384) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 1.19 MB (1245184) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.19 MB (1245184) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s107ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 37.41 KB (38304) |
| - TotalGetBatchTime: 1s115ms |
| - DataWaitTime: 1s115ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 93.798us ; Min: 36.876us ; Max: 725.513us ; Number of samples: 192) |
| - DeserializeRowBatchTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 192 (192) |
| - TotalBatchesReceived: 192 (192) |
| - TotalBytesReceived: 24.68 KB (25269) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Averaged Fragment F01 [12 instances]:(Total: 1s149ms, non-child: 76.999ms, % non-child: 6.70%) |
| split sizes: min: 0, max: 0, avg: 0, stddev: 0 |
| completion times: min:1s191ms max:1s203ms mean: 1s197ms stddev:4.149ms |
| execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec |
| num instances: 12 |
| Instances: |
| [0] Instance 454fb5fa46498311:3afee3190000000d (host=tarmstrong-Precision-7540:27001) |
| [1] Instance 454fb5fa46498311:3afee3190000000e (host=tarmstrong-Precision-7540:27001) |
| [2] Instance 454fb5fa46498311:3afee3190000000f (host=tarmstrong-Precision-7540:27001) |
| [3] Instance 454fb5fa46498311:3afee31900000010 (host=tarmstrong-Precision-7540:27001) |
| [4] Instance 454fb5fa46498311:3afee31900000011 (host=tarmstrong-Precision-7540:27000) |
| [5] Instance 454fb5fa46498311:3afee31900000012 (host=tarmstrong-Precision-7540:27000) |
| [6] Instance 454fb5fa46498311:3afee31900000013 (host=tarmstrong-Precision-7540:27000) |
| [7] Instance 454fb5fa46498311:3afee31900000014 (host=tarmstrong-Precision-7540:27000) |
| [8] Instance 454fb5fa46498311:3afee31900000015 (host=tarmstrong-Precision-7540:27002) |
| [9] Instance 454fb5fa46498311:3afee31900000016 (host=tarmstrong-Precision-7540:27002) |
| [10] Instance 454fb5fa46498311:3afee31900000017 (host=tarmstrong-Precision-7540:27002) |
| [11] Instance 454fb5fa46498311:3afee31900000018 (host=tarmstrong-Precision-7540:27002) |
| Last report received time[8-11]: 2020-12-15 20:07:23.272 |
| Last report received time[0-3]: 2020-12-15 20:07:23.276 |
| Last report received time[4-7]: 2020-12-15 20:07:23.281 |
| - MemoryUsage[0] (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage[0] (500.000ms): 1, 1, 1 |
| Fragment Instance Lifecycle Event Timeline[0]: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[1]: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[2]: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[3]: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[4]: 1s147ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s135ms (1s131ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[5]: 1s147ms |
| - Prepare Finished: 11.999ms (11.999ms) |
| - Open Finished: 1s135ms (1s123ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[6]: 1s147ms |
| - Prepare Finished: 11.999ms (11.999ms) |
| - Open Finished: 1s135ms (1s123ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[7]: 1s147ms |
| - Prepare Finished: 11.999ms (11.999ms) |
| - Open Finished: 1s135ms (1s123ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[8]: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[9]: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[10]: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[11]: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| - AverageThreadTokens: mean=1.00 min=1.00 max=1.00 |
| - BytesAssigned: mean=0 min=0 max=0 |
| - CompletionTime: mean=1s197ms min=1s191ms max=1s203ms |
| - ExchangeScanRatio: mean=0.00 min=0.00 max=0.00 |
| - ExecutionRate: mean=0.00 /sec min=0.00 /sec max=0.00 /sec |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakMemoryUsage: mean=2.27 MB (2376672) min=2.26 MB (2374624) max=2.27 MB (2382816) |
| - PeakReservation: mean=2.12 MB (2228224) min=2.12 MB (2228224) max=2.12 MB (2228224) |
| - PeakUsedReservation: mean=0 min=0 max=0 |
| - PerHostPeakMemUsage: mean=18.01 MB (18888699) min=17.93 MB (18805120) max=18.07 MB (18946812) |
| - RowsProduced: mean=152 (152) min=133 (133) max=169 (169) |
| - TotalNetworkReceiveTime: mean=1s058ms min=1s051ms max=1s063ms |
| - TotalNetworkSendTime: mean=9.333ms min=3.999ms max=11.999ms |
| - TotalStorageWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: mean=3 (3) min=0 (0) max=16 (16) |
| - TotalThreadsTotalWallClockTime: mean=1s148ms min=1s135ms max=1s159ms |
| - TotalThreadsSysTime: mean=569.083us min=0.000ns max=4.083ms |
| - TotalThreadsUserTime: mean=24.737ms min=4.756ms max=87.646ms |
| - TotalThreadsVoluntaryContextSwitches: mean=29 (29) min=25 (25) max=39 (39) |
| - TotalTime: mean=1s149ms min=1s135ms max=1s159ms |
| Fragment Instance Lifecycle Timings [12 instances]: |
| - ExecTime: mean=11.999ms min=11.999ms max=11.999ms |
| - ExecTreeExecTime: mean=2.333ms min=0.000ns max=7.999ms |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - OpenTime: mean=1s136ms min=1s123ms max=1s147ms |
| - ExecTreeOpenTime: mean=1s059ms min=1s051ms max=1s063ms |
| - PrepareTime: mean=666.659us min=0.000ns max=3.999ms |
| - ExecTreePrepareTime: mean=333.329us min=0.000ns max=3.999ms |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| KrpcDataStreamSender (dst_id=4) [12 instances]:(Total: 9.666ms, non-child: 333.330us, % non-child: 3.45%) |
| ExecOption[0-11]: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent[0] (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 324.30 KB/sec ; Min: 30.18 KB/sec ; Max: 895.41 KB/sec ; Number of samples: 192) |
| - RpcNetworkTime: (Avg: 460.361us ; Min: 139.963us ; Max: 1.858ms ; Number of samples: 204) |
| - RpcRecvrTime: (Avg: 126.641us ; Min: 39.950us ; Max: 751.214us ; Number of samples: 204) |
| - EosSent: mean=1 (1) min=1 (1) max=1 (1) |
| - InactiveTotalTime: mean=9.333ms min=3.999ms max=11.999ms |
| - PeakMemoryUsage: mean=9.84 KB (10080) min=9.84 KB (10080) max=9.84 KB (10080) |
| - RowsSent: mean=152 (152) min=133 (133) max=169 (169) |
| - RpcFailure: mean=0 (0) min=0 (0) max=0 (0) |
| - RpcRetry: mean=0 (0) min=0 (0) max=0 (0) |
| - SerializeBatchTime: mean=333.329us min=0.000ns max=3.999ms |
| - TotalBytesSent: mean=2.06 KB (2105) min=1.81 KB (1856) max=2.26 KB (2316) |
| - TotalTime: mean=9.666ms min=3.999ms max=11.999ms |
| - UncompressedRowBatchSize: mean=3.12 KB (3192) min=2.73 KB (2793) max=3.47 KB (3549) |
| AGGREGATION_NODE (id=3) [12 instances]:(Total: 1s062ms, non-child: 4.333ms, % non-child: 0.41%) |
| Node Lifecycle Event Timeline[0]: 1s155ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s155ms (7.999ms) |
| - Closed: 1s155ms (0.000ns) |
| Node Lifecycle Event Timeline[1]: 1s159ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s159ms (11.999ms) |
| - Closed: 1s159ms (0.000ns) |
| Node Lifecycle Event Timeline[2]: 1s159ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s159ms (11.999ms) |
| - Closed: 1s159ms (0.000ns) |
| Node Lifecycle Event Timeline[3]: 1s159ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s159ms (11.999ms) |
| - Closed: 1s159ms (0.000ns) |
| Node Lifecycle Event Timeline[4]: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s147ms (11.999ms) |
| - Closed: 1s147ms (0.000ns) |
| Node Lifecycle Event Timeline[5]: 1s143ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s143ms (7.999ms) |
| - Closed: 1s143ms (0.000ns) |
| Node Lifecycle Event Timeline[6]: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s147ms (11.999ms) |
| - Closed: 1s147ms (0.000ns) |
| Node Lifecycle Event Timeline[7]: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s147ms (11.999ms) |
| - Closed: 1s147ms (0.000ns) |
| Node Lifecycle Event Timeline[8]: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| Node Lifecycle Event Timeline[9]: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| Node Lifecycle Event Timeline[10]: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| Node Lifecycle Event Timeline[11]: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakMemoryUsage: mean=2.15 MB (2249856) min=2.15 MB (2249856) max=2.15 MB (2249856) |
| - RowsReturned: mean=152 (152) min=133 (133) max=169 (169) |
| - RowsReturnedRate: mean=142.00 /sec min=125.00 /sec max=160.00 /sec |
| - TotalTime: mean=1s062ms min=1s055ms max=1s071ms |
| GroupingAggregator 0 [12 instances]: |
| ExecOption[0-11]: Codegen Enabled |
| - BuildTime: mean=0.000ns min=0.000ns max=0.000ns |
| - GetResultsTime: mean=999.989us min=0.000ns max=3.999ms |
| - HTResizeTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - LargestPartitionPercent: mean=9 (9) min=8 (8) max=12 (12) |
| - MaxPartitionLevel: mean=0 (0) min=0 (0) max=0 (0) |
| - NumRepartitions: mean=0 (0) min=0 (0) max=0 (0) |
| - PartitionsCreated: mean=16 (16) min=16 (16) max=16 (16) |
| - PeakMemoryUsage: mean=2.14 MB (2245760) min=2.14 MB (2245760) max=2.14 MB (2245760) |
| - PeakReservation: mean=2.12 MB (2228224) min=2.12 MB (2228224) max=2.12 MB (2228224) |
| - PeakUsedReservation: mean=0 min=0 max=0 |
| - RowsRepartitioned: mean=0 (0) min=0 (0) max=0 (0) |
| - RowsReturned: mean=152 (152) min=133 (133) max=169 (169) |
| - SpilledPartitions: mean=0 (0) min=0 (0) max=0 (0) |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| Buffer pool [12 instances]: |
| - AllocTime: mean=0.000ns min=0.000ns max=0.000ns |
| - CompressionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - CumulativeAllocationBytes: mean=1.25 MB (1310720) min=1.25 MB (1310720) max=1.25 MB (1310720) |
| - CumulativeAllocations: mean=20 (20) min=20 (20) max=20 (20) |
| - EncryptionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakReservation: mean=2.12 MB (2228224) min=2.12 MB (2228224) max=2.12 MB (2228224) |
| - PeakUnpinnedBytes: mean=0 min=0 max=0 |
| - PeakUsedReservation: mean=1.25 MB (1310720) min=1.25 MB (1310720) max=1.25 MB (1310720) |
| - ReadIoBytes: mean=0 min=0 max=0 |
| - ReadIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - ReadIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| - SystemAllocTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - WriteIoBytes: mean=0 min=0 max=0 |
| - WriteIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - WriteIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| Hash Table [12 instances]: |
| - HashBuckets: mean=16.38K (16384) min=16.38K (16384) max=16.38K (16384) |
| - HashCollisions: mean=0 (0) min=0 (0) max=0 (0) |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - Probes: mean=152 (152) min=133 (133) max=169 (169) |
| - Resizes: mean=0 (0) min=0 (0) max=0 (0) |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - Travel: mean=0 (0) min=0 (0) max=0 (0) |
| EXCHANGE_NODE (id=2) [12 instances]:(Total: 1s058ms, non-child: 333.330us, % non-child: 0.03%) |
| Node Lifecycle Event Timeline[0]: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s111ms (1s027ms) |
| - First Batch Requested: 1s115ms (3.999ms) |
| - First Batch Returned: 1s147ms (31.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| Node Lifecycle Event Timeline[1]: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s111ms (1s027ms) |
| - First Batch Requested: 1s111ms (0.000ns) |
| - First Batch Returned: 1s147ms (35.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| Node Lifecycle Event Timeline[2]: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s111ms (1s027ms) |
| - First Batch Requested: 1s111ms (0.000ns) |
| - First Batch Returned: 1s147ms (35.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| Node Lifecycle Event Timeline[3]: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s115ms (1s031ms) |
| - First Batch Requested: 1s115ms (0.000ns) |
| - First Batch Returned: 1s147ms (31.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| Node Lifecycle Event Timeline[4]: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[5]: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[6]: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[7]: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[8]: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| Node Lifecycle Event Timeline[9]: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| Node Lifecycle Event Timeline[10]: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| Node Lifecycle Event Timeline[11]: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| - ConvertRowBatchTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=1s057ms min=1s047ms max=1s063ms |
| - PeakMemoryUsage: mean=106.00 KB (108544) min=104.00 KB (106496) max=112.00 KB (114688) |
| - RowsReturned: mean=152 (152) min=133 (133) max=169 (169) |
| - RowsReturnedRate: mean=143.00 /sec min=125.00 /sec max=160.00 /sec |
| - TotalTime: mean=1s058ms min=1s051ms max=1s063ms |
| Buffer pool [12 instances]: |
| - AllocTime: mean=0.000ns min=0.000ns max=0.000ns |
| - CompressionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - CumulativeAllocationBytes: mean=192.00 KB (196608) min=192.00 KB (196608) max=192.00 KB (196608) |
| - CumulativeAllocations: mean=24 (24) min=24 (24) max=24 (24) |
| - EncryptionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakReservation: mean=106.00 KB (108544) min=104.00 KB (106496) max=112.00 KB (114688) |
| - PeakUnpinnedBytes: mean=0 min=0 max=0 |
| - PeakUsedReservation: mean=106.00 KB (108544) min=104.00 KB (106496) max=112.00 KB (114688) |
| - ReadIoBytes: mean=0 min=0 max=0 |
| - ReadIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - ReadIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| - SystemAllocTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - WriteIoBytes: mean=0 min=0 max=0 |
| - WriteIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - WriteIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| Dequeue [12 instances]: |
| - BytesDequeued[0] (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: mean=1s024ms min=1s015ms max=1s031ms |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalBytesDequeued: mean=3.12 KB (3192) min=2.73 KB (2793) max=3.47 KB (3549) |
| - TotalGetBatchTime: mean=1s058ms min=1s051ms max=1s063ms |
| - DataWaitTime: mean=1s057ms min=1s047ms max=1s063ms |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| Enqueue [12 instances]: |
| - BytesReceived[0] (500.000ms): 0, 0, 0 |
| - DeferredQueueSize[0] (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 307.026us ; Min: 36.876us ; Max: 4.526ms ; Number of samples: 144) |
| - DeserializeRowBatchTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalBatchesEnqueued: mean=12 (12) min=12 (12) max=12 (12) |
| - TotalBatchesReceived: mean=12 (12) min=12 (12) max=12 (12) |
| - TotalBytesReceived: mean=2.00 KB (2053) min=1.76 KB (1802) max=2.20 KB (2248) |
| - TotalEarlySenders: mean=0 (0) min=0 (0) max=0 (0) |
| - TotalEosReceived: mean=12 (12) min=12 (12) max=12 (12) |
| - TotalHasDeferredRPCsTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalRPCsDeferred: mean=0 (0) min=0 (0) max=0 (0) |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| Fragment F01: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee3190000000d (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Fragment Instance Lifecycle Event Timeline: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 164 (164) |
| - TotalNetworkReceiveTime: 1s059ms |
| - TotalNetworkSendTime: 11.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 9 (9) |
| - TotalThreadsTotalWallClockTime: 1s159ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 87.646ms |
| - TotalThreadsVoluntaryContextSwitches: 39 (39) |
| - TotalTime: 1s159ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s147ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 322.18 KB/sec ; Min: 144.57 KB/sec ; Max: 503.46 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 434.281us ; Min: 282.160us ; Max: 631.366us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 112.140us ; Min: 67.886us ; Max: 296.966us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 11.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 164 (164) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.20 KB (2249) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 3.36 KB (3444) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s155ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s155ms (7.999ms) |
| - Closed: 1s155ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 164 (164) |
| - RowsReturnedRate: 154.00 /sec |
| - TotalTime: 1s063ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 8 (8) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 164 (164) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 164 (164) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s111ms (1s027ms) |
| - First Batch Requested: 1s115ms (3.999ms) |
| - First Batch Returned: 1s147ms (31.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s059ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 164 (164) |
| - RowsReturnedRate: 154.00 /sec |
| - TotalTime: 1s059ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s027ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 3.36 KB (3444) |
| - TotalGetBatchTime: 1s059ms |
| - DataWaitTime: 1s059ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 153.255us ; Min: 42.184us ; Max: 448.381us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 2.16 KB (2211) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee3190000000e (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Fragment Instance Lifecycle Event Timeline: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.27 MB (2382816) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 154 (154) |
| - TotalNetworkReceiveTime: 1s063ms |
| - TotalNetworkSendTime: 11.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 0 (0) |
| - TotalThreadsTotalWallClockTime: 1s159ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 5.420ms |
| - TotalThreadsVoluntaryContextSwitches: 27 (27) |
| - TotalTime: 1s159ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s147ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 307.35 KB/sec ; Min: 154.12 KB/sec ; Max: 588.34 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 466.934us ; Min: 195.277us ; Max: 644.217us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 173.568us ; Min: 46.096us ; Max: 751.214us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 11.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 154 (154) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.10 KB (2147) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 3.16 KB (3234) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s159ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s159ms (11.999ms) |
| - Closed: 1s159ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 154 (154) |
| - RowsReturnedRate: 144.00 /sec |
| - TotalTime: 1s063ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 154 (154) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 154 (154) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s111ms (1s027ms) |
| - First Batch Requested: 1s111ms (0.000ns) |
| - First Batch Returned: 1s147ms (35.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s063ms |
| - PeakMemoryUsage: 112.00 KB (114688) |
| - RowsReturned: 154 (154) |
| - RowsReturnedRate: 144.00 /sec |
| - TotalTime: 1s063ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 112.00 KB (114688) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 112.00 KB (114688) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s027ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 3.16 KB (3234) |
| - TotalGetBatchTime: 1s063ms |
| - DataWaitTime: 1s063ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 515.592us ; Min: 38.552us ; Max: 2.010ms ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 2.04 KB (2089) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee3190000000f (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Fragment Instance Lifecycle Event Timeline: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 133 (133) |
| - TotalNetworkReceiveTime: 1s063ms |
| - TotalNetworkSendTime: 11.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 1 (1) |
| - TotalThreadsTotalWallClockTime: 1s159ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 4.940ms |
| - TotalThreadsVoluntaryContextSwitches: 30 (30) |
| - TotalTime: 1s159ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s147ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 316.43 KB/sec ; Min: 61.71 KB/sec ; Max: 871.98 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 418.325us ; Min: 247.239us ; Max: 726.071us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 160.684us ; Min: 57.828us ; Max: 521.575us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 11.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 133 (133) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.81 KB (1856) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 2.73 KB (2793) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s159ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s159ms (11.999ms) |
| - Closed: 1s159ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 133 (133) |
| - RowsReturnedRate: 125.00 /sec |
| - TotalTime: 1s063ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 12 (12) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 133 (133) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 133 (133) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s111ms (1s027ms) |
| - First Batch Requested: 1s111ms (0.000ns) |
| - First Batch Returned: 1s147ms (35.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s063ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 133 (133) |
| - RowsReturnedRate: 125.00 /sec |
| - TotalTime: 1s063ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s027ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 2.73 KB (2793) |
| - TotalGetBatchTime: 1s063ms |
| - DataWaitTime: 1s063ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 98.825us ; Min: 40.228us ; Max: 335.239us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 1.76 KB (1802) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000010 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Fragment Instance Lifecycle Event Timeline: 1s159ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 1s147ms (1s147ms) |
| - First Batch Produced: 1s147ms (0.000ns) |
| - First Batch Sent: 1s147ms (0.000ns) |
| - ExecInternal Finished: 1s159ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.27 MB (2382816) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 141 (141) |
| - TotalNetworkReceiveTime: 1s063ms |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 0 (0) |
| - TotalThreadsTotalWallClockTime: 1s159ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 5.570ms |
| - TotalThreadsVoluntaryContextSwitches: 25 (25) |
| - TotalTime: 1s159ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 7.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s147ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 308.42 KB/sec ; Min: 115.27 KB/sec ; Max: 640.54 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 417.700us ; Min: 303.392us ; Max: 624.382us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 98.517us ; Min: 70.680us ; Max: 171.810us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 141 (141) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.92 KB (1967) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 2.89 KB (2961) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s159ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s147ms (1s063ms) |
| - First Batch Requested: 1s147ms (0.000ns) |
| - First Batch Returned: 1s147ms (0.000ns) |
| - Last Batch Returned: 1s159ms (11.999ms) |
| - Closed: 1s159ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 141 (141) |
| - RowsReturnedRate: 131.00 /sec |
| - TotalTime: 1s071ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 10 (10) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 141 (141) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 141 (141) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s115ms (1s031ms) |
| - First Batch Requested: 1s115ms (0.000ns) |
| - First Batch Returned: 1s147ms (31.999ms) |
| - Last Batch Returned: 1s147ms (0.000ns) |
| - Closed: 1s147ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s063ms |
| - PeakMemoryUsage: 112.00 KB (114688) |
| - RowsReturned: 141 (141) |
| - RowsReturnedRate: 132.00 /sec |
| - TotalTime: 1s063ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 112.00 KB (114688) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 112.00 KB (114688) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s031ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 2.89 KB (2961) |
| - TotalGetBatchTime: 1s063ms |
| - DataWaitTime: 1s063ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 148.203us ; Min: 38.832us ; Max: 374.071us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 1.88 KB (1924) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000015 (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Fragment Instance Lifecycle Event Timeline: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.27 MB (2382816) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 167 (167) |
| - TotalNetworkReceiveTime: 1s059ms |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 16 (16) |
| - TotalThreadsTotalWallClockTime: 1s147ms |
| - TotalThreadsSysTime: 2.746ms |
| - TotalThreadsUserTime: 76.568ms |
| - TotalThreadsVoluntaryContextSwitches: 35 (35) |
| - TotalTime: 1s151ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s135ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 3.999ms |
| - ExecTreePrepareTime: 3.999ms |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 376.23 KB/sec ; Min: 70.73 KB/sec ; Max: 592.20 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 430.518us ; Min: 173.485us ; Max: 1.546ms ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 122.017us ; Min: 50.007us ; Max: 246.680us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 167 (167) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 3.999ms |
| - TotalBytesSent: 2.24 KB (2294) |
| - TotalTime: 7.999ms |
| - UncompressedRowBatchSize: 3.42 KB (3507) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 167 (167) |
| - RowsReturnedRate: 155.00 /sec |
| - TotalTime: 1s071ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 10 (10) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 167 (167) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 167 (167) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s059ms |
| - PeakMemoryUsage: 112.00 KB (114688) |
| - RowsReturned: 167 (167) |
| - RowsReturnedRate: 157.00 /sec |
| - TotalTime: 1s059ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 112.00 KB (114688) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 112.00 KB (114688) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s027ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 3.42 KB (3507) |
| - TotalGetBatchTime: 1s059ms |
| - DataWaitTime: 1s059ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 472.756us ; Min: 45.257us ; Max: 1.830ms ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 2.19 KB (2240) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000011 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Fragment Instance Lifecycle Event Timeline: 1s147ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s135ms (1s131ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s203ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 169 (169) |
| - TotalNetworkReceiveTime: 1s051ms |
| - TotalNetworkSendTime: 7.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 3 (3) |
| - TotalThreadsTotalWallClockTime: 1s143ms |
| - TotalThreadsSysTime: 4.083ms |
| - TotalThreadsUserTime: 84.263ms |
| - TotalThreadsVoluntaryContextSwitches: 27 (27) |
| - TotalTime: 1s147ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s131ms |
| - ExecTreeOpenTime: 1s051ms |
| - PrepareTime: 3.999ms |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 373.70 KB/sec ; Min: 167.93 KB/sec ; Max: 739.55 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 422.581us ; Min: 159.517us ; Max: 717.411us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 154.143us ; Min: 51.683us ; Max: 330.769us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 7.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 169 (169) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.26 KB (2316) |
| - TotalTime: 7.999ms |
| - UncompressedRowBatchSize: 3.47 KB (3549) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s147ms (11.999ms) |
| - Closed: 1s147ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 169 (169) |
| - RowsReturnedRate: 160.00 /sec |
| - TotalTime: 1s055ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 3.999ms |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 169 (169) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 169 (169) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s051ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 169 (169) |
| - RowsReturnedRate: 160.00 /sec |
| - TotalTime: 1s051ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s015ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 3.47 KB (3549) |
| - TotalGetBatchTime: 1s051ms |
| - DataWaitTime: 1s051ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 176.559us ; Min: 40.508us ; Max: 644.497us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 2.20 KB (2248) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000016 (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Fragment Instance Lifecycle Event Timeline: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 163 (163) |
| - TotalNetworkReceiveTime: 1s059ms |
| - TotalNetworkSendTime: 11.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 3 (3) |
| - TotalThreadsTotalWallClockTime: 1s147ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 5.215ms |
| - TotalThreadsVoluntaryContextSwitches: 28 (28) |
| - TotalTime: 1s147ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s135ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 303.05 KB/sec ; Min: 71.64 KB/sec ; Max: 657.05 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 545.633us ; Min: 210.642us ; Max: 1.642ms ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 128.721us ; Min: 60.063us ; Max: 276.013us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 11.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 163 (163) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.19 KB (2241) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 3.34 KB (3423) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 163 (163) |
| - RowsReturnedRate: 153.00 /sec |
| - TotalTime: 1s063ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 10 (10) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 163 (163) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 163 (163) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s059ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 163 (163) |
| - RowsReturnedRate: 153.00 /sec |
| - TotalTime: 1s059ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s027ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 3.34 KB (3423) |
| - TotalGetBatchTime: 1s059ms |
| - DataWaitTime: 1s059ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 494.243us ; Min: 41.625us ; Max: 1.877ms ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 2.14 KB (2196) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000017 (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Fragment Instance Lifecycle Event Timeline: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 154 (154) |
| - TotalNetworkReceiveTime: 1s059ms |
| - TotalNetworkSendTime: 11.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 2 (2) |
| - TotalThreadsTotalWallClockTime: 1s147ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 4.756ms |
| - TotalThreadsVoluntaryContextSwitches: 26 (26) |
| - TotalTime: 1s147ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s135ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 368.75 KB/sec ; Min: 30.18 KB/sec ; Max: 843.00 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 541.689us ; Min: 139.963us ; Max: 1.841ms ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 107.029us ; Min: 48.609us ; Max: 226.286us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 11.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 154 (154) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.08 KB (2128) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 3.16 KB (3234) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 154 (154) |
| - RowsReturnedRate: 144.00 /sec |
| - TotalTime: 1s063ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 154 (154) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 154 (154) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s059ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 154 (154) |
| - RowsReturnedRate: 145.00 /sec |
| - TotalTime: 1s059ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s027ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 3.16 KB (3234) |
| - TotalGetBatchTime: 1s059ms |
| - DataWaitTime: 1s059ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 802.407us ; Min: 36.877us ; Max: 4.526ms ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 2.03 KB (2078) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000018 (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Fragment Instance Lifecycle Event Timeline: 1s151ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 1s139ms (1s135ms) |
| - First Batch Produced: 1s139ms (0.000ns) |
| - First Batch Sent: 1s139ms (0.000ns) |
| - ExecInternal Finished: 1s151ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 159 (159) |
| - TotalNetworkReceiveTime: 1s059ms |
| - TotalNetworkSendTime: 11.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 3 (3) |
| - TotalThreadsTotalWallClockTime: 1s147ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 5.535ms |
| - TotalThreadsVoluntaryContextSwitches: 28 (28) |
| - TotalTime: 1s147ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s135ms |
| - ExecTreeOpenTime: 1s063ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 337.77 KB/sec ; Min: 58.85 KB/sec ; Max: 895.41 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 519.077us ; Min: 193.042us ; Max: 1.858ms ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 97.334us ; Min: 39.950us ; Max: 194.159us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 11.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 159 (159) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.14 KB (2196) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 3.26 KB (3339) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s151ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s139ms (1s063ms) |
| - First Batch Requested: 1s139ms (0.000ns) |
| - First Batch Returned: 1s139ms (0.000ns) |
| - Last Batch Returned: 1s151ms (11.999ms) |
| - Closed: 1s151ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 159 (159) |
| - RowsReturnedRate: 149.00 /sec |
| - TotalTime: 1s063ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 159 (159) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 159 (159) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s139ms |
| - Open Started: 75.999ms (75.999ms) |
| - Open Finished: 1s103ms (1s027ms) |
| - First Batch Requested: 1s107ms (3.999ms) |
| - First Batch Returned: 1s139ms (31.999ms) |
| - Last Batch Returned: 1s139ms (0.000ns) |
| - Closed: 1s139ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s059ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 159 (159) |
| - RowsReturnedRate: 150.00 /sec |
| - TotalTime: 1s059ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s027ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 3.26 KB (3339) |
| - TotalGetBatchTime: 1s059ms |
| - DataWaitTime: 1s059ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 420.980us ; Min: 36.876us ; Max: 1.893ms ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 2.08 KB (2135) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000012 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Fragment Instance Lifecycle Event Timeline: 1s147ms |
| - Prepare Finished: 11.999ms (11.999ms) |
| - Open Finished: 1s135ms (1s123ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 140 (140) |
| - TotalNetworkReceiveTime: 1s051ms |
| - TotalNetworkSendTime: 7.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 2 (2) |
| - TotalThreadsTotalWallClockTime: 1s135ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 6.029ms |
| - TotalThreadsVoluntaryContextSwitches: 28 (28) |
| - TotalTime: 1s135ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s123ms |
| - ExecTreeOpenTime: 1s051ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 334.10 KB/sec ; Min: 76.49 KB/sec ; Max: 760.62 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 419.820us ; Min: 238.578us ; Max: 762.388us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 124.712us ; Min: 69.842us ; Max: 270.426us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 7.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 140 (140) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.92 KB (1966) |
| - TotalTime: 7.999ms |
| - UncompressedRowBatchSize: 2.87 KB (2940) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s143ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s143ms (7.999ms) |
| - Closed: 1s143ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 140 (140) |
| - RowsReturnedRate: 132.00 /sec |
| - TotalTime: 1s055ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 3.999ms |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 12 (12) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 140 (140) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 140 (140) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s051ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 140 (140) |
| - RowsReturnedRate: 133.00 /sec |
| - TotalTime: 1s051ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s015ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 2.87 KB (2940) |
| - TotalGetBatchTime: 1s051ms |
| - DataWaitTime: 1s051ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 90.770us ; Min: 41.347us ; Max: 216.508us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 1.87 KB (1914) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000013 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Fragment Instance Lifecycle Event Timeline: 1s147ms |
| - Prepare Finished: 11.999ms (11.999ms) |
| - Open Finished: 1s135ms (1s123ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 142 (142) |
| - TotalNetworkReceiveTime: 1s051ms |
| - TotalNetworkSendTime: 7.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 1 (1) |
| - TotalThreadsTotalWallClockTime: 1s135ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 5.462ms |
| - TotalThreadsVoluntaryContextSwitches: 28 (28) |
| - TotalTime: 1s135ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s123ms |
| - ExecTreeOpenTime: 1s051ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 272.93 KB/sec ; Min: 116.27 KB/sec ; Max: 487.31 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 460.148us ; Min: 207.290us ; Max: 711.265us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 118.450us ; Min: 42.463us ; Max: 246.959us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 7.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 142 (142) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.93 KB (1979) |
| - TotalTime: 7.999ms |
| - UncompressedRowBatchSize: 2.91 KB (2982) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s147ms (11.999ms) |
| - Closed: 1s147ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 142 (142) |
| - RowsReturnedRate: 134.00 /sec |
| - TotalTime: 1s055ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 3.999ms |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 10 (10) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 142 (142) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 142 (142) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s047ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 142 (142) |
| - RowsReturnedRate: 134.00 /sec |
| - TotalTime: 1s051ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s015ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 2.91 KB (2982) |
| - TotalGetBatchTime: 1s051ms |
| - DataWaitTime: 1s047ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 210.408us ; Min: 41.625us ; Max: 833.347us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 1.88 KB (1930) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000014 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Fragment Instance Lifecycle Event Timeline: 1s147ms |
| - Prepare Finished: 11.999ms (11.999ms) |
| - Open Finished: 1s135ms (1s123ms) |
| - First Batch Produced: 1s135ms (0.000ns) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s147ms (11.999ms) |
| - MemoryUsage (500.000ms): 30.97 KB, 30.97 KB, 30.97 KB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.26 MB (2374624) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 138 (138) |
| - TotalNetworkReceiveTime: 1s051ms |
| - TotalNetworkSendTime: 7.999ms |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 0 (0) |
| - TotalThreadsTotalWallClockTime: 1s135ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 5.449ms |
| - TotalThreadsVoluntaryContextSwitches: 27 (27) |
| - TotalTime: 1s135ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 11.999ms |
| - ExecTreeExecTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 1s123ms |
| - ExecTreeOpenTime: 1s051ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=4): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 270.74 KB/sec ; Min: 119.17 KB/sec ; Max: 507.95 KB/sec ; Number of samples: 16) |
| - RpcNetworkTime: (Avg: 447.625us ; Min: 244.165us ; Max: 712.662us ; Number of samples: 17) |
| - RpcRecvrTime: (Avg: 122.378us ; Min: 70.679us ; Max: 258.692us ; Number of samples: 17) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 7.999ms |
| - PeakMemoryUsage: 9.84 KB (10080) |
| - RowsSent: 138 (138) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.88 KB (1930) |
| - TotalTime: 7.999ms |
| - UncompressedRowBatchSize: 2.83 KB (2898) |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 1s147ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s135ms (1s051ms) |
| - First Batch Requested: 1s135ms (0.000ns) |
| - First Batch Returned: 1s135ms (0.000ns) |
| - Last Batch Returned: 1s147ms (11.999ms) |
| - Closed: 1s147ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.15 MB (2249856) |
| - RowsReturned: 138 (138) |
| - RowsReturnedRate: 130.00 /sec |
| - TotalTime: 1s055ms |
| GroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - MaxPartitionLevel: 0 (0) |
| - NumRepartitions: 0 (0) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.14 MB (2245760) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - RowsRepartitioned: 0 (0) |
| - RowsReturned: 138 (138) |
| - SpilledPartitions: 0 (0) |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 138 (138) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 1s099ms (1s015ms) |
| - First Batch Requested: 1s099ms (0.000ns) |
| - First Batch Returned: 1s135ms (35.999ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 1s051ms |
| - PeakMemoryUsage: 104.00 KB (106496) |
| - RowsReturned: 138 (138) |
| - RowsReturnedRate: 131.00 /sec |
| - TotalTime: 1s051ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 192.00 KB (196608) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 104.00 KB (106496) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 104.00 KB (106496) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0 |
| - FirstBatchWaitTime: 1s015ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 2.83 KB (2898) |
| - TotalGetBatchTime: 1s051ms |
| - DataWaitTime: 1s051ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0 |
| - DispatchTime: (Avg: 100.315us ; Min: 39.390us ; Max: 308.978us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 1.83 KB (1874) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Averaged Fragment F00 [12 instances]:(Total: 1s121ms, non-child: 93.332ms, % non-child: 8.32%) |
| split sizes: min: 15.76 MB, max: 21.12 MB, avg: 16.41 MB, stddev: 1.42 MB |
| completion times: min:1s191ms max:1s203ms mean: 1s197ms stddev:4.149ms |
| execution rates: min:13.22 MB/sec max:17.54 MB/sec mean:13.70 MB/sec stddev:1.16 MB/sec |
| num instances: 12 |
| Instances: |
| [0] Instance 454fb5fa46498311:3afee31900000001 (host=tarmstrong-Precision-7540:27001) |
| [1] Instance 454fb5fa46498311:3afee31900000002 (host=tarmstrong-Precision-7540:27001) |
| [2] Instance 454fb5fa46498311:3afee31900000003 (host=tarmstrong-Precision-7540:27001) |
| [3] Instance 454fb5fa46498311:3afee31900000004 (host=tarmstrong-Precision-7540:27001) |
| [4] Instance 454fb5fa46498311:3afee31900000005 (host=tarmstrong-Precision-7540:27000) |
| [5] Instance 454fb5fa46498311:3afee31900000006 (host=tarmstrong-Precision-7540:27000) |
| [6] Instance 454fb5fa46498311:3afee31900000007 (host=tarmstrong-Precision-7540:27000) |
| [7] Instance 454fb5fa46498311:3afee31900000008 (host=tarmstrong-Precision-7540:27000) |
| [8] Instance 454fb5fa46498311:3afee31900000009 (host=tarmstrong-Precision-7540:27002) |
| [9] Instance 454fb5fa46498311:3afee3190000000a (host=tarmstrong-Precision-7540:27002) |
| [10] Instance 454fb5fa46498311:3afee3190000000b (host=tarmstrong-Precision-7540:27002) |
| [11] Instance 454fb5fa46498311:3afee3190000000c (host=tarmstrong-Precision-7540:27002) |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[5]: 0:152/15.91 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[4]: 0:152/15.98 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[2]: 0:152/16.01 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[1]: 0:152/16.03 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[8]: 0:152/16.04 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[10]: 0:152/16.06 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[3]: 0:152/16.09 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[6]: 0:152/16.21 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[7]: 0:152/21.12 MB |
| Last report received time[8-11]: 2020-12-15 20:07:23.272 |
| Last report received time[0-3]: 2020-12-15 20:07:23.276 |
| Last report received time[4-7]: 2020-12-15 20:07:23.281 |
| - MemoryUsage[0] (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage[0] (500.000ms): 1, 1, 1 |
| Fragment Instance Lifecycle Event Timeline[0]: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s111ms (1s023ms) |
| - First Batch Sent: 1s111ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[1]: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s103ms (1s015ms) |
| - First Batch Sent: 1s103ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[2]: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s111ms (1s023ms) |
| - First Batch Sent: 1s111ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[3]: 1s119ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s119ms (11.999ms) |
| Fragment Instance Lifecycle Event Timeline[4]: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s111ms (1s023ms) |
| - First Batch Sent: 1s111ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[5]: 1s111ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s111ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[6]: 1s111ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s111ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[7]: 1s111ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s111ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[8]: 1s139ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s135ms (1s023ms) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s139ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[9]: 1s131ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s127ms (1s015ms) |
| - First Batch Sent: 1s127ms (0.000ns) |
| - ExecInternal Finished: 1s131ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[10]: 1s139ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s135ms (1s023ms) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s139ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[11]: 1s131ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s127ms (1s015ms) |
| - First Batch Sent: 1s127ms (0.000ns) |
| - ExecInternal Finished: 1s131ms (3.999ms) |
| - AverageThreadTokens: mean=1.00 min=1.00 max=1.00 |
| - BytesAssigned: mean=16.41 MB (17209364) min=15.76 MB (16526332) max=21.12 MB (22147452) |
| - CompletionTime: mean=1s197ms min=1s191ms max=1s203ms |
| - ExchangeScanRatio: mean=0.00 min=0.00 max=0.00 |
| - ExecutionRate: mean=13.70 MB/sec min=13.22 MB/sec max=17.54 MB/sec |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakMemoryUsage: mean=2.28 MB (2387200) min=2.28 MB (2387200) max=2.28 MB (2387200) |
| - PeakReservation: mean=2.12 MB (2228224) min=2.12 MB (2228224) max=2.12 MB (2228224) |
| - PeakUsedReservation: mean=0 min=0 max=0 |
| - PerHostPeakMemUsage: mean=18.01 MB (18888699) min=17.93 MB (18805120) max=18.07 MB (18946812) |
| - RowsProduced: mean=152 (152) min=150 (150) max=155 (155) |
| - TotalNetworkReceiveTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalNetworkSendTime: mean=3.666ms min=0.000ns max=11.999ms |
| - TotalStorageWaitTime: mean=940.656ms min=887.990ms max=979.989ms |
| - TotalThreadsInvoluntaryContextSwitches: mean=13 (13) min=4 (4) max=37 (37) |
| - TotalThreadsTotalWallClockTime: mean=1s121ms min=1s111ms max=1s139ms |
| - TotalThreadsSysTime: mean=5.361ms min=0.000ns max=10.991ms |
| - TotalThreadsUserTime: mean=81.152ms min=51.295ms max=164.809ms |
| - TotalThreadsVoluntaryContextSwitches: mean=261 (261) min=248 (248) max=281 (281) |
| - TotalTime: mean=1s121ms min=1s111ms max=1s139ms |
| Fragment Instance Lifecycle Timings [12 instances]: |
| - ExecTime: mean=1s025ms min=1s019ms max=1s031ms |
| - ExecTreeExecTime: mean=1s020ms min=1s015ms max=1s023ms |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - OpenTime: mean=95.998ms min=87.999ms max=111.998ms |
| - ExecTreeOpenTime: mean=2.666ms min=0.000ns max=3.999ms |
| - PrepareTime: mean=0.000ns min=0.000ns max=0.000ns |
| - ExecTreePrepareTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| KrpcDataStreamSender (dst_id=2) [12 instances]:(Total: 5.333ms, non-child: 1.666ms, % non-child: 31.25%) |
| ExecOption[0-11]: Hash Partitioned Sender Codegen Enabled |
| - BytesSent[0] (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 220.47 KB/sec ; Min: 14.07 KB/sec ; Max: 1.13 MB/sec ; Number of samples: 144) |
| - RpcNetworkTime: (Avg: 1.302ms ; Min: 185.499us ; Max: 8.207ms ; Number of samples: 288) |
| - RpcRecvrTime: (Avg: 250.737us ; Min: 39.670us ; Max: 4.570ms ; Number of samples: 288) |
| - EosSent: mean=12 (12) min=12 (12) max=12 (12) |
| - InactiveTotalTime: mean=3.666ms min=0.000ns max=11.999ms |
| - PeakMemoryUsage: mean=166.12 KB (170112) min=166.12 KB (170112) max=166.12 KB (170112) |
| - RowsSent: mean=152 (152) min=150 (150) max=155 (155) |
| - RpcFailure: mean=0 (0) min=0 (0) max=0 (0) |
| - RpcRetry: mean=0 (0) min=0 (0) max=0 (0) |
| - SerializeBatchTime: mean=333.329us min=0.000ns max=3.999ms |
| - TotalBytesSent: mean=2.00 KB (2053) min=1.98 KB (2024) max=2.04 KB (2089) |
| - TotalTime: mean=5.333ms min=3.999ms max=11.999ms |
| - UncompressedRowBatchSize: mean=3.12 KB (3192) min=3.08 KB (3150) max=3.18 KB (3255) |
| AGGREGATION_NODE (id=1) [12 instances]:(Total: 1s023ms, non-child: 5.999ms, % non-child: 0.59%) |
| Node Lifecycle Event Timeline[0]: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s111ms (1s023ms) |
| - Last Batch Returned: 1s111ms (0.000ns) |
| - Closed: 1s111ms (0.000ns) |
| Node Lifecycle Event Timeline[1]: 1s103ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s103ms (1s015ms) |
| - Last Batch Returned: 1s103ms (0.000ns) |
| - Closed: 1s103ms (0.000ns) |
| Node Lifecycle Event Timeline[2]: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s111ms (1s023ms) |
| - Last Batch Returned: 1s111ms (0.000ns) |
| - Closed: 1s111ms (0.000ns) |
| Node Lifecycle Event Timeline[3]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[4]: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s111ms (1s023ms) |
| - Last Batch Returned: 1s111ms (0.000ns) |
| - Closed: 1s111ms (0.000ns) |
| Node Lifecycle Event Timeline[5]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[6]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[7]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[8]: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s135ms (1s023ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[9]: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s127ms (1s015ms) |
| - Last Batch Returned: 1s127ms (0.000ns) |
| - Closed: 1s127ms (0.000ns) |
| Node Lifecycle Event Timeline[10]: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s135ms (1s023ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[11]: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s127ms (1s015ms) |
| - Last Batch Returned: 1s127ms (0.000ns) |
| - Closed: 1s127ms (0.000ns) |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakMemoryUsage: mean=2.02 MB (2122880) min=2.02 MB (2122880) max=2.02 MB (2122880) |
| - RowsReturned: mean=152 (152) min=150 (150) max=155 (155) |
| - RowsReturnedRate: mean=148.00 /sec min=145.00 /sec max=151.00 /sec |
| - TotalTime: mean=1s023ms min=1s015ms max=1s027ms |
| GroupingAggregator 0 [12 instances]: |
| ExecOption[0-11]: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: mean=0.000ns min=0.000ns max=0.000ns |
| - GetResultsTime: mean=0.000ns min=0.000ns max=0.000ns |
| - HTResizeTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - LargestPartitionPercent: mean=9 (9) min=8 (8) max=12 (12) |
| - PartitionsCreated: mean=16 (16) min=16 (16) max=16 (16) |
| - PeakMemoryUsage: mean=2.01 MB (2110592) min=2.01 MB (2110592) max=2.01 MB (2110592) |
| - PeakReservation: mean=2.00 MB (2097152) min=2.00 MB (2097152) max=2.00 MB (2097152) |
| - PeakUsedReservation: mean=0 min=0 max=0 |
| - ReductionFactorEstimate: mean=0.00 min=0.00 max=0.00 |
| - ReductionFactorThresholdToExpand: mean=0.00 min=0.00 max=0.00 |
| - RowsPassedThrough: mean=0 (0) min=0 (0) max=0 (0) |
| - RowsReturned: mean=152 (152) min=150 (150) max=155 (155) |
| - StreamingTime: mean=1.999ms min=0.000ns max=3.999ms |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| Buffer pool [12 instances]: |
| - AllocTime: mean=333.329us min=0.000ns max=3.999ms |
| - CompressionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - CumulativeAllocationBytes: mean=1.25 MB (1310720) min=1.25 MB (1310720) max=1.25 MB (1310720) |
| - CumulativeAllocations: mean=20 (20) min=20 (20) max=20 (20) |
| - EncryptionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakReservation: mean=2.00 MB (2097152) min=2.00 MB (2097152) max=2.00 MB (2097152) |
| - PeakUnpinnedBytes: mean=0 min=0 max=0 |
| - PeakUsedReservation: mean=1.25 MB (1310720) min=1.25 MB (1310720) max=1.25 MB (1310720) |
| - ReadIoBytes: mean=0 min=0 max=0 |
| - ReadIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - ReadIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| - SystemAllocTime: mean=333.329us min=0.000ns max=3.999ms |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - WriteIoBytes: mean=0 min=0 max=0 |
| - WriteIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - WriteIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| Hash Table [12 instances]: |
| - HashBuckets: mean=16.38K (16384) min=16.38K (16384) max=16.38K (16384) |
| - HashCollisions: mean=0 (0) min=0 (0) max=0 (0) |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - Probes: mean=152 (152) min=150 (150) max=155 (155) |
| - Resizes: mean=0 (0) min=0 (0) max=0 (0) |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - Travel: mean=0 (0) min=0 (0) max=0 (0) |
| HDFS_SCAN_NODE (id=0) [12 instances]:(Total: 1s017ms, non-child: 1s017ms, % non-child: 100.00%) |
| ExecOption[2,8]: PARQUET Codegen Enabled, Codegen enabled: 150 out of 150 |
| ExecOption[1,4,9]: PARQUET Codegen Enabled, Codegen enabled: 151 out of 151 |
| ExecOption[0,5,7]: PARQUET Codegen Enabled, Codegen enabled: 152 out of 152 |
| ExecOption[6,10]: PARQUET Codegen Enabled, Codegen enabled: 153 out of 153 |
| ExecOption[11]: PARQUET Codegen Enabled, Codegen enabled: 154 out of 154 |
| ExecOption[3]: PARQUET Codegen Enabled, Codegen enabled: 155 out of 155 |
| File Formats[2,8]: PARQUET/Unknown(Skipped):150 |
| File Formats[1,4,9]: PARQUET/Unknown(Skipped):151 |
| File Formats[0,5,7]: PARQUET/Unknown(Skipped):152 |
| File Formats[6,10]: PARQUET/Unknown(Skipped):153 |
| File Formats[11]: PARQUET/Unknown(Skipped):154 |
| File Formats[3]: PARQUET/Unknown(Skipped):155 |
| Hdfs Read Thread Concurrency Bucket[0-7,10]: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Hdfs Read Thread Concurrency Bucket[8-9,11]: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Table Name[0-11]: tpcds_parquet.store_sales |
| - BytesReadSeries[0] (500.000ms): 0, 4.35 MB, 10.67 MB |
| Node Lifecycle Event Timeline[0]: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s107ms (927.989ms) |
| - Closed: 1s111ms (3.999ms) |
| Node Lifecycle Event Timeline[1]: 1s103ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s103ms (923.989ms) |
| - Closed: 1s103ms (0.000ns) |
| Node Lifecycle Event Timeline[2]: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s111ms (931.989ms) |
| - Closed: 1s111ms (0.000ns) |
| Node Lifecycle Event Timeline[3]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s107ms (927.989ms) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[4]: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s111ms (927.989ms) |
| - Closed: 1s111ms (0.000ns) |
| Node Lifecycle Event Timeline[5]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s107ms (923.989ms) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[6]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s107ms (923.989ms) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[7]: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s107ms (923.989ms) |
| - Closed: 1s107ms (0.000ns) |
| Node Lifecycle Event Timeline[8]: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s135ms (923.989ms) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[9]: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s127ms (915.989ms) |
| - Closed: 1s127ms (0.000ns) |
| Node Lifecycle Event Timeline[10]: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s135ms (923.989ms) |
| - Closed: 1s135ms (0.000ns) |
| Node Lifecycle Event Timeline[11]: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s127ms (915.989ms) |
| - Closed: 1s127ms (0.000ns) |
| - FooterProcessingTime: (Avg: 6.355ms ; Min: 0.000ns ; Max: 99.998ms ; Number of samples: 1824) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1824) |
| - InitialRangeIdealReservation: (Avg: 112.28 KB (114975) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 1824) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1824) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 1824) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: mean=0.75 min=0.50 max=1.00 |
| - BytesRead: mean=11.84 MB (12417186) min=11.45 MB (12005633) max=12.27 MB (12869946) |
| - BytesReadDataNodeCache: mean=0 min=0 max=0 |
| - BytesReadLocal: mean=11.84 MB (12417186) min=11.45 MB (12005633) max=12.27 MB (12869946) |
| - BytesReadRemoteUnexpected: mean=0 min=0 max=0 |
| - BytesReadShortCircuit: mean=11.84 MB (12417186) min=11.45 MB (12005633) max=12.27 MB (12869946) |
| - CachedFileHandlesHitCount: mean=0 (0) min=0 (0) max=0 (0) |
| - CachedFileHandlesMissCount: mean=152 (152) min=150 (150) max=155 (155) |
| - CollectionItemsRead: mean=0 (0) min=0 (0) max=0 (0) |
| - DataCacheHitBytes: mean=0 min=0 max=0 |
| - DataCacheHitCount: mean=0 (0) min=0 (0) max=0 (0) |
| - DataCacheMissBytes: mean=0 min=0 max=0 |
| - DataCacheMissCount: mean=0 (0) min=0 (0) max=0 (0) |
| - DataCachePartialHitCount: mean=0 (0) min=0 (0) max=0 (0) |
| - DecompressionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - MaterializeTupleTime: mean=0.000ns min=0.000ns max=0.000ns |
| - MaxCompressedTextFileLength: mean=0 min=0 max=0 |
| - NumColumns: mean=0 (0) min=0 (0) max=0 (0) |
| - NumDictFilteredRowGroups: mean=0 (0) min=0 (0) max=0 (0) |
| - NumDisksAccessed: mean=1 (1) min=1 (1) max=1 (1) |
| - NumPages: mean=0 (0) min=0 (0) max=0 (0) |
| - NumRowGroups: mean=152 (152) min=150 (150) max=155 (155) |
| - NumRowGroupsWithPageIndex: mean=152 (152) min=150 (150) max=155 (155) |
| - NumScannersWithNoReads: mean=0 (0) min=0 (0) max=0 (0) |
| - NumStatsFilteredPages: mean=0 (0) min=0 (0) max=0 (0) |
| - NumStatsFilteredRowGroups: mean=0 (0) min=0 (0) max=0 (0) |
| - PeakMemoryUsage: mean=132.00 KB (135168) min=132.00 KB (135168) max=132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: mean=32.22 MB/sec min=29.48 MB/sec max=34.59 MB/sec |
| - RemoteScanRanges: mean=0 (0) min=0 (0) max=0 (0) |
| - RowsRead: mean=0 (0) min=0 (0) max=0 (0) |
| - RowsReturned: mean=152 (152) min=150 (150) max=155 (155) |
| - RowsReturnedRate: mean=149.00 /sec min=147.00 /sec max=152.00 /sec |
| - ScanRangesComplete: mean=152 (152) min=150 (150) max=155 (155) |
| - ScannerIoWaitTime: mean=940.656ms min=887.990ms max=979.989ms |
| - TotalRawHdfsOpenFileTime: mean=524.994ms min=467.994ms max=563.993ms |
| - TotalRawHdfsReadTime: mean=368.329ms min=343.996ms max=399.995ms |
| - TotalReadThroughput: mean=7.15 MB/sec min=6.80 MB/sec max=7.49 MB/sec |
| - TotalTime: mean=1s017ms min=1s011ms max=1s023ms |
| Buffer pool [12 instances]: |
| - AllocTime: mean=333.329us min=0.000ns max=3.999ms |
| - CompressionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - CumulativeAllocationBytes: mean=16.67 MB (17476266) min=16.25 MB (17039360) max=17.75 MB (18612224) |
| - CumulativeAllocations: mean=152 (152) min=150 (150) max=155 (155) |
| - EncryptionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakReservation: mean=128.00 KB (131072) min=128.00 KB (131072) max=128.00 KB (131072) |
| - PeakUnpinnedBytes: mean=0 min=0 max=0 |
| - PeakUsedReservation: mean=128.00 KB (131072) min=128.00 KB (131072) max=128.00 KB (131072) |
| - ReadIoBytes: mean=0 min=0 max=0 |
| - ReadIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - ReadIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| - SystemAllocTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - WriteIoBytes: mean=0 min=0 max=0 |
| - WriteIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - WriteIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000009 (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.04 MB |
| Fragment Instance Lifecycle Event Timeline: 1s139ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s135ms (1s023ms) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s139ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.27 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.04 MB (16818798) |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.46 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 150 (150) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 939.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 13 (13) |
| - TotalThreadsTotalWallClockTime: 1s139ms |
| - TotalThreadsSysTime: 4.337ms |
| - TotalThreadsUserTime: 164.809ms |
| - TotalThreadsVoluntaryContextSwitches: 281 (281) |
| - TotalTime: 1s139ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s027ms |
| - ExecTreeExecTime: 1s023ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 111.998ms |
| - ExecTreeOpenTime: 0.000ns |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 541.31 KB/sec ; Min: 192.27 KB/sec ; Max: 918.70 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 583.606us ; Min: 209.244us ; Max: 1.292ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 317.231us ; Min: 43.581us ; Max: 2.296ms ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 150 (150) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.98 KB (2024) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.08 KB (3150) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s135ms (1s023ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 150 (150) |
| - RowsReturnedRate: 146.00 /sec |
| - TotalTime: 1s023ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 8 (8) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 150 (150) |
| - StreamingTime: 3.999ms |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 150 (150) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 150 out of 150 |
| Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):150 |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s135ms (923.989ms) |
| - Closed: 1s135ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.88 MB, 10.20 MB |
| - FooterProcessingTime: (Avg: 6.399ms ; Min: 3.999ms ; Max: 99.998ms ; Number of samples: 150) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 150) |
| - InitialRangeIdealReservation: (Avg: 112.21 KB (114906) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 150) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 150) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 150) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 0.50 |
| - BytesRead: 11.55 MB (12111960) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.55 MB (12111960) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.55 MB (12111960) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 150 (150) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 150 (150) |
| - NumRowGroupsWithPageIndex: 150 (150) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 31.05 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 150 (150) |
| - RowsReturnedRate: 147.00 /sec |
| - ScanRangesComplete: 150 (150) |
| - ScannerIoWaitTime: 939.989ms |
| - TotalRawHdfsOpenFileTime: 519.994ms |
| - TotalRawHdfsReadTime: 371.995ms |
| - TotalReadThroughput: 6.80 MB/sec |
| - TotalTime: 1s019ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.44 MB (17235968) |
| - CumulativeAllocations: 150 (150) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee3190000000b (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.06 MB |
| Fragment Instance Lifecycle Event Timeline: 1s139ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s135ms (1s023ms) |
| - First Batch Sent: 1s135ms (0.000ns) |
| - ExecInternal Finished: 1s139ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.06 MB (16835710) |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.47 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 153 (153) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 947.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 4 (4) |
| - TotalThreadsTotalWallClockTime: 1s139ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 63.956ms |
| - TotalThreadsVoluntaryContextSwitches: 250 (250) |
| - TotalTime: 1s139ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s027ms |
| - ExecTreeExecTime: 1s023ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 111.998ms |
| - ExecTreeOpenTime: 0.000ns |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 520.18 KB/sec ; Min: 162.13 KB/sec ; Max: 1.13 MB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 473.827us ; Min: 199.467us ; Max: 946.770us ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 157.061us ; Min: 39.950us ; Max: 471.569us ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 153 (153) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.03 KB (2079) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.14 KB (3213) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s135ms (1s023ms) |
| - Last Batch Returned: 1s135ms (0.000ns) |
| - Closed: 1s135ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 153 (153) |
| - RowsReturnedRate: 149.00 /sec |
| - TotalTime: 1s023ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 153 (153) |
| - StreamingTime: 0.000ns |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 153 (153) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 153 out of 153 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):153 |
| Node Lifecycle Event Timeline: 1s135ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s135ms (923.989ms) |
| - Closed: 1s135ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.92 MB, 10.43 MB |
| - FooterProcessingTime: (Avg: 6.352ms ; Min: 0.000ns ; Max: 99.998ms ; Number of samples: 153) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 153) |
| - InitialRangeIdealReservation: (Avg: 112.94 KB (115651) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 153) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 153) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 153) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 11.96 MB (12537516) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.96 MB (12537516) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.96 MB (12537516) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 153 (153) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 153 (153) |
| - NumRowGroupsWithPageIndex: 153 (153) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 33.97 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 153 (153) |
| - RowsReturnedRate: 149.00 /sec |
| - ScanRangesComplete: 153 (153) |
| - ScannerIoWaitTime: 947.989ms |
| - TotalRawHdfsOpenFileTime: 547.993ms |
| - TotalRawHdfsReadTime: 351.996ms |
| - TotalReadThroughput: 6.95 MB/sec |
| - TotalTime: 1s023ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.88 MB (17694720) |
| - CumulativeAllocations: 153 (153) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee3190000000a (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.86 MB |
| Fragment Instance Lifecycle Event Timeline: 1s131ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s127ms (1s015ms) |
| - First Batch Sent: 1s127ms (0.000ns) |
| - ExecInternal Finished: 1s131ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.27 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.86 MB (16634121) |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.31 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 151 (151) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 935.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 10 (10) |
| - TotalThreadsTotalWallClockTime: 1s131ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 62.065ms |
| - TotalThreadsVoluntaryContextSwitches: 278 (278) |
| - TotalTime: 1s131ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s019ms |
| - ExecTreeExecTime: 1s015ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 111.998ms |
| - ExecTreeOpenTime: 0.000ns |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 151.41 KB/sec ; Min: 61.43 KB/sec ; Max: 193.49 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 732.228us ; Min: 263.162us ; Max: 1.293ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 190.154us ; Min: 39.670us ; Max: 695.900us ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 151 (151) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.99 KB (2036) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.10 KB (3171) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s127ms (1s015ms) |
| - Last Batch Returned: 1s127ms (0.000ns) |
| - Closed: 1s127ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 151 (151) |
| - RowsReturnedRate: 148.00 /sec |
| - TotalTime: 1s015ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 11 (11) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 151 (151) |
| - StreamingTime: 3.999ms |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 151 (151) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 151 out of 151 |
| Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):151 |
| Node Lifecycle Event Timeline: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s127ms (915.989ms) |
| - Closed: 1s127ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.89 MB, 10.53 MB |
| - FooterProcessingTime: (Avg: 6.357ms ; Min: 0.000ns ; Max: 99.998ms ; Number of samples: 151) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - InitialRangeIdealReservation: (Avg: 111.89 KB (114579) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 151) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 0.50 |
| - BytesRead: 11.81 MB (12387575) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.81 MB (12387575) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.81 MB (12387575) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 151 (151) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 151 (151) |
| - NumRowGroupsWithPageIndex: 151 (151) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 33.56 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 151 (151) |
| - RowsReturnedRate: 149.00 /sec |
| - ScanRangesComplete: 151 (151) |
| - ScannerIoWaitTime: 935.989ms |
| - TotalRawHdfsOpenFileTime: 527.994ms |
| - TotalRawHdfsReadTime: 351.996ms |
| - TotalReadThroughput: 7.02 MB/sec |
| - TotalTime: 1s011ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.50 MB (17301504) |
| - CumulativeAllocations: 151 (151) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee3190000000c (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:23.272 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.76 MB |
| Fragment Instance Lifecycle Event Timeline: 1s131ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 111.998ms (111.998ms) |
| - First Batch Produced: 1s127ms (1s015ms) |
| - First Batch Sent: 1s127ms (0.000ns) |
| - ExecInternal Finished: 1s131ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.27 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.76 MB (16526332) |
| - CompletionTime: 1s191ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.22 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.07 MB (18946812) |
| - RowsProduced: 154 (154) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 907.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 9 (9) |
| - TotalThreadsTotalWallClockTime: 1s131ms |
| - TotalThreadsSysTime: 10.991ms |
| - TotalThreadsUserTime: 51.295ms |
| - TotalThreadsVoluntaryContextSwitches: 248 (248) |
| - TotalTime: 1s131ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s019ms |
| - ExecTreeExecTime: 1s015ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 111.998ms |
| - ExecTreeOpenTime: 0.000ns |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 149.84 KB/sec ; Min: 91.06 KB/sec ; Max: 211.29 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 743.286us ; Min: 275.455us ; Max: 1.263ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 112.479us ; Min: 41.625us ; Max: 344.737us ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 154 (154) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.03 KB (2079) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.16 KB (3234) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 1s127ms (1s015ms) |
| - Last Batch Returned: 1s127ms (0.000ns) |
| - Closed: 1s127ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 154 (154) |
| - RowsReturnedRate: 151.00 /sec |
| - TotalTime: 1s015ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 8 (8) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 154 (154) |
| - StreamingTime: 3.999ms |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 3.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 3.999ms |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 154 (154) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 154 out of 154 |
| Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):154 |
| Node Lifecycle Event Timeline: 1s127ms |
| - Open Started: 111.998ms (111.998ms) |
| - Open Finished: 111.998ms (0.000ns) |
| - First Batch Requested: 111.998ms (0.000ns) |
| - First Batch Returned: 211.997ms (99.998ms) |
| - Last Batch Returned: 1s127ms (915.989ms) |
| - Closed: 1s127ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.96 MB, 10.67 MB |
| - FooterProcessingTime: (Avg: 6.103ms ; Min: 0.000ns ; Max: 99.998ms ; Number of samples: 154) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 154) |
| - InitialRangeIdealReservation: (Avg: 110.96 KB (113624) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 154) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 154) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 154) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 0.50 |
| - BytesRead: 11.99 MB (12573957) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.99 MB (12573957) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.99 MB (12573957) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 154 (154) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 154 (154) |
| - NumRowGroupsWithPageIndex: 154 (154) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 31.23 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 154 (154) |
| - RowsReturnedRate: 152.00 /sec |
| - ScanRangesComplete: 154 (154) |
| - ScannerIoWaitTime: 907.989ms |
| - TotalRawHdfsOpenFileTime: 479.994ms |
| - TotalRawHdfsReadTime: 383.995ms |
| - TotalReadThroughput: 7.11 MB/sec |
| - TotalTime: 1s011ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.69 MB (17498112) |
| - CumulativeAllocations: 154 (154) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000004 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.09 MB |
| Fragment Instance Lifecycle Event Timeline: 1s119ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s119ms (11.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.09 MB (16871797) |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.41 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 155 (155) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 7.999ms |
| - TotalStorageWaitTime: 975.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 15 (15) |
| - TotalThreadsTotalWallClockTime: 1s119ms |
| - TotalThreadsSysTime: 6.650ms |
| - TotalThreadsUserTime: 59.852ms |
| - TotalThreadsVoluntaryContextSwitches: 265 (265) |
| - TotalTime: 1s119ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s031ms |
| - ExecTreeExecTime: 1s019ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 36.04 KB/sec ; Min: 24.75 KB/sec ; Max: 46.69 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 2.579ms ; Min: 283.836us ; Max: 5.068ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 479.496us ; Min: 42.463us ; Max: 4.570ms ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 7.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 155 (155) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.04 KB (2089) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 3.18 KB (3255) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 155 (155) |
| - RowsReturnedRate: 151.00 /sec |
| - TotalTime: 1s023ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 155 (155) |
| - StreamingTime: 3.999ms |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 155 (155) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 155 out of 155 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):155 |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s107ms (927.989ms) |
| - Closed: 1s107ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.94 MB, 11.24 MB |
| - FooterProcessingTime: (Avg: 6.399ms ; Min: 3.999ms ; Max: 91.998ms ; Number of samples: 155) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 155) |
| - InitialRangeIdealReservation: (Avg: 117.26 KB (120078) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 155) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 155) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 155) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 12.27 MB (12869946) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 12.27 MB (12869946) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 12.27 MB (12869946) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 155 (155) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 155 (155) |
| - NumRowGroupsWithPageIndex: 155 (155) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 32.99 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 155 (155) |
| - RowsReturnedRate: 151.00 /sec |
| - ScanRangesComplete: 155 (155) |
| - ScannerIoWaitTime: 975.989ms |
| - TotalRawHdfsOpenFileTime: 555.993ms |
| - TotalRawHdfsReadTime: 371.995ms |
| - TotalReadThroughput: 7.49 MB/sec |
| - TotalTime: 1s019ms |
| Buffer pool: |
| - AllocTime: 3.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 17.75 MB (18612224) |
| - CumulativeAllocations: 155 (155) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000001 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.87 MB |
| Fragment Instance Lifecycle Event Timeline: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s111ms (1s023ms) |
| - First Batch Sent: 1s111ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.87 MB (16641560) |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.23 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 152 (152) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 919.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 12 (12) |
| - TotalThreadsTotalWallClockTime: 1s115ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 64.146ms |
| - TotalThreadsVoluntaryContextSwitches: 248 (248) |
| - TotalTime: 1s115ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s027ms |
| - ExecTreeExecTime: 1s023ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 108.31 KB/sec ; Min: 56.94 KB/sec ; Max: 228.02 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 1.187ms ; Min: 319.036us ; Max: 1.877ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 439.744us ; Min: 41.067us ; Max: 2.048ms ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 152 (152) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.00 KB (2049) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.12 KB (3192) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s111ms (1s023ms) |
| - Last Batch Returned: 1s111ms (0.000ns) |
| - Closed: 1s111ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 152 (152) |
| - RowsReturnedRate: 147.00 /sec |
| - TotalTime: 1s027ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 12 (12) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 152 (152) |
| - StreamingTime: 3.999ms |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 152 (152) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 152 out of 152 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):152 |
| Node Lifecycle Event Timeline: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s107ms (927.989ms) |
| - Closed: 1s111ms (3.999ms) |
| - BytesReadSeries (500.000ms): 0, 4.35 MB, 10.67 MB |
| - FooterProcessingTime: (Avg: 6.210ms ; Min: 0.000ns ; Max: 91.998ms ; Number of samples: 152) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - InitialRangeIdealReservation: (Avg: 109.47 KB (112101) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 152) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 11.56 MB (12118610) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.56 MB (12118610) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.56 MB (12118610) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 152 (152) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 152 (152) |
| - NumRowGroupsWithPageIndex: 152 (152) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 29.48 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 152 (152) |
| - RowsReturnedRate: 149.00 /sec |
| - ScanRangesComplete: 152 (152) |
| - ScannerIoWaitTime: 919.989ms |
| - TotalRawHdfsOpenFileTime: 467.994ms |
| - TotalRawHdfsReadTime: 391.995ms |
| - TotalReadThroughput: 7.12 MB/sec |
| - TotalTime: 1s015ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.25 MB (17039360) |
| - CumulativeAllocations: 152 (152) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000002 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.03 MB |
| Fragment Instance Lifecycle Event Timeline: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s103ms (1s015ms) |
| - First Batch Sent: 1s103ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (11.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.03 MB (16812382) |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.36 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 151 (151) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 11.999ms |
| - TotalStorageWaitTime: 887.990ms |
| - TotalThreadsInvoluntaryContextSwitches: 17 (17) |
| - TotalThreadsTotalWallClockTime: 1s115ms |
| - TotalThreadsSysTime: 6.324ms |
| - TotalThreadsUserTime: 142.294ms |
| - TotalThreadsVoluntaryContextSwitches: 280 (280) |
| - TotalTime: 1s115ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s027ms |
| - ExecTreeExecTime: 1s015ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 22.15 KB/sec ; Min: 14.07 KB/sec ; Max: 29.72 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 4.039ms ; Min: 312.610us ; Max: 8.207ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 245.981us ; Min: 49.447us ; Max: 1.795ms ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 11.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 151 (151) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.99 KB (2036) |
| - TotalTime: 11.999ms |
| - UncompressedRowBatchSize: 3.10 KB (3171) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s103ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s103ms (1s015ms) |
| - Last Batch Returned: 1s103ms (0.000ns) |
| - Closed: 1s103ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 151 (151) |
| - RowsReturnedRate: 148.00 /sec |
| - TotalTime: 1s019ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 151 (151) |
| - StreamingTime: 0.000ns |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 151 (151) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 151 out of 151 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):151 |
| Node Lifecycle Event Timeline: 1s103ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s103ms (923.989ms) |
| - Closed: 1s103ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.37 MB, 10.68 MB |
| - FooterProcessingTime: (Avg: 6.225ms ; Min: 0.000ns ; Max: 91.998ms ; Number of samples: 151) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - InitialRangeIdealReservation: (Avg: 110.20 KB (112843) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 151) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 11.63 MB (12197656) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.63 MB (12197656) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.63 MB (12197656) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 151 (151) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 151 (151) |
| - NumRowGroupsWithPageIndex: 151 (151) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 33.05 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 151 (151) |
| - RowsReturnedRate: 148.00 /sec |
| - ScanRangesComplete: 151 (151) |
| - ScannerIoWaitTime: 887.990ms |
| - TotalRawHdfsOpenFileTime: 499.994ms |
| - TotalRawHdfsReadTime: 351.996ms |
| - TotalReadThroughput: 7.12 MB/sec |
| - TotalTime: 1s015ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.25 MB (17039360) |
| - CumulativeAllocations: 151 (151) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000003 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:23.276 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.01 MB |
| Fragment Instance Lifecycle Event Timeline: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s111ms (1s023ms) |
| - First Batch Sent: 1s111ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.01 MB (16787175) |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.34 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 17.93 MB (18805120) |
| - RowsProduced: 150 (150) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 947.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 8 (8) |
| - TotalThreadsTotalWallClockTime: 1s115ms |
| - TotalThreadsSysTime: 8.945ms |
| - TotalThreadsUserTime: 53.674ms |
| - TotalThreadsVoluntaryContextSwitches: 255 (255) |
| - TotalTime: 1s115ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s027ms |
| - ExecTreeExecTime: 1s023ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 122.92 KB/sec ; Min: 79.35 KB/sec ; Max: 205.69 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 1.106ms ; Min: 653.995us ; Max: 1.772ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 407.466us ; Min: 42.464us ; Max: 1.928ms ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 150 (150) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.98 KB (2029) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.08 KB (3150) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s111ms (1s023ms) |
| - Last Batch Returned: 1s111ms (0.000ns) |
| - Closed: 1s111ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 150 (150) |
| - RowsReturnedRate: 145.00 /sec |
| - TotalTime: 1s027ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 150 (150) |
| - StreamingTime: 0.000ns |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 150 (150) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 150 out of 150 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):150 |
| Node Lifecycle Event Timeline: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 179.998ms (91.998ms) |
| - Last Batch Returned: 1s111ms (931.989ms) |
| - Closed: 1s111ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.38 MB, 11.07 MB |
| - FooterProcessingTime: (Avg: 6.453ms ; Min: 0.000ns ; Max: 91.998ms ; Number of samples: 150) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 150) |
| - InitialRangeIdealReservation: (Avg: 116.91 KB (119712) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 150) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 150) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 150) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 12.00 MB (12587990) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 12.00 MB (12587990) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 12.00 MB (12587990) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 150 (150) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 150 (150) |
| - NumRowGroupsWithPageIndex: 150 (150) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 30.01 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 150 (150) |
| - RowsReturnedRate: 147.00 /sec |
| - ScanRangesComplete: 150 (150) |
| - ScannerIoWaitTime: 947.989ms |
| - TotalRawHdfsOpenFileTime: 519.994ms |
| - TotalRawHdfsReadTime: 399.995ms |
| - TotalReadThroughput: 7.38 MB/sec |
| - TotalTime: 1s019ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 17.12 MB (17956864) |
| - CumulativeAllocations: 150 (150) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000005 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.98 MB |
| Fragment Instance Lifecycle Event Timeline: 1s115ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s111ms (1s023ms) |
| - First Batch Sent: 1s111ms (0.000ns) |
| - ExecInternal Finished: 1s115ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.98 MB (16754463) |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.32 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 151 (151) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 979.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 37 (37) |
| - TotalThreadsTotalWallClockTime: 1s115ms |
| - TotalThreadsSysTime: 9.496ms |
| - TotalThreadsUserTime: 137.704ms |
| - TotalThreadsVoluntaryContextSwitches: 257 (257) |
| - TotalTime: 1s115ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s027ms |
| - ExecTreeExecTime: 1s023ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 672.80 KB/sec ; Min: 416.61 KB/sec ; Max: 916.03 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 320.967us ; Min: 185.499us ; Max: 491.123us ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 127.390us ; Min: 47.492us ; Max: 314.287us ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 151 (151) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 1.99 KB (2042) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.10 KB (3171) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s111ms (1s023ms) |
| - Last Batch Returned: 1s111ms (0.000ns) |
| - Closed: 1s111ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 151 (151) |
| - RowsReturnedRate: 146.00 /sec |
| - TotalTime: 1s027ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 9 (9) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 151 (151) |
| - StreamingTime: 0.000ns |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 151 (151) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 151 out of 151 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):151 |
| Node Lifecycle Event Timeline: 1s111ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s111ms (927.989ms) |
| - Closed: 1s111ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.05 MB, 10.76 MB |
| - FooterProcessingTime: (Avg: 6.622ms ; Min: 0.000ns ; Max: 95.998ms ; Number of samples: 151) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - InitialRangeIdealReservation: (Avg: 111.89 KB (114579) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 151) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 11.91 MB (12493754) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.91 MB (12493754) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.91 MB (12493754) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 151 (151) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 151 (151) |
| - NumRowGroupsWithPageIndex: 151 (151) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 31.69 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 151 (151) |
| - RowsReturnedRate: 148.00 /sec |
| - ScanRangesComplete: 151 (151) |
| - ScannerIoWaitTime: 979.989ms |
| - TotalRawHdfsOpenFileTime: 539.994ms |
| - TotalRawHdfsReadTime: 375.995ms |
| - TotalReadThroughput: 7.17 MB/sec |
| - TotalTime: 1s019ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.50 MB (17301504) |
| - CumulativeAllocations: 151 (151) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000006 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.91 MB |
| Fragment Instance Lifecycle Event Timeline: 1s111ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s111ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.91 MB (16683211) |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.26 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 152 (152) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 963.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 5 (5) |
| - TotalThreadsTotalWallClockTime: 1s111ms |
| - TotalThreadsSysTime: 6.258ms |
| - TotalThreadsUserTime: 56.325ms |
| - TotalThreadsVoluntaryContextSwitches: 257 (257) |
| - TotalTime: 1s111ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s023ms |
| - ExecTreeExecTime: 1s019ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 127.35 KB/sec ; Min: 86.28 KB/sec ; Max: 198.48 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 1.094ms ; Min: 727.468us ; Max: 1.644ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 140.951us ; Min: 41.346us ; Max: 575.493us ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 152 (152) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.01 KB (2057) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.12 KB (3192) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 152 (152) |
| - RowsReturnedRate: 148.00 /sec |
| - TotalTime: 1s023ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 10 (10) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 152 (152) |
| - StreamingTime: 3.999ms |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 152 (152) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 152 out of 152 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):152 |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s107ms (923.989ms) |
| - Closed: 1s107ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.52 MB, 11.20 MB |
| - FooterProcessingTime: (Avg: 6.447ms ; Min: 0.000ns ; Max: 95.998ms ; Number of samples: 152) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - InitialRangeIdealReservation: (Avg: 112.84 KB (115550) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 152) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 12.18 MB (12767178) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 12.18 MB (12767178) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 12.18 MB (12767178) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 152 (152) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 152 (152) |
| - NumRowGroupsWithPageIndex: 152 (152) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 34.59 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 152 (152) |
| - RowsReturnedRate: 149.00 /sec |
| - ScanRangesComplete: 152 (152) |
| - ScannerIoWaitTime: 963.989ms |
| - TotalRawHdfsOpenFileTime: 563.993ms |
| - TotalRawHdfsReadTime: 351.996ms |
| - TotalReadThroughput: 7.47 MB/sec |
| - TotalTime: 1s015ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.75 MB (17563648) |
| - CumulativeAllocations: 152 (152) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000007 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.21 MB |
| Fragment Instance Lifecycle Event Timeline: 1s111ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s111ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.21 MB (16999375) |
| - CompletionTime: 1s199ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 13.51 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 153 (153) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 935.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 8 (8) |
| - TotalThreadsTotalWallClockTime: 1s111ms |
| - TotalThreadsSysTime: 7.493ms |
| - TotalThreadsUserTime: 56.199ms |
| - TotalThreadsVoluntaryContextSwitches: 256 (256) |
| - TotalTime: 1s111ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s023ms |
| - ExecTreeExecTime: 1s019ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 127.25 KB/sec ; Min: 81.89 KB/sec ; Max: 219.95 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 1.039ms ; Min: 342.223us ; Max: 1.669ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 203.552us ; Min: 40.228us ; Max: 869.385us ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 153 (153) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 3.999ms |
| - TotalBytesSent: 2.01 KB (2060) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.14 KB (3213) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 153 (153) |
| - RowsReturnedRate: 149.00 /sec |
| - TotalTime: 1s023ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 10 (10) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 153 (153) |
| - StreamingTime: 0.000ns |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 153 (153) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 153 out of 153 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):153 |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s107ms (923.989ms) |
| - Closed: 1s107ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.03 MB, 10.54 MB |
| - FooterProcessingTime: (Avg: 6.300ms ; Min: 0.000ns ; Max: 95.998ms ; Number of samples: 153) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 153) |
| - InitialRangeIdealReservation: (Avg: 108.76 KB (111368) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 153) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 153) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 153) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 11.45 MB (12005633) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.45 MB (12005633) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.45 MB (12005633) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 153 (153) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 153 (153) |
| - NumRowGroupsWithPageIndex: 153 (153) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 33.28 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 153 (153) |
| - RowsReturnedRate: 150.00 /sec |
| - ScanRangesComplete: 153 (153) |
| - ScannerIoWaitTime: 935.989ms |
| - TotalRawHdfsOpenFileTime: 547.993ms |
| - TotalRawHdfsReadTime: 343.996ms |
| - TotalReadThroughput: 7.03 MB/sec |
| - TotalTime: 1s015ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.25 MB (17039360) |
| - CumulativeAllocations: 153 (153) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance 454fb5fa46498311:3afee31900000008 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:23.281 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/21.12 MB |
| Fragment Instance Lifecycle Event Timeline: 1s111ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 87.999ms (87.999ms) |
| - First Batch Produced: 1s107ms (1s019ms) |
| - First Batch Sent: 1s107ms (0.000ns) |
| - ExecInternal Finished: 1s111ms (3.999ms) |
| - MemoryUsage (500.000ms): 139.25 KB, 2.28 MB, 2.28 MB |
| - ThreadUsage (500.000ms): 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 21.12 MB (22147452) |
| - CompletionTime: 1s203ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 17.54 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.28 MB (2387200) |
| - PeakReservation: 2.12 MB (2228224) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 18.04 MB (18914166) |
| - RowsProduced: 152 (152) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 943.989ms |
| - TotalThreadsInvoluntaryContextSwitches: 29 (29) |
| - TotalThreadsTotalWallClockTime: 1s111ms |
| - TotalThreadsSysTime: 3.844ms |
| - TotalThreadsUserTime: 61.508ms |
| - TotalThreadsVoluntaryContextSwitches: 259 (259) |
| - TotalTime: 1s111ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 1s023ms |
| - ExecTreeExecTime: 1s019ms |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 87.999ms |
| - ExecTreeOpenTime: 3.999ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Hash Partitioned Sender Codegen Enabled |
| - BytesSent (500.000ms): 0, 0, 0 |
| - NetworkThroughput: (Avg: 66.05 KB/sec ; Min: 47.97 KB/sec ; Max: 92.55 KB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 1.726ms ; Min: 792.839us ; Max: 2.994ms ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 187.337us ; Min: 41.626us ; Max: 764.624us ; Number of samples: 24) |
| - EosSent: 12 (12) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 166.12 KB (170112) |
| - RowsSent: 152 (152) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 2.01 KB (2061) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 3.12 KB (3192) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 87.999ms (3.999ms) |
| - First Batch Requested: 87.999ms (0.000ns) |
| - First Batch Returned: 1s107ms (1s019ms) |
| - Last Batch Returned: 1s107ms (0.000ns) |
| - Closed: 1s107ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 2.02 MB (2122880) |
| - RowsReturned: 152 (152) |
| - RowsReturnedRate: 148.00 /sec |
| - TotalTime: 1s023ms |
| GroupingAggregator 0: |
| ExecOption: Streaming Preaggregation, Codegen Enabled |
| - BuildTime: 0.000ns |
| - GetResultsTime: 0.000ns |
| - HTResizeTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - LargestPartitionPercent: 11 (11) |
| - PartitionsCreated: 16 (16) |
| - PeakMemoryUsage: 2.01 MB (2110592) |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUsedReservation: 0 |
| - ReductionFactorEstimate: 0.00 |
| - ReductionFactorThresholdToExpand: 0.00 |
| - RowsPassedThrough: 0 (0) |
| - RowsReturned: 152 (152) |
| - StreamingTime: 0.000ns |
| - TotalTime: 0.000ns |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 1.25 MB (1310720) |
| - CumulativeAllocations: 20 (20) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 2.00 MB (2097152) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 1.25 MB (1310720) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Hash Table: |
| - HashBuckets: 16.38K (16384) |
| - HashCollisions: 0 (0) |
| - InactiveTotalTime: 0.000ns |
| - Probes: 152 (152) |
| - Resizes: 0 (0) |
| - TotalTime: 0.000ns |
| - Travel: 0 (0) |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 152 out of 152 |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/Unknown(Skipped):152 |
| Node Lifecycle Event Timeline: 1s107ms |
| - Open Started: 83.999ms (83.999ms) |
| - Open Finished: 83.999ms (0.000ns) |
| - First Batch Requested: 87.999ms (3.999ms) |
| - First Batch Returned: 183.997ms (95.998ms) |
| - Last Batch Returned: 1s107ms (923.989ms) |
| - Closed: 1s107ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.07 MB, 10.78 MB |
| - FooterProcessingTime: (Avg: 6.394ms ; Min: 0.000ns ; Max: 95.998ms ; Number of samples: 152) |
| - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - InitialRangeIdealReservation: (Avg: 112.00 KB (114688) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetCompressedPageSize: 0 (Number of samples: 0) |
| - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - ParquetRowGroupIdealReservation: (Avg: 0 ; Min: 0 ; Max: 0 ; Number of samples: 152) |
| - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) |
| - ParquetUncompressedPageSize: 0 (Number of samples: 0) |
| - AverageHdfsReadThreadConcurrency: 1.00 |
| - BytesRead: 11.78 MB (12354468) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 11.78 MB (12354468) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 11.78 MB (12354468) |
| - CachedFileHandlesHitCount: 0 (0) |
| - CachedFileHandlesMissCount: 152 (152) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 0.000ns |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 0 (0) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 0 (0) |
| - NumRowGroups: 152 (152) |
| - NumRowGroupsWithPageIndex: 152 (152) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 132.00 KB (135168) |
| - PerReadThreadRawHdfsThroughput: 31.67 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 0 (0) |
| - RowsReturned: 152 (152) |
| - RowsReturnedRate: 149.00 /sec |
| - ScanRangesComplete: 152 (152) |
| - ScannerIoWaitTime: 943.989ms |
| - TotalRawHdfsOpenFileTime: 527.994ms |
| - TotalRawHdfsReadTime: 371.995ms |
| - TotalReadThroughput: 7.19 MB/sec |
| - TotalTime: 1s015ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 16.62 MB (17432576) |
| - CumulativeAllocations: 152 (152) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 128.00 KB (131072) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 128.00 KB (131072) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Query (id=da4f8f953162a9b0:9a4d93eb00000000): |
| DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Summary: |
| Session ID: 3d44010dd05364df:6980cb4578e82ca6 |
| Session Type: HIVESERVER2 |
| HiveServer2 Protocol Version: V6 |
| Start Time: 2020-12-15 20:07:23.293049000 |
| End Time: 2020-12-15 20:07:27.329815000 |
| Query Type: QUERY |
| Query State: FINISHED |
| Impala Query State: FINISHED |
| Query Status: OK |
| Impala Version: impalad version 4.0.0-SNAPSHOT DEBUG (build f7212f2361611fea183e12153886257a844e0ff1) |
| User: tarmstrong |
| Connected User: tarmstrong |
| Delegated User: |
| Network Address: ::ffff:127.0.0.1:46162 |
| Default Db: default |
| Sql Statement: SELECT NDV(ss_sold_time_sk) AS ss_sold_time_sk, COUNT(CASE WHEN ss_sold_time_sk IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_item_sk) AS ss_item_sk, COUNT(CASE WHEN ss_item_sk IS NULL THEN 1 ELSE NULL END), 8, CAST(8 as DOUBLE), NULL, NULL, NDV(ss_customer_sk) AS ss_customer_sk, COUNT(CASE WHEN ss_customer_sk IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_cdemo_sk) AS ss_cdemo_sk, COUNT(CASE WHEN ss_cdemo_sk IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_hdemo_sk) AS ss_hdemo_sk, COUNT(CASE WHEN ss_hdemo_sk IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_addr_sk) AS ss_addr_sk, COUNT(CASE WHEN ss_addr_sk IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_store_sk) AS ss_store_sk, COUNT(CASE WHEN ss_store_sk IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_promo_sk) AS ss_promo_sk, COUNT(CASE WHEN ss_promo_sk IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_ticket_number) AS ss_ticket_number, COUNT(CASE WHEN ss_ticket_number IS NULL THEN 1 ELSE NULL END), 8, CAST(8 as DOUBLE), NULL, NULL, NDV(ss_quantity) AS ss_quantity, COUNT(CASE WHEN ss_quantity IS NULL THEN 1 ELSE NULL END), 4, CAST(4 as DOUBLE), NULL, NULL, NDV(ss_wholesale_cost) AS ss_wholesale_cost, COUNT(CASE WHEN ss_wholesale_cost IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_list_price) AS ss_list_price, COUNT(CASE WHEN ss_list_price IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_sales_price) AS ss_sales_price, COUNT(CASE WHEN ss_sales_price IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_ext_discount_amt) AS ss_ext_discount_amt, COUNT(CASE WHEN ss_ext_discount_amt IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_ext_sales_price) AS ss_ext_sales_price, COUNT(CASE WHEN ss_ext_sales_price IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_ext_wholesale_cost) AS ss_ext_wholesale_cost, COUNT(CASE WHEN ss_ext_wholesale_cost IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_ext_list_price) AS ss_ext_list_price, COUNT(CASE WHEN ss_ext_list_price IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_ext_tax) AS ss_ext_tax, COUNT(CASE WHEN ss_ext_tax IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_coupon_amt) AS ss_coupon_amt, COUNT(CASE WHEN ss_coupon_amt IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_net_paid) AS ss_net_paid, COUNT(CASE WHEN ss_net_paid IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_net_paid_inc_tax) AS ss_net_paid_inc_tax, COUNT(CASE WHEN ss_net_paid_inc_tax IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL, NDV(ss_net_profit) AS ss_net_profit, COUNT(CASE WHEN ss_net_profit IS NULL THEN 1 ELSE NULL END), 16, CAST(16 as DOUBLE), NULL, NULL FROM tpcds_parquet.store_sales |
| Coordinator: tarmstrong-Precision-7540:27000 |
| Query Options (set by configuration): MT_DOP=4,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (f7212f2) built on Tue 15 Dec 2020 04:06:17 PM PST,PREAGG_BYTES_LIMIT=0,SORT_RUN_BYTES_LIMIT=0,TARGETED_KUDU_SCAN_RANGE_LENGTH=0 |
| Query Options (set by configuration and planner): MT_DOP=4,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (f7212f2) built on Tue 15 Dec 2020 04:06:17 PM PST,PREAGG_BYTES_LIMIT=0,SORT_RUN_BYTES_LIMIT=0,TARGETED_KUDU_SCAN_RANGE_LENGTH=0 |
| Plan: |
| ---------------- |
| Max Per-Host Resource Reservation: Memory=32.00MB Threads=5 |
| Per-Host Resource Estimates: Memory=114MB |
| Analyzed query: SELECT ndv(ss_sold_time_sk) ss_sold_time_sk, count(CASE WHEN |
| ss_sold_time_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(4 AS |
| TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_item_sk) ss_item_sk, count(CASE |
| WHEN ss_item_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(8 AS |
| TINYINT), CAST(8 AS DOUBLE), NULL, NULL, ndv(ss_customer_sk) ss_customer_sk, |
| count(CASE WHEN ss_customer_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_cdemo_sk) ss_cdemo_sk, |
| count(CASE WHEN ss_cdemo_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_hdemo_sk) ss_hdemo_sk, |
| count(CASE WHEN ss_hdemo_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_addr_sk) ss_addr_sk, |
| count(CASE WHEN ss_addr_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_store_sk) ss_store_sk, |
| count(CASE WHEN ss_store_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_promo_sk) ss_promo_sk, |
| count(CASE WHEN ss_promo_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_ticket_number) |
| ss_ticket_number, count(CASE WHEN ss_ticket_number IS NULL THEN CAST(1 AS |
| TINYINT) ELSE NULL END), CAST(8 AS TINYINT), CAST(8 AS DOUBLE), NULL, NULL, |
| ndv(ss_quantity) ss_quantity, count(CASE WHEN ss_quantity IS NULL THEN CAST(1 AS |
| TINYINT) ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, |
| ndv(ss_wholesale_cost) ss_wholesale_cost, count(CASE WHEN ss_wholesale_cost IS |
| NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS |
| DOUBLE), NULL, NULL, ndv(ss_list_price) ss_list_price, count(CASE WHEN |
| ss_list_price IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(16 AS |
| TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_sales_price) ss_sales_price, |
| count(CASE WHEN ss_sales_price IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_ext_discount_amt) |
| ss_ext_discount_amt, count(CASE WHEN ss_ext_discount_amt IS NULL THEN CAST(1 AS |
| TINYINT) ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, |
| ndv(ss_ext_sales_price) ss_ext_sales_price, count(CASE WHEN ss_ext_sales_price |
| IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS |
| DOUBLE), NULL, NULL, ndv(ss_ext_wholesale_cost) ss_ext_wholesale_cost, |
| count(CASE WHEN ss_ext_wholesale_cost IS NULL THEN CAST(1 AS TINYINT) ELSE NULL |
| END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, |
| ndv(ss_ext_list_price) ss_ext_list_price, count(CASE WHEN ss_ext_list_price IS |
| NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS |
| DOUBLE), NULL, NULL, ndv(ss_ext_tax) ss_ext_tax, count(CASE WHEN ss_ext_tax IS |
| NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS |
| DOUBLE), NULL, NULL, ndv(ss_coupon_amt) ss_coupon_amt, count(CASE WHEN |
| ss_coupon_amt IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), CAST(16 AS |
| TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_net_paid) ss_net_paid, |
| count(CASE WHEN ss_net_paid IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), |
| CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_net_paid_inc_tax) |
| ss_net_paid_inc_tax, count(CASE WHEN ss_net_paid_inc_tax IS NULL THEN CAST(1 AS |
| TINYINT) ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, |
| ndv(ss_net_profit) ss_net_profit, count(CASE WHEN ss_net_profit IS NULL THEN |
| CAST(1 AS TINYINT) ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), |
| NULL, NULL FROM tpcds_parquet.store_sales |
| |
| F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 |
| | Per-Instance Resources: mem-estimate=10.02MB mem-reservation=0B thread-reservation=1 |
| PLAN-ROOT SINK |
| | output exprs: ndv(ss_sold_time_sk), count(CASE WHEN ss_sold_time_sk IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_item_sk), count(CASE WHEN ss_item_sk IS NULL THEN 1 ELSE NULL END), CAST(8 AS TINYINT), CAST(8 AS DOUBLE), NULL, NULL, ndv(ss_customer_sk), count(CASE WHEN ss_customer_sk IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_cdemo_sk), count(CASE WHEN ss_cdemo_sk IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_hdemo_sk), count(CASE WHEN ss_hdemo_sk IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_addr_sk), count(CASE WHEN ss_addr_sk IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_store_sk), count(CASE WHEN ss_store_sk IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_promo_sk), count(CASE WHEN ss_promo_sk IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_ticket_number), count(CASE WHEN ss_ticket_number IS NULL THEN 1 ELSE NULL END), CAST(8 AS TINYINT), CAST(8 AS DOUBLE), NULL, NULL, ndv(ss_quantity), count(CASE WHEN ss_quantity IS NULL THEN 1 ELSE NULL END), CAST(4 AS TINYINT), CAST(4 AS DOUBLE), NULL, NULL, ndv(ss_wholesale_cost), count(CASE WHEN ss_wholesale_cost IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_list_price), count(CASE WHEN ss_list_price IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_sales_price), count(CASE WHEN ss_sales_price IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_ext_discount_amt), count(CASE WHEN ss_ext_discount_amt IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_ext_sales_price), count(CASE WHEN ss_ext_sales_price IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_ext_wholesale_cost), count(CASE WHEN ss_ext_wholesale_cost IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_ext_list_price), count(CASE WHEN ss_ext_list_price IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_ext_tax), count(CASE WHEN ss_ext_tax IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_coupon_amt), count(CASE WHEN ss_coupon_amt IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_net_paid), count(CASE WHEN ss_net_paid IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_net_paid_inc_tax), count(CASE WHEN ss_net_paid_inc_tax IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL, ndv(ss_net_profit), count(CASE WHEN ss_net_profit IS NULL THEN 1 ELSE NULL END), CAST(16 AS TINYINT), CAST(16 AS DOUBLE), NULL, NULL |
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 |
| | |
| 03:AGGREGATE [FINALIZE] |
| | output: ndv:merge(ss_sold_time_sk), count:merge(CASE WHEN ss_sold_time_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_item_sk), count:merge(CASE WHEN ss_item_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_customer_sk), count:merge(CASE WHEN ss_customer_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_cdemo_sk), count:merge(CASE WHEN ss_cdemo_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_hdemo_sk), count:merge(CASE WHEN ss_hdemo_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_addr_sk), count:merge(CASE WHEN ss_addr_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_store_sk), count:merge(CASE WHEN ss_store_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_promo_sk), count:merge(CASE WHEN ss_promo_sk IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_ticket_number), count:merge(CASE WHEN ss_ticket_number IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_quantity), count:merge(CASE WHEN ss_quantity IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_wholesale_cost), count:merge(CASE WHEN ss_wholesale_cost IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_list_price), count:merge(CASE WHEN ss_list_price IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_sales_price), count:merge(CASE WHEN ss_sales_price IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_ext_discount_amt), count:merge(CASE WHEN ss_ext_discount_amt IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_ext_sales_price), count:merge(CASE WHEN ss_ext_sales_price IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_ext_wholesale_cost), count:merge(CASE WHEN ss_ext_wholesale_cost IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_ext_list_price), count:merge(CASE WHEN ss_ext_list_price IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_ext_tax), count:merge(CASE WHEN ss_ext_tax IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_coupon_amt), count:merge(CASE WHEN ss_coupon_amt IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_net_paid), count:merge(CASE WHEN ss_net_paid IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_net_paid_inc_tax), count:merge(CASE WHEN ss_net_paid_inc_tax IS NULL THEN 1 ELSE NULL END), ndv:merge(ss_net_profit), count:merge(CASE WHEN ss_net_profit IS NULL THEN 1 ELSE NULL END) |
| | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 |
| | tuple-ids=2 row-size=352B cardinality=1 |
| | in pipelines: 03(GETNEXT), 01(OPEN) |
| | |
| 02:EXCHANGE [UNPARTITIONED] |
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 |
| | tuple-ids=1 row-size=352B cardinality=1 |
| | in pipelines: 01(GETNEXT) |
| | |
| F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=12 |
| Per-Instance Resources: mem-estimate=26.00MB mem-reservation=8.00MB thread-reservation=1 |
| 01:AGGREGATE |
| | output: ndv(ss_sold_time_sk), count(CASE WHEN ss_sold_time_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_item_sk), count(CASE WHEN ss_item_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_customer_sk), count(CASE WHEN ss_customer_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_cdemo_sk), count(CASE WHEN ss_cdemo_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_hdemo_sk), count(CASE WHEN ss_hdemo_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_addr_sk), count(CASE WHEN ss_addr_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_store_sk), count(CASE WHEN ss_store_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_promo_sk), count(CASE WHEN ss_promo_sk IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_ticket_number), count(CASE WHEN ss_ticket_number IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_quantity), count(CASE WHEN ss_quantity IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_wholesale_cost), count(CASE WHEN ss_wholesale_cost IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_list_price), count(CASE WHEN ss_list_price IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_sales_price), count(CASE WHEN ss_sales_price IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_ext_discount_amt), count(CASE WHEN ss_ext_discount_amt IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_ext_sales_price), count(CASE WHEN ss_ext_sales_price IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_ext_wholesale_cost), count(CASE WHEN ss_ext_wholesale_cost IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_ext_list_price), count(CASE WHEN ss_ext_list_price IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_ext_tax), count(CASE WHEN ss_ext_tax IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_coupon_amt), count(CASE WHEN ss_coupon_amt IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_net_paid), count(CASE WHEN ss_net_paid IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_net_paid_inc_tax), count(CASE WHEN ss_net_paid_inc_tax IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END), ndv(ss_net_profit), count(CASE WHEN ss_net_profit IS NULL THEN CAST(1 AS TINYINT) ELSE NULL END) |
| | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 |
| | tuple-ids=1 row-size=352B cardinality=1 |
| | in pipelines: 01(GETNEXT), 00(OPEN) |
| | |
| 00:SCAN HDFS [tpcds_parquet.store_sales, RANDOM] |
| HDFS partitions=1824/1824 files=1824 size=196.95MB |
| stored statistics: |
| table: rows=2.88M size=196.95MB |
| partitions: 1824/1824 rows=2.88M |
| columns: all |
| extrapolated-rows=disabled max-scan-range-rows=130.09K |
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0 |
| tuple-ids=0 row-size=96B cardinality=2.88M |
| in pipelines: 00(GETNEXT) |
| ---------------- |
| Estimated Per-Host Mem: 119554048 |
| Request Pool: default-pool |
| Per Host Min Memory Reservation: tarmstrong-Precision-7540:27002(32.00 MB) tarmstrong-Precision-7540:27000(32.00 MB) tarmstrong-Precision-7540:27001(32.00 MB) |
| Per Host Number of Fragment Instances: tarmstrong-Precision-7540:27002(4) tarmstrong-Precision-7540:27000(5) tarmstrong-Precision-7540:27001(4) |
| Admission result: Admitted immediately |
| Cluster Memory Admitted: 342.05 MB |
| Executor Group: default |
| ExecSummary: |
| Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail |
| ---------------------------------------------------------------------------------------------------------------------------------- |
| F01:ROOT 1 1 0.000ns 0.000ns 0 0 |
| 03:AGGREGATE 1 1 0.000ns 0.000ns 1 1 34.17 KB 10.00 MB FINALIZE |
| 02:EXCHANGE 1 1 0.000ns 0.000ns 12 1 392.00 KB 16.00 KB UNPARTITIONED |
| F00:EXCHANGE SENDER 3 12 0.000ns 0.000ns 8.00 B 0 |
| 01:AGGREGATE 3 12 159.664ms 227.997ms 12 1 133.17 KB 10.00 MB |
| 00:SCAN HDFS 3 12 3s370ms 3s439ms 2.88M 2.88M 12.24 MB 16.00 MB tpcds_parquet.store_sales |
| Errors: |
| Query Compilation: 133.843ms |
| - Metadata of all 1 tables cached: 11.900ms (11.900ms) |
| - Analysis finished: 52.835ms (40.935ms) |
| - Authorization finished (noop): 52.914ms (79.340us) |
| - Value transfer graph computed: 53.556ms (641.423us) |
| - Single node plan created: 114.085ms (60.529ms) |
| - Runtime filters computed: 118.854ms (4.769ms) |
| - Distributed plan created: 118.955ms (100.851us) |
| - Parallel plans created: 118.968ms (12.851us) |
| - Planning finished: 133.843ms (14.874ms) |
| Query Timeline: 4s035ms |
| - Query submitted: 0.000ns (0.000ns) |
| - Planning finished: 147.998ms (147.998ms) |
| - Submit for admission: 147.998ms (0.000ns) |
| - Completed admission: 163.998ms (15.999ms) |
| - Ready to start on 3 backends: 163.998ms (0.000ns) |
| - All 3 execution backends (13 fragment instances) started: 175.998ms (11.999ms) |
| - Rows available: 4s011ms (3s835ms) |
| - First row fetched: 4s011ms (0.000ns) |
| - Last row fetched: 4s011ms (0.000ns) |
| - Released admission control resources: 4s035ms (23.999ms) |
| - Unregister query: 4s035ms (0.000ns) |
| - AdmissionControlTimeSinceLastUpdate: 67.000ms |
| - ComputeScanRangeAssignmentTimer: 11.999ms |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Frontend: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| ImpalaServer: |
| - ClientFetchWaitTimer: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - NumRowsFetched: 1 (1) |
| - NumRowsFetchedFromCache: 0 (0) |
| - RowMaterializationRate: 41.00 /sec |
| - RowMaterializationTimer: 23.999ms |
| - TotalTime: 0.000ns |
| Execution Profile da4f8f953162a9b0:9a4d93eb00000000: |
| Number of filters: 0 |
| Filter routing table: |
| ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp |
| ---------------------------------------------------------------------------------------------------------------------------------------- |
| Backend startup latencies: Count: 3, min / max: 3ms / 4ms, 25th %-ile: 3ms, 50th %-ile: 4ms, 75th %-ile: 4ms, 90th %-ile: 4ms, 95th %-ile: 4ms, 99.9th %-ile: 4ms |
| Slowest backend to start up: tarmstrong-Precision-7540:27000 |
| Per Node Peak Memory Usage: tarmstrong-Precision-7540:27000(37.41 MB) tarmstrong-Precision-7540:27001(33.69 MB) tarmstrong-Precision-7540:27002(33.61 MB) |
| Per Node Bytes Read: tarmstrong-Precision-7540:27000(113.30 MB) tarmstrong-Precision-7540:27001(108.23 MB) tarmstrong-Precision-7540:27002(107.79 MB) |
| Per Node User Time: tarmstrong-Precision-7540:27000(5s703ms) tarmstrong-Precision-7540:27001(5s191ms) tarmstrong-Precision-7540:27002(5s217ms) |
| Per Node System Time: tarmstrong-Precision-7540:27000(285.814ms) tarmstrong-Precision-7540:27001(320.814ms) tarmstrong-Precision-7540:27002(281.862ms) |
| - ExchangeScanRatio: 0.00 |
| - FiltersReceived: 0 (0) |
| - FinalizationTimer: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - InnerNodeSelectivityRatio: 0.00 |
| - NumBackends: 3 (3) |
| - NumCompletedBackends: 3 (3) |
| - NumFragmentInstances: 13 (13) |
| - NumFragments: 2 (2) |
| - TotalBytesRead: 329.31 MB (345305727) |
| - TotalBytesSent: 174.62 KB (178806) |
| - TotalCpuTime: 17s001ms |
| - TotalInnerBytesSent: 0 |
| - TotalScanBytesSent: 174.62 KB (178806) |
| - TotalTime: 3s871ms |
| Per Node Profiles: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| tarmstrong-Precision-7540:27000: |
| - AdmissionSlots: 4 (4) |
| - BloomFilterBytes: 0 |
| - InactiveTotalTime: 0.000ns |
| - ScratchBytesRead: 0 |
| - ScratchBytesWritten: 0 |
| - ScratchFileUsedBytes: 0 |
| - ScratchReads: 0 (0) |
| - ScratchWrites: 0 (0) |
| - TotalEncryptionTime: 0.000ns |
| - TotalReadBlockTime: 0.000ns |
| - TotalTime: 0.000ns |
| - UncompressedScratchBytesWritten: 0 |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 0 |
| - CumulativeAllocations: 0 (0) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 0 |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 0 |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - ReservationLimit: 0 |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| JVM: |
| - GcCount: 1 (1) |
| - GcNumInfoThresholdExceeded: 0 (0) |
| - GcNumWarnThresholdExceeded: 0 (0) |
| - GcTimeMillis: 13ms |
| - GcTotalExtraSleepTimeMillis: 0 |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Fragment F01: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 0 (0) |
| - CodegenTotalWallClockTime: 87.999ms |
| - CodegenSysTime: 0.000ns |
| - CodegenUserTime: 88.000ms |
| - CodegenVoluntaryContextSwitches: 0 (0) |
| - CompileTime: 15.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 3.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 75.999ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 132 (132) |
| - NumInstructions: 660 (660) |
| - OptimizationTime: 55.999ms |
| - PeakMemoryUsage: 330.00 KB (337920) |
| - PrepareTime: 11.999ms |
| - TotalTime: 87.999ms |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 0 (0) |
| - CodegenTotalWallClockTime: 239.997ms |
| - CodegenSysTime: 3.953ms |
| - CodegenUserTime: 233.257ms |
| - CodegenVoluntaryContextSwitches: 0 (0) |
| - CompileTime: 7.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 7.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 223.997ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 213 (213) |
| - NumInstructions: 3.20K (3202) |
| - OptimizationTime: 203.997ms |
| - PeakMemoryUsage: 1.56 MB (1639424) |
| - PrepareTime: 15.999ms |
| - TotalTime: 239.997ms |
| tarmstrong-Precision-7540:27001: |
| - AdmissionSlots: 4 (4) |
| - BloomFilterBytes: 0 |
| - InactiveTotalTime: 0.000ns |
| - ScratchBytesRead: 0 |
| - ScratchBytesWritten: 0 |
| - ScratchFileUsedBytes: 0 |
| - ScratchReads: 0 (0) |
| - ScratchWrites: 0 (0) |
| - TotalEncryptionTime: 0.000ns |
| - TotalReadBlockTime: 0.000ns |
| - TotalTime: 0.000ns |
| - UncompressedScratchBytesWritten: 0 |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 0 |
| - CumulativeAllocations: 0 (0) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 0 |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 0 |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - ReservationLimit: 0 |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| JVM: |
| - GcCount: 0 (0) |
| - GcNumInfoThresholdExceeded: 0 (0) |
| - GcNumWarnThresholdExceeded: 0 (0) |
| - GcTimeMillis: 0 |
| - GcTotalExtraSleepTimeMillis: 0 |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 0 (0) |
| - CodegenTotalWallClockTime: 239.997ms |
| - CodegenSysTime: 3.953ms |
| - CodegenUserTime: 233.275ms |
| - CodegenVoluntaryContextSwitches: 0 (0) |
| - CompileTime: 7.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 7.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 223.997ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 213 (213) |
| - NumInstructions: 3.20K (3202) |
| - OptimizationTime: 203.997ms |
| - PeakMemoryUsage: 1.56 MB (1639424) |
| - PrepareTime: 15.999ms |
| - TotalTime: 239.997ms |
| tarmstrong-Precision-7540:27002: |
| - AdmissionSlots: 4 (4) |
| - BloomFilterBytes: 0 |
| - InactiveTotalTime: 0.000ns |
| - ScratchBytesRead: 0 |
| - ScratchBytesWritten: 0 |
| - ScratchFileUsedBytes: 0 |
| - ScratchReads: 0 (0) |
| - ScratchWrites: 0 (0) |
| - TotalEncryptionTime: 0.000ns |
| - TotalReadBlockTime: 0.000ns |
| - TotalTime: 0.000ns |
| - UncompressedScratchBytesWritten: 0 |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 0 |
| - CumulativeAllocations: 0 (0) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 0 |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 0 |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - ReservationLimit: 0 |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| JVM: |
| - GcCount: 0 (0) |
| - GcNumInfoThresholdExceeded: 0 (0) |
| - GcNumWarnThresholdExceeded: 0 (0) |
| - GcTimeMillis: 0 |
| - GcTotalExtraSleepTimeMillis: 0 |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| CodeGen: |
| - CodegenCompileThreadInvoluntaryContextSwitches: 0 (0) |
| - CodegenCompileThreadTotalWallClockTime: 0.000ns |
| - CodegenCompileThreadSysTime: 0.000ns |
| - CodegenCompileThreadUserTime: 0.000ns |
| - CodegenCompileThreadVoluntaryContextSwitches: 0 (0) |
| - CodegenInvoluntaryContextSwitches: 2 (2) |
| - CodegenTotalWallClockTime: 235.997ms |
| - CodegenSysTime: 7.988ms |
| - CodegenUserTime: 227.667ms |
| - CodegenVoluntaryContextSwitches: 0 (0) |
| - CompileTime: 3.999ms |
| - InactiveTotalTime: 0.000ns |
| - IrGenerationTime: 11.999ms |
| - LoadTime: 0.000ns |
| - MainThreadCodegenTime: 223.997ms |
| - ModuleBitcodeSize: 2.96 MB (3105592) |
| - NumFunctions: 213 (213) |
| - NumInstructions: 3.20K (3202) |
| - OptimizationTime: 207.997ms |
| - PeakMemoryUsage: 1.56 MB (1639424) |
| - PrepareTime: 11.999ms |
| - TotalTime: 235.997ms |
| Averaged Fragment F01:(Total: 3s819ms, non-child: 91.998ms, % non-child: 2.41%) |
| split sizes: min: 0, max: 0, avg: 0, stddev: 0 |
| completion times: min:3s863ms max:3s863ms mean: 3s863ms stddev:0.000ns |
| execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec |
| num instances: 1 |
| Instances: |
| [0] Instance da4f8f953162a9b0:9a4d93eb00000000 (host=tarmstrong-Precision-7540:27000) |
| Last report received time[0]: 2020-12-15 20:07:27.327 |
| - MemoryUsage[0] (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB |
| Fragment Instance Lifecycle Event Timeline[0]: 3s819ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 3s819ms (3s815ms) |
| - First Batch Produced: 3s819ms (0.000ns) |
| - First Batch Sent: 3s819ms (0.000ns) |
| - ExecInternal Finished: 3s819ms (0.000ns) |
| - AverageThreadTokens: 0.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 3s863ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 434.17 KB (444592) |
| - PeakReservation: 0 |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 37.41 MB (39231939) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 3s727ms |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 0 (0) |
| - TotalThreadsTotalWallClockTime: 3s815ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 92.519ms |
| - TotalThreadsVoluntaryContextSwitches: 13 (13) |
| - TotalTime: 3s819ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s815ms |
| - ExecTreeOpenTime: 3s727ms |
| - PrepareTime: 3.999ms |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| PLAN_ROOT_SINK: |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 0 |
| - RowsSent: 1 (1) |
| - RowsSentRate: 0 |
| - TotalTime: 0.000ns |
| AGGREGATION_NODE (id=3):(Total: 3s727ms, non-child: 0.000ns, % non-child: 0.00%) |
| Node Lifecycle Event Timeline[0]: 3s819ms |
| - Open Started: 91.998ms (91.998ms) |
| - Open Finished: 3s819ms (3s727ms) |
| - First Batch Requested: 3s819ms (0.000ns) |
| - First Batch Returned: 3s819ms (0.000ns) |
| - Last Batch Returned: 3s819ms (0.000ns) |
| - Closed: 3s819ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 34.17 KB (34992) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s727ms |
| NonGroupingAggregator 0: |
| - BuildTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| EXCHANGE_NODE (id=2):(Total: 3s727ms, non-child: 0.000ns, % non-child: 0.00%) |
| Node Lifecycle Event Timeline[0]: 3s819ms |
| - Open Started: 91.998ms (91.998ms) |
| - Open Finished: 3s695ms (3s603ms) |
| - First Batch Requested: 3s695ms (0.000ns) |
| - First Batch Returned: 3s819ms (123.998ms) |
| - Last Batch Returned: 3s819ms (0.000ns) |
| - Closed: 3s819ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 3s727ms |
| - PeakMemoryUsage: 392.00 KB (401408) |
| - RowsReturned: 12 (12) |
| - RowsReturnedRate: 3.00 /sec |
| - TotalTime: 3s727ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 480.00 KB (491520) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 392.00 KB (401408) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 392.00 KB (401408) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued[0] (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - FirstBatchWaitTime: 3s603ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 266.16 KB (272544) |
| - TotalGetBatchTime: 3s727ms |
| - DataWaitTime: 3s727ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived[0] (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - DeferredQueueSize[0] (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - DispatchTime: (Avg: 81.062us ; Min: 54.756us ; Max: 134.375us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 174.62 KB (178806) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Coordinator Fragment F01: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000000 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:27.327 |
| Fragment Instance Lifecycle Event Timeline: 3s819ms |
| - Prepare Finished: 3.999ms (3.999ms) |
| - Open Finished: 3s819ms (3s815ms) |
| - First Batch Produced: 3s819ms (0.000ns) |
| - First Batch Sent: 3s819ms (0.000ns) |
| - ExecInternal Finished: 3s819ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB |
| - AverageThreadTokens: 0.00 |
| - BytesAssigned: 0 |
| - CompletionTime: 3s863ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 0.00 /sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 434.17 KB (444592) |
| - PeakReservation: 0 |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 37.41 MB (39231939) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 3s727ms |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 0.000ns |
| - TotalThreadsInvoluntaryContextSwitches: 0 (0) |
| - TotalThreadsTotalWallClockTime: 3s815ms |
| - TotalThreadsSysTime: 0.000ns |
| - TotalThreadsUserTime: 92.519ms |
| - TotalThreadsVoluntaryContextSwitches: 13 (13) |
| - TotalTime: 3s819ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s815ms |
| - ExecTreeOpenTime: 3s727ms |
| - PrepareTime: 3.999ms |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| PLAN_ROOT_SINK: |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 0 |
| - RowsSent: 1 (1) |
| - RowsSentRate: 0 |
| - TotalTime: 0.000ns |
| AGGREGATION_NODE (id=3): |
| Node Lifecycle Event Timeline: 3s819ms |
| - Open Started: 91.998ms (91.998ms) |
| - Open Finished: 3s819ms (3s727ms) |
| - First Batch Requested: 3s819ms (0.000ns) |
| - First Batch Returned: 3s819ms (0.000ns) |
| - Last Batch Returned: 3s819ms (0.000ns) |
| - Closed: 3s819ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 34.17 KB (34992) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s727ms |
| NonGroupingAggregator 0: |
| ExecOption: |
| - BuildTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| EXCHANGE_NODE (id=2): |
| Node Lifecycle Event Timeline: 3s819ms |
| - Open Started: 91.998ms (91.998ms) |
| - Open Finished: 3s695ms (3s603ms) |
| - First Batch Requested: 3s695ms (0.000ns) |
| - First Batch Returned: 3s819ms (123.998ms) |
| - Last Batch Returned: 3s819ms (0.000ns) |
| - Closed: 3s819ms (0.000ns) |
| - ConvertRowBatchTime: 0.000ns |
| - InactiveTotalTime: 3s727ms |
| - PeakMemoryUsage: 392.00 KB (401408) |
| - RowsReturned: 12 (12) |
| - RowsReturnedRate: 3.00 /sec |
| - TotalTime: 3s727ms |
| Buffer pool: |
| - AllocTime: 0.000ns |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 480.00 KB (491520) |
| - CumulativeAllocations: 24 (24) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 392.00 KB (401408) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 392.00 KB (401408) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Dequeue: |
| - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - FirstBatchWaitTime: 3s603ms |
| - InactiveTotalTime: 0.000ns |
| - TotalBytesDequeued: 266.16 KB (272544) |
| - TotalGetBatchTime: 3s727ms |
| - DataWaitTime: 3s727ms |
| - TotalTime: 0.000ns |
| Enqueue: |
| - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - DispatchTime: (Avg: 81.062us ; Min: 54.756us ; Max: 134.375us ; Number of samples: 12) |
| - DeserializeRowBatchTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - TotalBatchesEnqueued: 12 (12) |
| - TotalBatchesReceived: 12 (12) |
| - TotalBytesReceived: 174.62 KB (178806) |
| - TotalEarlySenders: 0 (0) |
| - TotalEosReceived: 12 (12) |
| - TotalHasDeferredRPCsTime: 0.000ns |
| - TotalRPCsDeferred: 0 (0) |
| - TotalTime: 0.000ns |
| Averaged Fragment F00 [12 instances]:(Total: 3s769ms, non-child: 238.664ms, % non-child: 6.33%) |
| split sizes: min: 15.76 MB, max: 21.12 MB, avg: 16.41 MB, stddev: 1.42 MB |
| completion times: min:3s731ms max:3s863ms mean: 3s816ms stddev:58.197ms |
| execution rates: min:4.12 MB/sec max:5.47 MB/sec mean:4.30 MB/sec stddev:365.33 KB/sec |
| num instances: 12 |
| Instances: |
| [0] Instance da4f8f953162a9b0:9a4d93eb00000001 (host=tarmstrong-Precision-7540:27001) |
| [1] Instance da4f8f953162a9b0:9a4d93eb00000002 (host=tarmstrong-Precision-7540:27001) |
| [2] Instance da4f8f953162a9b0:9a4d93eb00000003 (host=tarmstrong-Precision-7540:27001) |
| [3] Instance da4f8f953162a9b0:9a4d93eb00000004 (host=tarmstrong-Precision-7540:27001) |
| [4] Instance da4f8f953162a9b0:9a4d93eb00000005 (host=tarmstrong-Precision-7540:27000) |
| [5] Instance da4f8f953162a9b0:9a4d93eb00000006 (host=tarmstrong-Precision-7540:27000) |
| [6] Instance da4f8f953162a9b0:9a4d93eb00000007 (host=tarmstrong-Precision-7540:27000) |
| [7] Instance da4f8f953162a9b0:9a4d93eb00000008 (host=tarmstrong-Precision-7540:27000) |
| [8] Instance da4f8f953162a9b0:9a4d93eb00000009 (host=tarmstrong-Precision-7540:27002) |
| [9] Instance da4f8f953162a9b0:9a4d93eb0000000a (host=tarmstrong-Precision-7540:27002) |
| [10] Instance da4f8f953162a9b0:9a4d93eb0000000b (host=tarmstrong-Precision-7540:27002) |
| [11] Instance da4f8f953162a9b0:9a4d93eb0000000c (host=tarmstrong-Precision-7540:27002) |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[5]: 0:152/15.91 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[4]: 0:152/15.98 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[2]: 0:152/16.01 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[1]: 0:152/16.03 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[8]: 0:152/16.04 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[10]: 0:152/16.06 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[3]: 0:152/16.09 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[6]: 0:152/16.21 MB |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>)[7]: 0:152/21.12 MB |
| Last report received time[8-11]: 2020-12-15 20:07:27.203 |
| Last report received time[0-3]: 2020-12-15 20:07:27.317 |
| Last report received time[4-7]: 2020-12-15 20:07:27.327 |
| - MemoryUsage[0] (500.000ms): 12.01 KB, 8.04 MB, 8.04 MB, 8.07 MB, 8.08 MB, 8.04 MB, 8.04 MB, 8.22 MB |
| - ThreadUsage[0] (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| Fragment Instance Lifecycle Event Timeline[0]: 3s819ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s819ms (3s819ms) |
| - First Batch Produced: 3s819ms (0.000ns) |
| - First Batch Sent: 3s819ms (0.000ns) |
| - ExecInternal Finished: 3s819ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[1]: 3s815ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s815ms (3s815ms) |
| - First Batch Produced: 3s815ms (0.000ns) |
| - First Batch Sent: 3s815ms (0.000ns) |
| - ExecInternal Finished: 3s815ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[2]: 3s811ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s811ms (3s811ms) |
| - First Batch Produced: 3s811ms (0.000ns) |
| - First Batch Sent: 3s811ms (0.000ns) |
| - ExecInternal Finished: 3s811ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[3]: 3s815ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s815ms (3s815ms) |
| - First Batch Produced: 3s815ms (0.000ns) |
| - First Batch Sent: 3s815ms (0.000ns) |
| - ExecInternal Finished: 3s815ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[4]: 3s799ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s799ms (3s799ms) |
| - First Batch Produced: 3s799ms (0.000ns) |
| - First Batch Sent: 3s799ms (0.000ns) |
| - ExecInternal Finished: 3s799ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[5]: 3s799ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s799ms (3s799ms) |
| - First Batch Produced: 3s799ms (0.000ns) |
| - First Batch Sent: 3s799ms (0.000ns) |
| - ExecInternal Finished: 3s799ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[6]: 3s791ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s787ms (3s787ms) |
| - First Batch Produced: 3s787ms (0.000ns) |
| - First Batch Sent: 3s787ms (0.000ns) |
| - ExecInternal Finished: 3s791ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[7]: 3s795ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s795ms (3s795ms) |
| - First Batch Produced: 3s795ms (0.000ns) |
| - First Batch Sent: 3s795ms (0.000ns) |
| - ExecInternal Finished: 3s795ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[8]: 3s695ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s691ms (3s691ms) |
| - First Batch Produced: 3s691ms (0.000ns) |
| - First Batch Sent: 3s691ms (0.000ns) |
| - ExecInternal Finished: 3s695ms (3.999ms) |
| Fragment Instance Lifecycle Event Timeline[9]: 3s695ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s695ms (3s695ms) |
| - First Batch Produced: 3s695ms (0.000ns) |
| - First Batch Sent: 3s695ms (0.000ns) |
| - ExecInternal Finished: 3s695ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[10]: 3s703ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s703ms (3s703ms) |
| - First Batch Produced: 3s703ms (0.000ns) |
| - First Batch Sent: 3s703ms (0.000ns) |
| - ExecInternal Finished: 3s703ms (0.000ns) |
| Fragment Instance Lifecycle Event Timeline[11]: 3s691ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s691ms (3s691ms) |
| - First Batch Produced: 3s691ms (0.000ns) |
| - First Batch Sent: 3s691ms (0.000ns) |
| - ExecInternal Finished: 3s691ms (0.000ns) |
| - AverageThreadTokens: mean=1.00 min=1.00 max=1.00 |
| - BytesAssigned: mean=16.41 MB (17209364) min=15.76 MB (16526332) max=21.12 MB (22147452) |
| - CompletionTime: mean=3s816ms min=3s731ms max=3s863ms |
| - ExchangeScanRatio: mean=0.00 min=0.00 max=0.00 |
| - ExecutionRate: mean=4.30 MB/sec min=4.12 MB/sec max=5.47 MB/sec |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakMemoryUsage: mean=8.77 MB (9200547) min=8.44 MB (8852160) max=12.28 MB (12875074) |
| - PeakReservation: mean=8.03 MB (8415914) min=8.00 MB (8388608) max=8.31 MB (8716288) |
| - PeakUsedReservation: mean=0 min=0 max=0 |
| - PerHostPeakMemUsage: mean=34.91 MB (36600553) min=33.61 MB (35243040) max=37.41 MB (39231939) |
| - RowsProduced: mean=1 (1) min=1 (1) max=1 (1) |
| - TotalNetworkReceiveTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalNetworkSendTime: mean=666.659us min=0.000ns max=3.999ms |
| - TotalStorageWaitTime: mean=334.329ms min=271.996ms max=399.995ms |
| - TotalThreadsInvoluntaryContextSwitches: mean=8.15K (8152) min=7.70K (7700) max=8.65K (8654) |
| - TotalThreadsTotalWallClockTime: mean=3s769ms min=3s691ms max=3s819ms |
| - TotalThreadsSysTime: mean=74.040ms min=52.178ms max=93.090ms |
| - TotalThreadsUserTime: mean=1s335ms min=1s206ms max=1s523ms |
| - TotalThreadsVoluntaryContextSwitches: mean=3.63K (3631) min=3.44K (3441) max=3.79K (3786) |
| - TotalTime: mean=3s769ms min=3s691ms max=3s819ms |
| Fragment Instance Lifecycle Timings [12 instances]: |
| - ExecTime: mean=666.659us min=0.000ns max=3.999ms |
| - ExecTreeExecTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - OpenTime: mean=3s769ms min=3s691ms max=3s819ms |
| - ExecTreeOpenTime: mean=3s530ms min=3s455ms max=3s579ms |
| - PrepareTime: mean=0.000ns min=0.000ns max=0.000ns |
| - ExecTreePrepareTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| KrpcDataStreamSender (dst_id=2) [12 instances]:(Total: 666.659us, non-child: 0.000ns, % non-child: 0.00%) |
| ExecOption[0-11]: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent[0] (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 56.71 MB/sec ; Min: 27.86 MB/sec ; Max: 81.38 MB/sec ; Number of samples: 12) |
| - RpcNetworkTime: (Avg: 222.572us ; Min: 140.800us ; Max: 509.284us ; Number of samples: 24) |
| - RpcRecvrTime: (Avg: 100.501us ; Min: 50.845us ; Max: 193.042us ; Number of samples: 24) |
| - EosSent: mean=1 (1) min=1 (1) max=1 (1) |
| - InactiveTotalTime: mean=666.659us min=0.000ns max=3.999ms |
| - PeakMemoryUsage: mean=8.00 B (8) min=8.00 B (8) max=8.00 B (8) |
| - RowsSent: mean=1 (1) min=1 (1) max=1 (1) |
| - RpcFailure: mean=0 (0) min=0 (0) max=0 (0) |
| - RpcRetry: mean=0 (0) min=0 (0) max=0 (0) |
| - SerializeBatchTime: mean=0.000ns min=0.000ns max=0.000ns |
| - TotalBytesSent: mean=14.55 KB (14900) min=14.48 KB (14823) max=14.62 KB (14970) |
| - TotalTime: mean=666.659us min=0.000ns max=3.999ms |
| - UncompressedRowBatchSize: mean=22.18 KB (22712) min=22.18 KB (22712) max=22.18 KB (22712) |
| AGGREGATION_NODE (id=1) [12 instances]:(Total: 3s530ms, non-child: 159.664ms, % non-child: 4.52%) |
| Node Lifecycle Event Timeline[0]: 3s819ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s819ms (3s579ms) |
| - First Batch Requested: 3s819ms (0.000ns) |
| - First Batch Returned: 3s819ms (0.000ns) |
| - Last Batch Returned: 3s819ms (0.000ns) |
| - Closed: 3s819ms (0.000ns) |
| Node Lifecycle Event Timeline[1]: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s815ms (3s575ms) |
| - First Batch Requested: 3s815ms (0.000ns) |
| - First Batch Returned: 3s815ms (0.000ns) |
| - Last Batch Returned: 3s815ms (0.000ns) |
| - Closed: 3s815ms (0.000ns) |
| Node Lifecycle Event Timeline[2]: 3s811ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s811ms (3s571ms) |
| - First Batch Requested: 3s811ms (0.000ns) |
| - First Batch Returned: 3s811ms (0.000ns) |
| - Last Batch Returned: 3s811ms (0.000ns) |
| - Closed: 3s811ms (0.000ns) |
| Node Lifecycle Event Timeline[3]: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s815ms (3s575ms) |
| - First Batch Requested: 3s815ms (0.000ns) |
| - First Batch Returned: 3s815ms (0.000ns) |
| - Last Batch Returned: 3s815ms (0.000ns) |
| - Closed: 3s815ms (0.000ns) |
| Node Lifecycle Event Timeline[4]: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s799ms (3s559ms) |
| - First Batch Requested: 3s799ms (0.000ns) |
| - First Batch Returned: 3s799ms (0.000ns) |
| - Last Batch Returned: 3s799ms (0.000ns) |
| - Closed: 3s799ms (0.000ns) |
| Node Lifecycle Event Timeline[5]: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s799ms (3s559ms) |
| - First Batch Requested: 3s799ms (0.000ns) |
| - First Batch Returned: 3s799ms (0.000ns) |
| - Last Batch Returned: 3s799ms (0.000ns) |
| - Closed: 3s799ms (0.000ns) |
| Node Lifecycle Event Timeline[6]: 3s787ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s787ms (3s547ms) |
| - First Batch Requested: 3s787ms (0.000ns) |
| - First Batch Returned: 3s787ms (0.000ns) |
| - Last Batch Returned: 3s787ms (0.000ns) |
| - Closed: 3s787ms (0.000ns) |
| Node Lifecycle Event Timeline[7]: 3s795ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s795ms (3s555ms) |
| - First Batch Requested: 3s795ms (0.000ns) |
| - First Batch Returned: 3s795ms (0.000ns) |
| - Last Batch Returned: 3s795ms (0.000ns) |
| - Closed: 3s795ms (0.000ns) |
| Node Lifecycle Event Timeline[8]: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s691ms (3s455ms) |
| - First Batch Requested: 3s691ms (0.000ns) |
| - First Batch Returned: 3s691ms (0.000ns) |
| - Last Batch Returned: 3s691ms (0.000ns) |
| - Closed: 3s691ms (0.000ns) |
| Node Lifecycle Event Timeline[9]: 3s695ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s695ms (3s459ms) |
| - First Batch Requested: 3s695ms (0.000ns) |
| - First Batch Returned: 3s695ms (0.000ns) |
| - Last Batch Returned: 3s695ms (0.000ns) |
| - Closed: 3s695ms (0.000ns) |
| Node Lifecycle Event Timeline[10]: 3s703ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s703ms (3s467ms) |
| - First Batch Requested: 3s703ms (0.000ns) |
| - First Batch Returned: 3s703ms (0.000ns) |
| - Last Batch Returned: 3s703ms (0.000ns) |
| - Closed: 3s703ms (0.000ns) |
| Node Lifecycle Event Timeline[11]: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s691ms (3s455ms) |
| - First Batch Requested: 3s691ms (0.000ns) |
| - First Batch Returned: 3s691ms (0.000ns) |
| - Last Batch Returned: 3s691ms (0.000ns) |
| - Closed: 3s691ms (0.000ns) |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakMemoryUsage: mean=133.17 KB (136368) min=133.17 KB (136368) max=133.17 KB (136368) |
| - RowsReturned: mean=1 (1) min=1 (1) max=1 (1) |
| - RowsReturnedRate: mean=0 min=0 max=0 |
| - TotalTime: mean=3s530ms min=3s455ms max=3s579ms |
| NonGroupingAggregator 0 [12 instances]: |
| ExecOption[0-11]: Codegen Enabled |
| - BuildTime: mean=155.998ms min=123.998ms max=219.997ms |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakMemoryUsage: mean=26.17 KB (26800) min=26.17 KB (26800) max=26.17 KB (26800) |
| - RowsReturned: mean=1 (1) min=1 (1) max=1 (1) |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| HDFS_SCAN_NODE (id=0) [12 instances]:(Total: 3s370ms, non-child: 3s370ms, % non-child: 100.00%) |
| ExecOption[6]: PARQUET Codegen Enabled, Codegen enabled: 139 out of 139 |
| ExecOption[1]: PARQUET Codegen Enabled, Codegen enabled: 147 out of 147 |
| ExecOption[8]: PARQUET Codegen Enabled, Codegen enabled: 149 out of 149 |
| ExecOption[9]: PARQUET Codegen Enabled, Codegen enabled: 150 out of 150 |
| ExecOption[3]: PARQUET Codegen Enabled, Codegen enabled: 151 out of 151 |
| ExecOption[11]: PARQUET Codegen Enabled, Codegen enabled: 152 out of 152 |
| ExecOption[2,4]: PARQUET Codegen Enabled, Codegen enabled: 154 out of 154 |
| ExecOption[0,5]: PARQUET Codegen Enabled, Codegen enabled: 156 out of 156 |
| ExecOption[10]: PARQUET Codegen Enabled, Codegen enabled: 157 out of 157 |
| ExecOption[7]: PARQUET Codegen Enabled, Codegen enabled: 159 out of 159 |
| File Formats[6]: PARQUET/SNAPPY:139 |
| File Formats[1]: PARQUET/SNAPPY:147 |
| File Formats[8]: PARQUET/SNAPPY:149 |
| File Formats[9]: PARQUET/SNAPPY:150 |
| File Formats[3]: PARQUET/SNAPPY:151 |
| File Formats[11]: PARQUET/SNAPPY:152 |
| File Formats[2,4]: PARQUET/SNAPPY:154 |
| File Formats[0,5]: PARQUET/SNAPPY:156 |
| File Formats[10]: PARQUET/SNAPPY:157 |
| File Formats[7]: PARQUET/SNAPPY:159 |
| Hdfs Read Thread Concurrency Bucket[3,6]: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Hdfs Read Thread Concurrency Bucket[7]: 0:71.43% 1:0% 2:28.57% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Hdfs Read Thread Concurrency Bucket[4]: 0:71.43% 1:14.29% 2:0% 3:0% 4:0% 5:14.29% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Hdfs Read Thread Concurrency Bucket[10]: 0:85.71% 1:0% 2:0% 3:0% 4:14.29% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Hdfs Read Thread Concurrency Bucket[2,5,11]: 0:85.71% 1:0% 2:14.29% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Hdfs Read Thread Concurrency Bucket[0-1,8-9]: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| Table Name[0-11]: tpcds_parquet.store_sales |
| - BytesReadSeries[0] (500.000ms): 0, 3.28 MB, 7.33 MB, 11.11 MB, 14.61 MB, 18.07 MB, 21.86 MB, 25.97 MB |
| Node Lifecycle Event Timeline[0]: 3s819ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s819ms (3s559ms) |
| - Closed: 3s819ms (0.000ns) |
| Node Lifecycle Event Timeline[1]: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 267.997ms (27.999ms) |
| - Last Batch Returned: 3s815ms (3s547ms) |
| - Closed: 3s815ms (0.000ns) |
| Node Lifecycle Event Timeline[2]: 3s811ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s811ms (3s551ms) |
| - Closed: 3s811ms (0.000ns) |
| Node Lifecycle Event Timeline[3]: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 263.997ms (23.999ms) |
| - Last Batch Returned: 3s815ms (3s551ms) |
| - Closed: 3s815ms (0.000ns) |
| Node Lifecycle Event Timeline[4]: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 267.997ms (27.999ms) |
| - Last Batch Returned: 3s799ms (3s531ms) |
| - Closed: 3s799ms (0.000ns) |
| Node Lifecycle Event Timeline[5]: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s799ms (3s539ms) |
| - Closed: 3s799ms (0.000ns) |
| Node Lifecycle Event Timeline[6]: 3s787ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 279.996ms (39.999ms) |
| - Last Batch Returned: 3s787ms (3s507ms) |
| - Closed: 3s787ms (0.000ns) |
| Node Lifecycle Event Timeline[7]: 3s795ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 275.996ms (35.999ms) |
| - Last Batch Returned: 3s795ms (3s519ms) |
| - Closed: 3s795ms (0.000ns) |
| Node Lifecycle Event Timeline[8]: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s691ms (3s431ms) |
| - Closed: 3s691ms (0.000ns) |
| Node Lifecycle Event Timeline[9]: 3s695ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 263.997ms (23.999ms) |
| - Last Batch Returned: 3s695ms (3s431ms) |
| - Closed: 3s695ms (0.000ns) |
| Node Lifecycle Event Timeline[10]: 3s703ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 267.997ms (27.999ms) |
| - Last Batch Returned: 3s699ms (3s431ms) |
| - Closed: 3s703ms (3.999ms) |
| Node Lifecycle Event Timeline[11]: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 255.997ms (15.999ms) |
| - Last Batch Returned: 3s691ms (3s435ms) |
| - Closed: 3s691ms (0.000ns) |
| - FooterProcessingTime: (Avg: 1.427ms ; Min: 0.000ns ; Max: 15.999ms ; Number of samples: 1824) |
| - InitialRangeActualReservation: (Avg: 8.01 MB (8398309) ; Min: 8.00 MB (8388608) ; Max: 8.31 MB (8716288) ; Number of samples: 1824) |
| - InitialRangeIdealReservation: (Avg: 112.28 KB (114975) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 1824) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 249.59 KB (255579) ; Min: 72.87 KB (74623) ; Max: 509.83 KB (522065) ; Number of samples: 264) |
| - ParquetCompressedPageSize: (Avg: 1.64 KB (1679) ; Min: 162.00 B (162) ; Max: 78.28 KB (80161) ; Number of samples: 40174) |
| - ParquetRowGroupActualReservation: (Avg: 8.01 MB (8398488) ; Min: 8.00 MB (8388608) ; Max: 8.31 MB (8716288) ; Number of samples: 1824) |
| - ParquetRowGroupIdealReservation: (Avg: 224.81 KB (230202) ; Min: 176.00 KB (180224) ; Max: 8.31 MB (8716288) ; Number of samples: 1824) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 266.14 KB (272531) ; Min: 73.58 KB (75342) ; Max: 848.12 KB (868472) ; Number of samples: 264) |
| - ParquetUncompressedPageSize: (Avg: 1.75 KB (1790) ; Min: 158.00 B (158) ; Max: 78.27 KB (80152) ; Number of samples: 40174) |
| - AverageHdfsReadThreadConcurrency: mean=0.00 min=0.00 max=0.86 |
| - BytesRead: mean=27.44 MB (28775477) min=25.64 MB (26886807) max=29.67 MB (31108369) |
| - BytesReadDataNodeCache: mean=0 min=0 max=0 |
| - BytesReadLocal: mean=27.44 MB (28775477) min=25.64 MB (26886807) max=29.67 MB (31108369) |
| - BytesReadRemoteUnexpected: mean=0 min=0 max=0 |
| - BytesReadShortCircuit: mean=27.44 MB (28775477) min=25.64 MB (26886807) max=29.67 MB (31108369) |
| - CachedFileHandlesHitCount: mean=3.19K (3188) min=2.92K (2915) max=3.32K (3323) |
| - CachedFileHandlesMissCount: mean=307 (307) min=281 (281) max=334 (334) |
| - CollectionItemsRead: mean=0 (0) min=0 (0) max=0 (0) |
| - DataCacheHitBytes: mean=0 min=0 max=0 |
| - DataCacheHitCount: mean=0 (0) min=0 (0) max=0 (0) |
| - DataCacheMissBytes: mean=0 min=0 max=0 |
| - DataCacheMissCount: mean=0 (0) min=0 (0) max=0 (0) |
| - DataCachePartialHitCount: mean=0 (0) min=0 (0) max=0 (0) |
| - DecompressionTime: mean=36.666ms min=19.999ms max=55.999ms |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - MaterializeTupleTime: mean=669.659ms min=583.993ms max=863.990ms |
| - MaxCompressedTextFileLength: mean=0 min=0 max=0 |
| - NumColumns: mean=22 (22) min=22 (22) max=22 (22) |
| - NumDictFilteredRowGroups: mean=0 (0) min=0 (0) max=0 (0) |
| - NumDisksAccessed: mean=1 (1) min=1 (1) max=1 (1) |
| - NumPages: mean=3.35K (3347) min=3.10K (3104) max=3.50K (3498) |
| - NumRowGroups: mean=152 (152) min=139 (139) max=159 (159) |
| - NumRowGroupsWithPageIndex: mean=152 (152) min=139 (139) max=159 (159) |
| - NumScannersWithNoReads: mean=0 (0) min=0 (0) max=0 (0) |
| - NumStatsFilteredPages: mean=0 (0) min=0 (0) max=0 (0) |
| - NumStatsFilteredRowGroups: mean=0 (0) min=0 (0) max=0 (0) |
| - PeakMemoryUsage: mean=8.73 MB (9157355) min=8.40 MB (8808968) max=12.24 MB (12831882) |
| - PerReadThreadRawHdfsThroughput: mean=70.85 MB/sec min=60.79 MB/sec max=82.42 MB/sec |
| - RemoteScanRanges: mean=0 (0) min=0 (0) max=0 (0) |
| - RowsRead: mean=240.03K (240033) min=213.13K (213129) max=334.56K (334558) |
| - RowsReturned: mean=240.03K (240033) min=213.13K (213129) max=334.56K (334558) |
| - RowsReturnedRate: mean=71.27 K/sec min=64.04 K/sec max=100.77 K/sec |
| - ScanRangesComplete: mean=152 (152) min=139 (139) max=159 (159) |
| - ScannerIoWaitTime: mean=334.329ms min=271.996ms max=399.995ms |
| - TotalRawHdfsOpenFileTime: mean=568.327ms min=387.995ms max=759.991ms |
| - TotalRawHdfsReadTime: mean=389.662ms min=343.996ms max=451.994ms |
| - TotalReadThroughput: mean=6.56 MB/sec min=6.11 MB/sec max=7.09 MB/sec |
| - TotalTime: mean=3s370ms min=3s275ms max=3s439ms |
| Buffer pool [12 instances]: |
| - AllocTime: mean=17.333ms min=3.999ms max=27.999ms |
| - CompressionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - CumulativeAllocationBytes: mean=50.04 MB (52467029) min=47.91 MB (50241536) max=52.82 MB (55386112) |
| - CumulativeAllocations: mean=3.50K (3496) min=3.20K (3197) max=3.66K (3657) |
| - EncryptionTime: mean=0.000ns min=0.000ns max=0.000ns |
| - InactiveTotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - PeakReservation: mean=8.03 MB (8415914) min=8.00 MB (8388608) max=8.31 MB (8716288) |
| - PeakUnpinnedBytes: mean=0 min=0 max=0 |
| - PeakUsedReservation: mean=1.07 MB (1117525) min=392.00 KB (401408) max=8.31 MB (8716288) |
| - ReadIoBytes: mean=0 min=0 max=0 |
| - ReadIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - ReadIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| - SystemAllocTime: mean=333.329us min=0.000ns max=3.999ms |
| - TotalTime: mean=0.000ns min=0.000ns max=0.000ns |
| - WriteIoBytes: mean=0 min=0 max=0 |
| - WriteIoOps: mean=0 (0) min=0 (0) max=0 (0) |
| - WriteIoWaitTime: mean=0.000ns min=0.000ns max=0.000ns |
| Fragment F00: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000001 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:27.317 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.87 MB |
| Fragment Instance Lifecycle Event Timeline: 3s819ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s819ms (3s819ms) |
| - First Batch Produced: 3s819ms (0.000ns) |
| - First Batch Sent: 3s819ms (0.000ns) |
| - ExecInternal Finished: 3s819ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.04 MB, 8.04 MB, 8.07 MB, 8.08 MB, 8.04 MB, 8.04 MB, 8.22 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.87 MB (16641560) |
| - CompletionTime: 3s851ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.12 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.44 MB (8852160) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.69 MB (35326680) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 319.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.08K (8081) |
| - TotalThreadsTotalWallClockTime: 3s819ms |
| - TotalThreadsSysTime: 89.516ms |
| - TotalThreadsUserTime: 1s283ms |
| - TotalThreadsVoluntaryContextSwitches: 3.70K (3696) |
| - TotalTime: 3s819ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s819ms |
| - ExecTreeOpenTime: 3s579ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 68.44 MB/sec ; Min: 68.44 MB/sec ; Max: 68.44 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 182.146us ; Min: 157.004us ; Max: 207.289us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 122.501us ; Min: 53.638us ; Max: 191.365us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.53 KB (14877) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s819ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s819ms (3s579ms) |
| - First Batch Requested: 3s819ms (0.000ns) |
| - First Batch Returned: 3s819ms (0.000ns) |
| - Last Batch Returned: 3s819ms (0.000ns) |
| - Closed: 3s819ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s579ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 183.997ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 156 out of 156 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:156 |
| Node Lifecycle Event Timeline: 3s819ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s819ms (3s559ms) |
| - Closed: 3s819ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.28 MB, 7.33 MB, 11.11 MB, 14.61 MB, 18.07 MB, 21.86 MB, 25.97 MB |
| - FooterProcessingTime: (Avg: 1.230ms ; Min: 0.000ns ; Max: 11.999ms ; Number of samples: 156) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 156) |
| - InitialRangeIdealReservation: (Avg: 115.69 KB (118468) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 156) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 250.68 KB (256695) ; Min: 83.36 KB (85361) ; Max: 340.30 KB (348469) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.61 KB (1645) ; Min: 238.00 B (238) ; Max: 4.98 KB (5095) ; Number of samples: 3432) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 156) |
| - ParquetRowGroupIdealReservation: (Avg: 222.26 KB (227590) ; Min: 176.00 KB (180224) ; Max: 392.00 KB (401408) ; Number of samples: 156) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 266.96 KB (273365) ; Min: 84.36 KB (86384) ; Max: 340.92 KB (349107) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.71 KB (1752) ; Min: 238.00 B (238) ; Max: 5.00 KB (5118) ; Number of samples: 3432) |
| - AverageHdfsReadThreadConcurrency: 0.29 |
| - BytesRead: 28.35 MB (29729074) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 28.35 MB (29729074) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 28.35 MB (29729074) |
| - CachedFileHandlesHitCount: 3.28K (3278) |
| - CachedFileHandlesMissCount: 310 (310) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 51.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 651.992ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.43K (3432) |
| - NumRowGroups: 156 (156) |
| - NumRowGroupsWithPageIndex: 156 (156) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.40 MB (8808968) |
| - PerReadThreadRawHdfsThroughput: 82.42 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 241.55K (241554) |
| - RowsReturned: 241.55K (241554) |
| - RowsReturnedRate: 71.13 K/sec |
| - ScanRangesComplete: 156 (156) |
| - ScannerIoWaitTime: 319.996ms |
| - TotalRawHdfsOpenFileTime: 615.993ms |
| - TotalRawHdfsReadTime: 343.996ms |
| - TotalReadThroughput: 6.49 MB/sec |
| - TotalTime: 3s395ms |
| Buffer pool: |
| - AllocTime: 27.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 51.48 MB (53985280) |
| - CumulativeAllocations: 3.59K (3588) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 392.00 KB (401408) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000002 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:27.317 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.03 MB |
| Fragment Instance Lifecycle Event Timeline: 3s815ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s815ms (3s815ms) |
| - First Batch Produced: 3s815ms (0.000ns) |
| - First Batch Sent: 3s815ms (0.000ns) |
| - ExecInternal Finished: 3s815ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.04 MB, 8.24 MB, 8.22 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.32 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.03 MB (16812382) |
| - CompletionTime: 3s851ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.16 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.45 MB (8861304) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.69 MB (35326680) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 383.995ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.17K (8172) |
| - TotalThreadsTotalWallClockTime: 3s815ms |
| - TotalThreadsSysTime: 69.901ms |
| - TotalThreadsUserTime: 1s459ms |
| - TotalThreadsVoluntaryContextSwitches: 3.61K (3607) |
| - TotalTime: 3s815ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s815ms |
| - ExecTreeOpenTime: 3s575ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 81.38 MB/sec ; Min: 81.38 MB/sec ; Max: 81.38 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 164.826us ; Min: 154.769us ; Max: 174.883us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 83.530us ; Min: 59.225us ; Max: 107.835us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.57 KB (14923) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s815ms (3s575ms) |
| - First Batch Requested: 3s815ms (0.000ns) |
| - First Batch Returned: 3s815ms (0.000ns) |
| - Last Batch Returned: 3s815ms (0.000ns) |
| - Closed: 3s815ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s575ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 131.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 147 out of 147 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:147 |
| Node Lifecycle Event Timeline: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 267.997ms (27.999ms) |
| - Last Batch Returned: 3s815ms (3s547ms) |
| - Closed: 3s815ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.46 MB, 7.02 MB, 10.67 MB, 13.93 MB, 16.79 MB, 20.28 MB, 24.42 MB |
| - FooterProcessingTime: (Avg: 1.850ms ; Min: 0.000ns ; Max: 15.999ms ; Number of samples: 147) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 147) |
| - InitialRangeIdealReservation: (Avg: 116.68 KB (119480) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 147) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 234.14 KB (239759) ; Min: 77.18 KB (79029) ; Max: 318.40 KB (326039) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.59 KB (1631) ; Min: 233.00 B (233) ; Max: 5.21 KB (5330) ; Number of samples: 3234) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 147) |
| - ParquetRowGroupIdealReservation: (Avg: 220.19 KB (225475) ; Min: 176.00 KB (180224) ; Max: 424.00 KB (434176) ; Number of samples: 147) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 248.88 KB (254856) ; Min: 78.08 KB (79951) ; Max: 318.94 KB (326591) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.69 KB (1733) ; Min: 229.00 B (229) ; Max: 5.22 KB (5350) ; Number of samples: 3234) |
| - AverageHdfsReadThreadConcurrency: 0.14 |
| - BytesRead: 26.51 MB (27801781) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 26.51 MB (27801781) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 26.51 MB (27801781) |
| - CachedFileHandlesHitCount: 3.09K (3089) |
| - CachedFileHandlesMissCount: 292 (292) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 35.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 683.992ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.23K (3234) |
| - NumRowGroups: 147 (147) |
| - NumRowGroupsWithPageIndex: 147 (147) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.41 MB (8818112) |
| - PerReadThreadRawHdfsThroughput: 69.05 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 225.98K (225981) |
| - RowsReturned: 225.98K (225981) |
| - RowsReturnedRate: 65.69 K/sec |
| - ScanRangesComplete: 147 (147) |
| - ScannerIoWaitTime: 383.995ms |
| - TotalRawHdfsOpenFileTime: 511.994ms |
| - TotalRawHdfsReadTime: 383.995ms |
| - TotalReadThroughput: 6.11 MB/sec |
| - TotalTime: 3s439ms |
| Buffer pool: |
| - AllocTime: 19.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 48.36 MB (50708480) |
| - CumulativeAllocations: 3.38K (3381) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 424.00 KB (434176) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000004 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:27.317 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.09 MB |
| Fragment Instance Lifecycle Event Timeline: 3s815ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s815ms (3s815ms) |
| - First Batch Produced: 3s815ms (0.000ns) |
| - First Batch Sent: 3s815ms (0.000ns) |
| - ExecInternal Finished: 3s815ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.04 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.09 MB, 8.21 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.09 MB (16871797) |
| - CompletionTime: 3s851ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.18 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.48 MB (8889122) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.69 MB (35326680) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 323.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.15K (8149) |
| - TotalThreadsTotalWallClockTime: 3s815ms |
| - TotalThreadsSysTime: 91.178ms |
| - TotalThreadsUserTime: 1s219ms |
| - TotalThreadsVoluntaryContextSwitches: 3.75K (3752) |
| - TotalTime: 3s815ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s815ms |
| - ExecTreeOpenTime: 3s575ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 64.66 MB/sec ; Min: 64.66 MB/sec ; Max: 64.66 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 182.565us ; Min: 145.829us ; Max: 219.302us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 94.146us ; Min: 55.873us ; Max: 132.419us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.52 KB (14868) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s815ms (3s575ms) |
| - First Batch Requested: 3s815ms (0.000ns) |
| - First Batch Returned: 3s815ms (0.000ns) |
| - Last Batch Returned: 3s815ms (0.000ns) |
| - Closed: 3s815ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s575ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 167.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 151 out of 151 |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:151 |
| Node Lifecycle Event Timeline: 3s815ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 263.997ms (23.999ms) |
| - Last Batch Returned: 3s815ms (3s551ms) |
| - Closed: 3s815ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.01 MB, 7.07 MB, 10.38 MB, 13.92 MB, 17.32 MB, 21.10 MB, 24.87 MB |
| - FooterProcessingTime: (Avg: 1.483ms ; Min: 0.000ns ; Max: 11.999ms ; Number of samples: 151) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 151) |
| - InitialRangeIdealReservation: (Avg: 111.89 KB (114579) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 151) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 235.81 KB (241474) ; Min: 78.65 KB (80542) ; Max: 318.78 KB (326435) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.56 KB (1599) ; Min: 230.00 B (230) ; Max: 5.85 KB (5992) ; Number of samples: 3322) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 151) |
| - ParquetRowGroupIdealReservation: (Avg: 221.30 KB (226609) ; Min: 176.00 KB (180224) ; Max: 440.00 KB (450560) ; Number of samples: 151) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 250.96 KB (256979) ; Min: 79.67 KB (81585) ; Max: 319.35 KB (327015) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.66 KB (1701) ; Min: 226.00 B (226) ; Max: 5.89 KB (6029) ; Number of samples: 3322) |
| - AverageHdfsReadThreadConcurrency: 0.00 |
| - BytesRead: 26.87 MB (28180009) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 26.87 MB (28180009) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 26.87 MB (28180009) |
| - CachedFileHandlesHitCount: 3.17K (3169) |
| - CachedFileHandlesMissCount: 304 (304) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 55.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 611.993ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.32K (3322) |
| - NumRowGroups: 151 (151) |
| - NumRowGroupsWithPageIndex: 151 (151) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.44 MB (8845930) |
| - PerReadThreadRawHdfsThroughput: 74.65 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 227.66K (227664) |
| - RowsReturned: 227.66K (227664) |
| - RowsReturnedRate: 66.96 K/sec |
| - ScanRangesComplete: 151 (151) |
| - ScannerIoWaitTime: 323.996ms |
| - TotalRawHdfsOpenFileTime: 519.994ms |
| - TotalRawHdfsReadTime: 359.996ms |
| - TotalReadThroughput: 6.22 MB/sec |
| - TotalTime: 3s399ms |
| Buffer pool: |
| - AllocTime: 15.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 49.13 MB (51519488) |
| - CumulativeAllocations: 3.47K (3473) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 440.00 KB (450560) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000003 (host=tarmstrong-Precision-7540:27001): |
| Last report received time: 2020-12-15 20:07:27.317 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.01 MB |
| Fragment Instance Lifecycle Event Timeline: 3s811ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s811ms (3s811ms) |
| - First Batch Produced: 3s811ms (0.000ns) |
| - First Batch Sent: 3s811ms (0.000ns) |
| - ExecInternal Finished: 3s811ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.29 MB, 8.04 MB, 8.04 MB, 8.36 MB, 8.32 MB, 8.04 MB, 8.04 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.01 MB (16787175) |
| - CompletionTime: 3s851ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.16 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.45 MB (8855979) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.69 MB (35326680) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 399.995ms |
| - TotalThreadsInvoluntaryContextSwitches: 7.72K (7723) |
| - TotalThreadsTotalWallClockTime: 3s811ms |
| - TotalThreadsSysTime: 70.219ms |
| - TotalThreadsUserTime: 1s228ms |
| - TotalThreadsVoluntaryContextSwitches: 3.79K (3786) |
| - TotalTime: 3s811ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s811ms |
| - ExecTreeOpenTime: 3s571ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 59.16 MB/sec ; Min: 59.16 MB/sec ; Max: 59.16 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 190.526us ; Min: 140.800us ; Max: 240.253us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 97.359us ; Min: 50.845us ; Max: 143.874us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.55 KB (14903) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s811ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s811ms (3s571ms) |
| - First Batch Requested: 3s811ms (0.000ns) |
| - First Batch Returned: 3s811ms (0.000ns) |
| - Last Batch Returned: 3s811ms (0.000ns) |
| - Closed: 3s811ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s571ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 131.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 154 out of 154 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:0% 2:14.29% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:154 |
| Node Lifecycle Event Timeline: 3s811ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s811ms (3s551ms) |
| - Closed: 3s811ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.24 MB, 7.11 MB, 10.40 MB, 13.67 MB, 16.76 MB, 20.35 MB, 24.76 MB |
| - FooterProcessingTime: (Avg: 1.740ms ; Min: 0.000ns ; Max: 11.999ms ; Number of samples: 154) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 154) |
| - InitialRangeIdealReservation: (Avg: 109.71 KB (112347) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 154) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 230.33 KB (235854) ; Min: 76.53 KB (78367) ; Max: 310.76 KB (318214) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.50 KB (1531) ; Min: 162.00 B (162) ; Max: 5.08 KB (5197) ; Number of samples: 3388) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 154) |
| - ParquetRowGroupIdealReservation: (Avg: 214.60 KB (219747) ; Min: 176.00 KB (180224) ; Max: 408.00 KB (417792) ; Number of samples: 154) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 244.42 KB (250287) ; Min: 77.23 KB (79082) ; Max: 311.25 KB (318725) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.59 KB (1625) ; Min: 158.00 B (158) ; Max: 5.11 KB (5229) ; Number of samples: 3388) |
| - AverageHdfsReadThreadConcurrency: 0.29 |
| - BytesRead: 26.49 MB (27772789) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 26.49 MB (27772789) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 26.49 MB (27772789) |
| - CachedFileHandlesHitCount: 3.24K (3242) |
| - CachedFileHandlesMissCount: 300 (300) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 55.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 619.993ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.39K (3388) |
| - NumRowGroups: 154 (154) |
| - NumRowGroupsWithPageIndex: 154 (154) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.40 MB (8812787) |
| - PerReadThreadRawHdfsThroughput: 66.22 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 222.71K (222714) |
| - RowsReturned: 222.71K (222714) |
| - RowsReturnedRate: 64.97 K/sec |
| - ScanRangesComplete: 154 (154) |
| - ScannerIoWaitTime: 399.995ms |
| - TotalRawHdfsOpenFileTime: 543.993ms |
| - TotalRawHdfsReadTime: 399.995ms |
| - TotalReadThroughput: 6.19 MB/sec |
| - TotalTime: 3s427ms |
| Buffer pool: |
| - AllocTime: 7.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 48.77 MB (51142656) |
| - CumulativeAllocations: 3.54K (3542) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 408.00 KB (417792) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000005 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:27.327 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.98 MB |
| Fragment Instance Lifecycle Event Timeline: 3s799ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s799ms (3s799ms) |
| - First Batch Produced: 3s799ms (0.000ns) |
| - First Batch Sent: 3s799ms (0.000ns) |
| - ExecInternal Finished: 3s799ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.31 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.37 MB, 8.04 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.98 MB (16754463) |
| - CompletionTime: 3s863ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.14 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.45 MB (8856210) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 37.41 MB (39231939) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 367.995ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.32K (8319) |
| - TotalThreadsTotalWallClockTime: 3s799ms |
| - TotalThreadsSysTime: 58.912ms |
| - TotalThreadsUserTime: 1s523ms |
| - TotalThreadsVoluntaryContextSwitches: 3.76K (3758) |
| - TotalTime: 3s799ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s799ms |
| - ExecTreeOpenTime: 3s559ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 49.28 MB/sec ; Min: 49.28 MB/sec ; Max: 49.28 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 220.978us ; Min: 152.255us ; Max: 289.702us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 98.476us ; Min: 54.755us ; Max: 142.197us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.62 KB (14970) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s799ms (3s559ms) |
| - First Batch Requested: 3s799ms (0.000ns) |
| - First Batch Returned: 3s799ms (0.000ns) |
| - Last Batch Returned: 3s799ms (0.000ns) |
| - Closed: 3s799ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s559ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 135.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 154 out of 154 |
| Hdfs Read Thread Concurrency Bucket: 0:71.43% 1:14.29% 2:0% 3:0% 4:0% 5:14.29% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:154 |
| Node Lifecycle Event Timeline: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 267.997ms (27.999ms) |
| - Last Batch Returned: 3s799ms (3s531ms) |
| - Closed: 3s799ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.22 MB, 8.03 MB, 11.45 MB, 14.51 MB, 18.08 MB, 21.69 MB, 26.13 MB |
| - FooterProcessingTime: (Avg: 1.376ms ; Min: 0.000ns ; Max: 7.999ms ; Number of samples: 154) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 154) |
| - InitialRangeIdealReservation: (Avg: 111.79 KB (114475) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 154) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 243.62 KB (249468) ; Min: 80.81 KB (82748) ; Max: 330.04 KB (337960) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.58 KB (1619) ; Min: 231.00 B (231) ; Max: 5.08 KB (5205) ; Number of samples: 3388) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 154) |
| - ParquetRowGroupIdealReservation: (Avg: 222.70 KB (228046) ; Min: 176.00 KB (180224) ; Max: 408.00 KB (417792) ; Number of samples: 154) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 259.09 KB (265313) ; Min: 81.75 KB (83711) ; Max: 330.62 KB (338554) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.68 KB (1722) ; Min: 227.00 B (227) ; Max: 5.11 KB (5237) ; Number of samples: 3388) |
| - AverageHdfsReadThreadConcurrency: 0.86 |
| - BytesRead: 27.48 MB (28812382) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 27.48 MB (28812382) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 27.48 MB (28812382) |
| - CachedFileHandlesHitCount: 3.24K (3242) |
| - CachedFileHandlesMissCount: 300 (300) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 19.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 731.991ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.39K (3388) |
| - NumRowGroups: 154 (154) |
| - NumRowGroupsWithPageIndex: 154 (154) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.40 MB (8813018) |
| - PerReadThreadRawHdfsThroughput: 60.79 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 234.81K (234810) |
| - RowsReturned: 234.81K (234810) |
| - RowsReturnedRate: 68.58 K/sec |
| - ScanRangesComplete: 154 (154) |
| - ScannerIoWaitTime: 367.995ms |
| - TotalRawHdfsOpenFileTime: 595.993ms |
| - TotalRawHdfsReadTime: 451.994ms |
| - TotalReadThroughput: 6.52 MB/sec |
| - TotalTime: 3s423ms |
| Buffer pool: |
| - AllocTime: 3.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 50.30 MB (52748288) |
| - CumulativeAllocations: 3.54K (3542) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 408.00 KB (417792) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000006 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:27.327 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.91 MB |
| Fragment Instance Lifecycle Event Timeline: 3s799ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s799ms (3s799ms) |
| - First Batch Produced: 3s799ms (0.000ns) |
| - First Batch Sent: 3s799ms (0.000ns) |
| - ExecInternal Finished: 3s799ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.04 MB, 8.04 MB, 8.04 MB, 8.13 MB, 8.04 MB, 8.07 MB, 8.27 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.91 MB (16683211) |
| - CompletionTime: 3s863ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.12 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.49 MB (8900338) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 37.41 MB (39231939) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 383.995ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.56K (8559) |
| - TotalThreadsTotalWallClockTime: 3s799ms |
| - TotalThreadsSysTime: 81.634ms |
| - TotalThreadsUserTime: 1s289ms |
| - TotalThreadsVoluntaryContextSwitches: 3.58K (3579) |
| - TotalTime: 3s799ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s799ms |
| - ExecTreeOpenTime: 3s559ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 62.41 MB/sec ; Min: 62.41 MB/sec ; Max: 62.41 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 188.850us ; Min: 149.460us ; Max: 228.241us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 83.111us ; Min: 51.962us ; Max: 114.261us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.59 KB (14936) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s799ms (3s559ms) |
| - First Batch Requested: 3s799ms (0.000ns) |
| - First Batch Returned: 3s799ms (0.000ns) |
| - Last Batch Returned: 3s799ms (0.000ns) |
| - Closed: 3s799ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s559ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 155.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 156 out of 156 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:0% 2:14.29% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:156 |
| Node Lifecycle Event Timeline: 3s799ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s799ms (3s539ms) |
| - Closed: 3s799ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 2.98 MB, 7.18 MB, 11.05 MB, 14.75 MB, 17.84 MB, 21.33 MB, 26.54 MB |
| - FooterProcessingTime: (Avg: 1.846ms ; Min: 0.000ns ; Max: 11.999ms ; Number of samples: 156) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 156) |
| - InitialRangeIdealReservation: (Avg: 110.36 KB (113007) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 156) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 248.54 KB (254508) ; Min: 82.09 KB (84060) ; Max: 337.04 KB (345133) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.59 KB (1631) ; Min: 227.00 B (227) ; Max: 6.12 KB (6264) ; Number of samples: 3432) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 156) |
| - ParquetRowGroupIdealReservation: (Avg: 221.59 KB (226907) ; Min: 176.00 KB (180224) ; Max: 440.00 KB (450560) ; Number of samples: 156) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 264.28 KB (270623) ; Min: 83.02 KB (85016) ; Max: 337.76 KB (345865) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.69 KB (1734) ; Min: 223.00 B (223) ; Max: 6.15 KB (6302) ; Number of samples: 3432) |
| - AverageHdfsReadThreadConcurrency: 0.29 |
| - BytesRead: 27.95 MB (29305988) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 27.95 MB (29305988) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 27.95 MB (29305988) |
| - CachedFileHandlesHitCount: 3.26K (3263) |
| - CachedFileHandlesMissCount: 325 (325) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 27.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 639.992ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.43K (3432) |
| - NumRowGroups: 156 (156) |
| - NumRowGroupsWithPageIndex: 156 (156) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.45 MB (8857146) |
| - PerReadThreadRawHdfsThroughput: 67.18 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 239.67K (239672) |
| - RowsReturned: 239.67K (239672) |
| - RowsReturnedRate: 70.41 K/sec |
| - ScanRangesComplete: 156 (156) |
| - ScannerIoWaitTime: 383.995ms |
| - TotalRawHdfsOpenFileTime: 555.993ms |
| - TotalRawHdfsReadTime: 415.995ms |
| - TotalReadThroughput: 6.62 MB/sec |
| - TotalTime: 3s403ms |
| Buffer pool: |
| - AllocTime: 19.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 50.57 MB (53026816) |
| - CumulativeAllocations: 3.59K (3588) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 440.00 KB (450560) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000008 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:27.327 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/21.12 MB |
| Fragment Instance Lifecycle Event Timeline: 3s795ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s795ms (3s795ms) |
| - First Batch Produced: 3s795ms (0.000ns) |
| - First Batch Sent: 3s795ms (0.000ns) |
| - ExecInternal Finished: 3s795ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.04 MB, 8.24 MB, 8.10 MB, 8.04 MB, 8.04 MB, 8.06 MB, 8.04 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 21.12 MB (22147452) |
| - CompletionTime: 3s863ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 5.47 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.45 MB (8859420) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 37.41 MB (39231939) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 303.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.65K (8654) |
| - TotalThreadsTotalWallClockTime: 3s795ms |
| - TotalThreadsSysTime: 93.090ms |
| - TotalThreadsUserTime: 1s280ms |
| - TotalThreadsVoluntaryContextSwitches: 3.73K (3727) |
| - TotalTime: 3s795ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s795ms |
| - ExecTreeOpenTime: 3s555ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 63.05 MB/sec ; Min: 63.05 MB/sec ; Max: 63.05 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 203.937us ; Min: 181.867us ; Max: 226.007us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 100.152us ; Min: 59.784us ; Max: 140.521us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.59 KB (14943) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s795ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s795ms (3s555ms) |
| - First Batch Requested: 3s795ms (0.000ns) |
| - First Batch Returned: 3s795ms (0.000ns) |
| - Last Batch Returned: 3s795ms (0.000ns) |
| - Closed: 3s795ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s555ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 167.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 159 out of 159 |
| Hdfs Read Thread Concurrency Bucket: 0:71.43% 1:0% 2:28.57% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:159 |
| Node Lifecycle Event Timeline: 3s795ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 275.996ms (35.999ms) |
| - Last Batch Returned: 3s795ms (3s519ms) |
| - Closed: 3s795ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.16 MB, 7.59 MB, 11.14 MB, 14.49 MB, 18.07 MB, 21.98 MB, 27.14 MB |
| - FooterProcessingTime: (Avg: 1.232ms ; Min: 0.000ns ; Max: 11.999ms ; Number of samples: 159) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 159) |
| - InitialRangeIdealReservation: (Avg: 112.70 KB (115409) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 159) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 248.30 KB (254256) ; Min: 81.87 KB (83835) ; Max: 336.48 KB (344558) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.56 KB (1599) ; Min: 221.00 B (221) ; Max: 5.15 KB (5278) ; Number of samples: 3498) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 159) |
| - ParquetRowGroupIdealReservation: (Avg: 218.82 KB (224069) ; Min: 176.00 KB (180224) ; Max: 408.00 KB (417792) ; Number of samples: 159) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 263.72 KB (270047) ; Min: 82.69 KB (84670) ; Max: 337.00 KB (345085) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.66 KB (1698) ; Min: 218.00 B (218) ; Max: 5.18 KB (5308) ; Number of samples: 3498) |
| - AverageHdfsReadThreadConcurrency: 0.71 |
| - BytesRead: 28.20 MB (29573092) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 28.20 MB (29573092) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 28.20 MB (29573092) |
| - CachedFileHandlesHitCount: 3.32K (3323) |
| - CachedFileHandlesMissCount: 334 (334) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 23.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 619.993ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.50K (3498) |
| - NumRowGroups: 159 (159) |
| - NumRowGroupsWithPageIndex: 159 (159) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.41 MB (8816228) |
| - PerReadThreadRawHdfsThroughput: 66.52 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 239.56K (239564) |
| - RowsReturned: 239.56K (239564) |
| - RowsReturnedRate: 70.79 K/sec |
| - ScanRangesComplete: 159 (159) |
| - ScannerIoWaitTime: 303.996ms |
| - TotalRawHdfsOpenFileTime: 759.991ms |
| - TotalRawHdfsReadTime: 423.995ms |
| - TotalReadThroughput: 6.77 MB/sec |
| - TotalTime: 3s383ms |
| Buffer pool: |
| - AllocTime: 15.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 51.48 MB (53977088) |
| - CumulativeAllocations: 3.66K (3657) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 408.00 KB (417792) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000007 (host=tarmstrong-Precision-7540:27000): |
| Last report received time: 2020-12-15 20:07:27.327 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.21 MB |
| Fragment Instance Lifecycle Event Timeline: 3s791ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s787ms (3s787ms) |
| - First Batch Produced: 3s787ms (0.000ns) |
| - First Batch Sent: 3s787ms (0.000ns) |
| - ExecInternal Finished: 3s791ms (3.999ms) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.38 MB, 8.04 MB, 8.04 MB, 8.04 MB, 12.05 MB, 8.44 MB, 8.35 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.21 MB (16999375) |
| - CompletionTime: 3s863ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.20 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 12.28 MB (12875074) |
| - PeakReservation: 8.31 MB (8716288) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 37.41 MB (39231939) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 271.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 7.70K (7700) |
| - TotalThreadsTotalWallClockTime: 3s791ms |
| - TotalThreadsSysTime: 52.178ms |
| - TotalThreadsUserTime: 1s517ms |
| - TotalThreadsVoluntaryContextSwitches: 3.46K (3456) |
| - TotalTime: 3s791ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 3.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s787ms |
| - ExecTreeOpenTime: 3s547ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 38.63 MB/sec ; Min: 38.63 MB/sec ; Max: 38.63 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 291.098us ; Min: 216.228us ; Max: 365.968us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 125.715us ; Min: 58.388us ; Max: 193.042us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.48 KB (14823) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s787ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 3s787ms (3s547ms) |
| - First Batch Requested: 3s787ms (0.000ns) |
| - First Batch Returned: 3s787ms (0.000ns) |
| - Last Batch Returned: 3s787ms (0.000ns) |
| - Closed: 3s787ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s547ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 219.997ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 139 out of 139 |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:139 |
| Node Lifecycle Event Timeline: 3s787ms |
| - Open Started: 239.997ms (239.997ms) |
| - Open Finished: 239.997ms (0.000ns) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 279.996ms (39.999ms) |
| - Last Batch Returned: 3s787ms (3s507ms) |
| - Closed: 3s787ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.12 MB, 7.48 MB, 10.64 MB, 14.10 MB, 20.08 MB, 23.69 MB, 28.41 MB |
| - FooterProcessingTime: (Avg: 1.352ms ; Min: 0.000ns ; Max: 7.999ms ; Number of samples: 139) |
| - InitialRangeActualReservation: (Avg: 8.12 MB (8515908) ; Min: 8.00 MB (8388608) ; Max: 8.31 MB (8716288) ; Number of samples: 139) |
| - InitialRangeIdealReservation: (Avg: 110.50 KB (113155) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 139) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 357.47 KB (366054) ; Min: 110.14 KB (112784) ; Max: 509.83 KB (522065) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 2.53 KB (2594) ; Min: 239.00 B (239) ; Max: 78.28 KB (80161) ; Number of samples: 3104) |
| - ParquetRowGroupActualReservation: (Avg: 8.12 MB (8518265) ; Min: 8.00 MB (8388608) ; Max: 8.31 MB (8716288) ; Number of samples: 139) |
| - ParquetRowGroupIdealReservation: (Avg: 278.62 KB (285305) ; Min: 176.00 KB (180224) ; Max: 8.31 MB (8716288) ; Number of samples: 139) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 389.96 KB (399315) ; Min: 110.67 KB (113329) ; Max: 848.12 KB (868472) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 2.76 KB (2830) ; Min: 241.00 B (241) ; Max: 78.27 KB (80152) ; Number of samples: 3104) |
| - AverageHdfsReadThreadConcurrency: 0.00 |
| - BytesRead: 29.67 MB (31108369) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 29.67 MB (31108369) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 29.67 MB (31108369) |
| - CachedFileHandlesHitCount: 2.92K (2915) |
| - CachedFileHandlesMissCount: 282 (282) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 35.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 863.990ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.10K (3104) |
| - NumRowGroups: 139 (139) |
| - NumRowGroupsWithPageIndex: 139 (139) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 12.24 MB (12831882) |
| - PerReadThreadRawHdfsThroughput: 69.97 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 334.56K (334558) |
| - RowsReturned: 334.56K (334558) |
| - RowsReturnedRate: 100.77 K/sec |
| - ScanRangesComplete: 139 (139) |
| - ScannerIoWaitTime: 271.996ms |
| - TotalRawHdfsOpenFileTime: 623.993ms |
| - TotalRawHdfsReadTime: 423.995ms |
| - TotalReadThroughput: 7.09 MB/sec |
| - TotalTime: 3s319ms |
| Buffer pool: |
| - AllocTime: 27.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 52.82 MB (55386112) |
| - CumulativeAllocations: 3.20K (3197) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.31 MB (8716288) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 8.31 MB (8716288) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb0000000b (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:27.203 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.06 MB |
| Fragment Instance Lifecycle Event Timeline: 3s703ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s703ms (3s703ms) |
| - First Batch Produced: 3s703ms (0.000ns) |
| - First Batch Sent: 3s703ms (0.000ns) |
| - ExecInternal Finished: 3s703ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.24 MB, 8.24 MB, 8.04 MB, 8.04 MB, 8.26 MB, 8.24 MB, 8.08 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.06 MB (16835710) |
| - CompletionTime: 3s735ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.30 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.45 MB (8859433) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.61 MB (35243040) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 343.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.11K (8108) |
| - TotalThreadsTotalWallClockTime: 3s703ms |
| - TotalThreadsSysTime: 74.899ms |
| - TotalThreadsUserTime: 1s206ms |
| - TotalThreadsVoluntaryContextSwitches: 3.69K (3689) |
| - TotalTime: 3s703ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s703ms |
| - ExecTreeOpenTime: 3s467ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 56.50 MB/sec ; Min: 56.50 MB/sec ; Max: 56.50 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 200.305us ; Min: 148.623us ; Max: 251.988us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 99.454us ; Min: 59.225us ; Max: 139.683us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.58 KB (14928) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s703ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s703ms (3s467ms) |
| - First Batch Requested: 3s703ms (0.000ns) |
| - First Batch Returned: 3s703ms (0.000ns) |
| - Last Batch Returned: 3s703ms (0.000ns) |
| - Closed: 3s703ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s467ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 123.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 157 out of 157 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:0% 2:0% 3:0% 4:14.29% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:157 |
| Node Lifecycle Event Timeline: 3s703ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 267.997ms (27.999ms) |
| - Last Batch Returned: 3s699ms (3s431ms) |
| - Closed: 3s703ms (3.999ms) |
| - BytesReadSeries (500.000ms): 0, 3.60 MB, 8.13 MB, 11.91 MB, 15.24 MB, 18.23 MB, 21.49 MB, 26.10 MB |
| - FooterProcessingTime: (Avg: 1.146ms ; Min: 0.000ns ; Max: 7.999ms ; Number of samples: 157) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 157) |
| - InitialRangeIdealReservation: (Avg: 111.69 KB (114374) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 157) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 221.26 KB (226575) ; Min: 73.99 KB (75762) ; Max: 299.55 KB (306737) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.41 KB (1443) ; Min: 233.00 B (233) ; Max: 5.15 KB (5277) ; Number of samples: 3454) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 157) |
| - ParquetRowGroupIdealReservation: (Avg: 213.76 KB (218888) ; Min: 176.00 KB (180224) ; Max: 408.00 KB (417792) ; Number of samples: 157) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 234.55 KB (240176) ; Min: 74.72 KB (76514) ; Max: 299.90 KB (307093) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.49 KB (1529) ; Min: 229.00 B (229) ; Max: 5.17 KB (5298) ; Number of samples: 3454) |
| - AverageHdfsReadThreadConcurrency: 0.57 |
| - BytesRead: 26.33 MB (27607687) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 26.33 MB (27607687) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 26.33 MB (27607687) |
| - CachedFileHandlesHitCount: 3.30K (3299) |
| - CachedFileHandlesMissCount: 312 (312) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 43.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 583.993ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.45K (3454) |
| - NumRowGroups: 157 (157) |
| - NumRowGroupsWithPageIndex: 157 (157) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.41 MB (8816241) |
| - PerReadThreadRawHdfsThroughput: 74.80 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 216.45K (216450) |
| - RowsReturned: 216.45K (216450) |
| - RowsReturnedRate: 64.88 K/sec |
| - ScanRangesComplete: 157 (157) |
| - ScannerIoWaitTime: 343.996ms |
| - TotalRawHdfsOpenFileTime: 575.993ms |
| - TotalRawHdfsReadTime: 351.996ms |
| - TotalReadThroughput: 6.52 MB/sec |
| - TotalTime: 3s335ms |
| Buffer pool: |
| - AllocTime: 7.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 49.90 MB (52322304) |
| - CumulativeAllocations: 3.61K (3611) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 408.00 KB (417792) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb00000009 (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:27.203 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/16.04 MB |
| Fragment Instance Lifecycle Event Timeline: 3s695ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s691ms (3s691ms) |
| - First Batch Produced: 3s691ms (0.000ns) |
| - First Batch Sent: 3s691ms (0.000ns) |
| - ExecInternal Finished: 3s695ms (3.999ms) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.04 MB, 8.24 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.04 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 16.04 MB (16818798) |
| - CompletionTime: 3s735ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.29 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.45 MB (8860274) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.61 MB (35243040) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 3.999ms |
| - TotalStorageWaitTime: 287.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 7.92K (7921) |
| - TotalThreadsTotalWallClockTime: 3s695ms |
| - TotalThreadsSysTime: 67.171ms |
| - TotalThreadsUserTime: 1s423ms |
| - TotalThreadsVoluntaryContextSwitches: 3.56K (3557) |
| - TotalTime: 3s695ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 3.999ms |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s691ms |
| - ExecTreeOpenTime: 3s455ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 53.16 MB/sec ; Min: 53.16 MB/sec ; Max: 53.16 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 212.597us ; Min: 158.959us ; Max: 266.236us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 97.219us ; Min: 51.962us ; Max: 142.476us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 3.999ms |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.49 KB (14840) |
| - TotalTime: 3.999ms |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s691ms (3s455ms) |
| - First Batch Requested: 3s691ms (0.000ns) |
| - First Batch Returned: 3s691ms (0.000ns) |
| - Last Batch Returned: 3s691ms (0.000ns) |
| - Closed: 3s691ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s455ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 127.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 149 out of 149 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:149 |
| Node Lifecycle Event Timeline: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 259.997ms (19.999ms) |
| - Last Batch Returned: 3s691ms (3s431ms) |
| - Closed: 3s691ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.10 MB, 6.95 MB, 10.85 MB, 14.38 MB, 17.42 MB, 21.01 MB, 25.38 MB |
| - FooterProcessingTime: (Avg: 1.181ms ; Min: 0.000ns ; Max: 7.999ms ; Number of samples: 149) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 149) |
| - InitialRangeIdealReservation: (Avg: 111.68 KB (114358) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 149) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 219.12 KB (224379) ; Min: 72.87 KB (74623) ; Max: 296.63 KB (303751) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.47 KB (1505) ; Min: 234.00 B (234) ; Max: 5.19 KB (5314) ; Number of samples: 3278) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 149) |
| - ParquetRowGroupIdealReservation: (Avg: 217.61 KB (222833) ; Min: 176.00 KB (180224) ; Max: 424.00 KB (434176) ; Number of samples: 149) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 232.38 KB (237958) ; Min: 73.58 KB (75342) ; Max: 297.04 KB (304168) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.56 KB (1597) ; Min: 232.00 B (232) ; Max: 5.21 KB (5338) ; Number of samples: 3278) |
| - AverageHdfsReadThreadConcurrency: 0.14 |
| - BytesRead: 25.64 MB (26886807) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 25.64 MB (26886807) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 25.64 MB (26886807) |
| - CachedFileHandlesHitCount: 3.15K (3146) |
| - CachedFileHandlesMissCount: 281 (281) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 23.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 659.992ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.28K (3278) |
| - NumRowGroups: 149 (149) |
| - NumRowGroupsWithPageIndex: 149 (149) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.41 MB (8817082) |
| - PerReadThreadRawHdfsThroughput: 71.23 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 213.13K (213129) |
| - RowsReturned: 213.13K (213129) |
| - RowsReturnedRate: 64.04 K/sec |
| - ScanRangesComplete: 149 (149) |
| - ScannerIoWaitTime: 287.996ms |
| - TotalRawHdfsOpenFileTime: 387.995ms |
| - TotalRawHdfsReadTime: 359.996ms |
| - TotalReadThroughput: 6.34 MB/sec |
| - TotalTime: 3s327ms |
| Buffer pool: |
| - AllocTime: 27.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 47.91 MB (50241536) |
| - CumulativeAllocations: 3.43K (3427) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 424.00 KB (434176) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 3.999ms |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb0000000a (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:27.203 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.86 MB |
| Fragment Instance Lifecycle Event Timeline: 3s695ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s695ms (3s695ms) |
| - First Batch Produced: 3s695ms (0.000ns) |
| - First Batch Sent: 3s695ms (0.000ns) |
| - ExecInternal Finished: 3s695ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.44 MB, 8.33 MB, 8.43 MB, 8.04 MB, 8.04 MB, 8.04 MB, 8.04 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.86 MB (16634121) |
| - CompletionTime: 3s735ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.25 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.45 MB (8855253) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.61 MB (35243040) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 319.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.10K (8103) |
| - TotalThreadsTotalWallClockTime: 3s695ms |
| - TotalThreadsSysTime: 68.486ms |
| - TotalThreadsUserTime: 1s277ms |
| - TotalThreadsVoluntaryContextSwitches: 3.44K (3441) |
| - TotalTime: 3s695ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s695ms |
| - ExecTreeOpenTime: 3s459ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 27.86 MB/sec ; Min: 27.86 MB/sec ; Max: 27.86 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 392.369us ; Min: 275.455us ; Max: 509.284us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 93.168us ; Min: 69.841us ; Max: 116.495us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.53 KB (14878) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s695ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s695ms (3s459ms) |
| - First Batch Requested: 3s695ms (0.000ns) |
| - First Batch Returned: 3s695ms (0.000ns) |
| - Last Batch Returned: 3s695ms (0.000ns) |
| - Closed: 3s695ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s459ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 143.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 150 out of 150 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:150 |
| Node Lifecycle Event Timeline: 3s695ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 263.997ms (23.999ms) |
| - Last Batch Returned: 3s695ms (3s431ms) |
| - Closed: 3s695ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 3.65 MB, 8.45 MB, 12.16 MB, 15.35 MB, 19.08 MB, 22.33 MB, 27.49 MB |
| - FooterProcessingTime: (Avg: 1.359ms ; Min: 0.000ns ; Max: 11.999ms ; Number of samples: 150) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 150) |
| - InitialRangeIdealReservation: (Avg: 116.05 KB (118838) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 150) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 248.18 KB (254138) ; Min: 81.95 KB (83912) ; Max: 337.13 KB (345222) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.65 KB (1694) ; Min: 247.00 B (247) ; Max: 5.04 KB (5162) ; Number of samples: 3300) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 150) |
| - ParquetRowGroupIdealReservation: (Avg: 223.73 KB (229102) ; Min: 176.00 KB (180224) ; Max: 392.00 KB (401408) ; Number of samples: 150) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 264.21 KB (270553) ; Min: 82.92 KB (84910) ; Max: 337.85 KB (345955) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.76 KB (1803) ; Min: 244.00 B (244) ; Max: 5.06 KB (5183) ; Number of samples: 3300) |
| - AverageHdfsReadThreadConcurrency: 0.14 |
| - BytesRead: 27.72 MB (29069223) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 27.72 MB (29069223) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 27.72 MB (29069223) |
| - CachedFileHandlesHitCount: 3.13K (3132) |
| - CachedFileHandlesMissCount: 318 (318) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 31.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 707.992ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.30K (3300) |
| - NumRowGroups: 150 (150) |
| - NumRowGroupsWithPageIndex: 150 (150) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.40 MB (8812061) |
| - PerReadThreadRawHdfsThroughput: 77.87 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 238.69K (238693) |
| - RowsReturned: 238.69K (238693) |
| - RowsReturnedRate: 71.98 K/sec |
| - ScanRangesComplete: 150 (150) |
| - ScannerIoWaitTime: 319.996ms |
| - TotalRawHdfsOpenFileTime: 547.993ms |
| - TotalRawHdfsReadTime: 355.996ms |
| - TotalReadThroughput: 6.87 MB/sec |
| - TotalTime: 3s315ms |
| Buffer pool: |
| - AllocTime: 7.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 49.77 MB (52191232) |
| - CumulativeAllocations: 3.45K (3450) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 392.00 KB (401408) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Instance da4f8f953162a9b0:9a4d93eb0000000c (host=tarmstrong-Precision-7540:27002): |
| Last report received time: 2020-12-15 20:07:27.203 |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:152/15.76 MB |
| Fragment Instance Lifecycle Event Timeline: 3s691ms |
| - Prepare Finished: 0.000ns (0.000ns) |
| - Open Finished: 3s691ms (3s691ms) |
| - First Batch Produced: 3s691ms (0.000ns) |
| - First Batch Sent: 3s691ms (0.000ns) |
| - ExecInternal Finished: 3s691ms (0.000ns) |
| - MemoryUsage (500.000ms): 12.01 KB, 8.38 MB, 8.33 MB, 8.04 MB, 8.04 MB, 8.42 MB, 8.04 MB, 8.04 MB |
| - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 |
| - AverageThreadTokens: 1.00 |
| - BytesAssigned: 15.76 MB (16526332) |
| - CompletionTime: 3s731ms |
| - ExchangeScanRatio: 0.00 |
| - ExecutionRate: 4.22 MB/sec |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.47 MB (8882006) |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUsedReservation: 0 |
| - PerHostPeakMemUsage: 33.61 MB (35243040) |
| - RowsProduced: 1 (1) |
| - TotalNetworkReceiveTime: 0.000ns |
| - TotalNetworkSendTime: 0.000ns |
| - TotalStorageWaitTime: 303.996ms |
| - TotalThreadsInvoluntaryContextSwitches: 8.34K (8336) |
| - TotalThreadsTotalWallClockTime: 3s691ms |
| - TotalThreadsSysTime: 71.306ms |
| - TotalThreadsUserTime: 1s311ms |
| - TotalThreadsVoluntaryContextSwitches: 3.53K (3528) |
| - TotalTime: 3s691ms |
| Fragment Instance Lifecycle Timings: |
| - ExecTime: 0.000ns |
| - ExecTreeExecTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - OpenTime: 3s691ms |
| - ExecTreeOpenTime: 3s455ms |
| - PrepareTime: 0.000ns |
| - ExecTreePrepareTime: 0.000ns |
| - TotalTime: 0.000ns |
| KrpcDataStreamSender (dst_id=2): |
| ExecOption: Unpartitioned Sender Codegen Disabled: not needed |
| - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 |
| - NetworkThroughput: (Avg: 55.96 MB/sec ; Min: 55.96 MB/sec ; Max: 55.96 MB/sec ; Number of samples: 1) |
| - RpcNetworkTime: (Avg: 240.673us ; Min: 227.124us ; Max: 254.222us ; Number of samples: 2) |
| - RpcRecvrTime: (Avg: 111.188us ; Min: 75.709us ; Max: 146.667us ; Number of samples: 2) |
| - EosSent: 1 (1) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 8.00 B (8) |
| - RowsSent: 1 (1) |
| - RpcFailure: 0 (0) |
| - RpcRetry: 0 (0) |
| - SerializeBatchTime: 0.000ns |
| - TotalBytesSent: 14.57 KB (14917) |
| - TotalTime: 0.000ns |
| - UncompressedRowBatchSize: 22.18 KB (22712) |
| AGGREGATION_NODE (id=1): |
| Node Lifecycle Event Timeline: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 3s691ms (3s455ms) |
| - First Batch Requested: 3s691ms (0.000ns) |
| - First Batch Returned: 3s691ms (0.000ns) |
| - Last Batch Returned: 3s691ms (0.000ns) |
| - Closed: 3s691ms (0.000ns) |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 133.17 KB (136368) |
| - RowsReturned: 1 (1) |
| - RowsReturnedRate: 0 |
| - TotalTime: 3s455ms |
| NonGroupingAggregator 0: |
| ExecOption: Codegen Enabled |
| - BuildTime: 179.998ms |
| - InactiveTotalTime: 0.000ns |
| - PeakMemoryUsage: 26.17 KB (26800) |
| - RowsReturned: 1 (1) |
| - TotalTime: 0.000ns |
| HDFS_SCAN_NODE (id=0): |
| Table Name: tpcds_parquet.store_sales |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 152 out of 152 |
| Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:0% 2:14.29% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% |
| File Formats: PARQUET/SNAPPY:152 |
| Node Lifecycle Event Timeline: 3s691ms |
| - Open Started: 235.997ms (235.997ms) |
| - Open Finished: 239.997ms (3.999ms) |
| - First Batch Requested: 239.997ms (0.000ns) |
| - First Batch Returned: 255.997ms (15.999ms) |
| - Last Batch Returned: 3s691ms (3s435ms) |
| - Closed: 3s691ms (0.000ns) |
| - BytesReadSeries (500.000ms): 0, 4.21 MB, 8.31 MB, 12.18 MB, 16.06 MB, 19.85 MB, 23.21 MB, 27.91 MB |
| - FooterProcessingTime: (Avg: 1.342ms ; Min: 0.000ns ; Max: 11.999ms ; Number of samples: 152) |
| - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 152) |
| - InitialRangeIdealReservation: (Avg: 108.63 KB (111238) ; Min: 64.00 KB (65536) ; Max: 128.00 KB (131072) ; Number of samples: 152) |
| - PageIndexProcessingTime: 0.000ns (Number of samples: 0) |
| - ParquetCompressedBytesReadPerColumn: (Avg: 257.61 KB (263789) ; Min: 84.27 KB (86292) ; Max: 348.85 KB (357224) ; Number of samples: 22) |
| - ParquetCompressedPageSize: (Avg: 1.69 KB (1735) ; Min: 238.00 B (238) ; Max: 5.69 KB (5822) ; Number of samples: 3344) |
| - ParquetRowGroupActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 152) |
| - ParquetRowGroupIdealReservation: (Avg: 227.74 KB (233202) ; Min: 176.00 KB (180224) ; Max: 440.00 KB (450560) ; Number of samples: 152) |
| - ParquetUncompressedBytesReadPerColumn: (Avg: 274.32 KB (280899) ; Min: 85.60 KB (87652) ; Max: 349.61 KB (358000) ; Number of samples: 22) |
| - ParquetUncompressedPageSize: (Avg: 1.80 KB (1848) ; Min: 235.00 B (235) ; Max: 5.72 KB (5861) ; Number of samples: 3344) |
| - AverageHdfsReadThreadConcurrency: 0.29 |
| - BytesRead: 28.09 MB (29458526) |
| - BytesReadDataNodeCache: 0 |
| - BytesReadLocal: 28.09 MB (29458526) |
| - BytesReadRemoteUnexpected: 0 |
| - BytesReadShortCircuit: 28.09 MB (29458526) |
| - CachedFileHandlesHitCount: 3.17K (3168) |
| - CachedFileHandlesMissCount: 328 (328) |
| - CollectionItemsRead: 0 (0) |
| - DataCacheHitBytes: 0 |
| - DataCacheHitCount: 0 (0) |
| - DataCacheMissBytes: 0 |
| - DataCacheMissCount: 0 (0) |
| - DataCachePartialHitCount: 0 (0) |
| - DecompressionTime: 31.999ms |
| - InactiveTotalTime: 0.000ns |
| - MaterializeTupleTime: 659.992ms |
| - MaxCompressedTextFileLength: 0 |
| - NumColumns: 22 (22) |
| - NumDictFilteredRowGroups: 0 (0) |
| - NumDisksAccessed: 1 (1) |
| - NumPages: 3.34K (3344) |
| - NumRowGroups: 152 (152) |
| - NumRowGroupsWithPageIndex: 152 (152) |
| - NumScannersWithNoReads: 0 (0) |
| - NumStatsFilteredPages: 0 (0) |
| - NumStatsFilteredRowGroups: 0 (0) |
| - PeakMemoryUsage: 8.43 MB (8838814) |
| - PerReadThreadRawHdfsThroughput: 69.54 MB/sec |
| - RemoteScanRanges: 0 (0) |
| - RowsRead: 245.62K (245615) |
| - RowsReturned: 245.62K (245615) |
| - RowsReturnedRate: 74.97 K/sec |
| - ScanRangesComplete: 152 (152) |
| - ScannerIoWaitTime: 303.996ms |
| - TotalRawHdfsOpenFileTime: 579.993ms |
| - TotalRawHdfsReadTime: 403.995ms |
| - TotalReadThroughput: 6.97 MB/sec |
| - TotalTime: 3s275ms |
| Buffer pool: |
| - AllocTime: 23.999ms |
| - CompressionTime: 0.000ns |
| - CumulativeAllocationBytes: 49.93 MB (52355072) |
| - CumulativeAllocations: 3.50K (3496) |
| - EncryptionTime: 0.000ns |
| - InactiveTotalTime: 0.000ns |
| - PeakReservation: 8.00 MB (8388608) |
| - PeakUnpinnedBytes: 0 |
| - PeakUsedReservation: 440.00 KB (450560) |
| - ReadIoBytes: 0 |
| - ReadIoOps: 0 (0) |
| - ReadIoWaitTime: 0.000ns |
| - SystemAllocTime: 0.000ns |
| - TotalTime: 0.000ns |
| - WriteIoBytes: 0 |
| - WriteIoOps: 0 (0) |
| - WriteIoWaitTime: 0.000ns |
| Query (id=484be0f1c7b1005f:242a988600000000): |
| DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Summary: |
| Session ID: 3d44010dd05364df:6980cb4578e82ca6 |
| Session Type: HIVESERVER2 |
| HiveServer2 Protocol Version: V6 |
| Start Time: 2020-12-15 20:07:15.987954000 |
| End Time: 2020-12-15 20:07:39.786634000 |
| Query Type: DDL |
| Query State: FINISHED |
| Impala Query State: FINISHED |
| Query Status: OK |
| Impala Version: impalad version 4.0.0-SNAPSHOT DEBUG (build f7212f2361611fea183e12153886257a844e0ff1) |
| User: tarmstrong |
| Connected User: tarmstrong |
| Delegated User: |
| Network Address: ::ffff:127.0.0.1:46162 |
| Default Db: default |
| Sql Statement: compute stats tpcds_parquet.store_sales |
| Coordinator: tarmstrong-Precision-7540:27000 |
| Query Options (set by configuration): TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (f7212f2) built on Tue 15 Dec 2020 04:06:17 PM PST |
| Query Options (set by configuration and planner): MT_DOP=4,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=Impala Shell v4.0.0-SNAPSHOT (f7212f2) built on Tue 15 Dec 2020 04:06:17 PM PST |
| DDL Type: COMPUTE_STATS |
| Query Compilation: 5s740ms |
| - Metadata load started: 3.587ms (3.587ms) |
| - Metadata load finished. loaded-tables=1/1 load-requests=1 catalog-updates=5 storage-load-time=645ms: 5s657ms (5s654ms) |
| - Analysis finished: 5s715ms (57.355ms) |
| - Authorization finished (noop): 5s715ms (611.252us) |
| - Planning finished: 5s740ms (25.076ms) |
| Query Timeline: 23s795ms |
| - Query submitted: 0.000ns (0.000ns) |
| - Planning finished: 5s739ms (5s739ms) |
| - Child queries finished: 11s339ms (5s599ms) |
| - Metastore update finished: 23s643ms (12s303ms) |
| - Rows available: 23s643ms (0.000ns) |
| - Unregister query: 23s795ms (151.998ms) |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Frontend: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| ImpalaServer: |
| - CatalogOpExecTimer: 12s211ms |
| - ClientFetchWaitTimer: 151.998ms |
| - InactiveTotalTime: 0.000ns |
| - NumRowsFetched: 0 (0) |
| - NumRowsFetchedFromCache: 0 (0) |
| - RowMaterializationRate: 0 |
| - RowMaterializationTimer: 0.000ns |
| - TotalTime: 0.000ns |
| Child Queries: |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Table Stats Query (id=454fb5fa46498311:3afee31900000000): |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
| Column Stats Query (id=da4f8f953162a9b0:9a4d93eb00000000): |
| - InactiveTotalTime: 0.000ns |
| - TotalTime: 0.000ns |
