blob: 0ed157748bf48e898a2b04b382179077f636e9c4 [file] [log] [blame] [view]
---
{
"title": "SHOW-LOAD-PROFILE",
"language": "en"
}
---
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
## SHOW-LOAD-PROFILE
### Name
SHOW LOAD PROFILE
### Description
This statement is used to view the Profile information of the import operation. This function requires the user to open the Profile settings. The versions before 0.15 perform the following settings:
```sql
SET is_report_success=true;
```
Versions 0.15 and later perform the following settings:
```sql
SET [GLOBAL] enable_profile=true;
```
grammar:
```sql
show load profile "/";
show load profile "/[queryId]"
show load profile "/[queryId]/[TaskId]"
show load profile "/[queryId]/[TaskId]/[FragmentId]/"
show load profile "/[queryId]/[TaskId]/[FragmentId]/[InstanceId]"
```
This command will list all currently saved import profiles. Each line corresponds to one import. where the QueryId column is the ID of the import job. This ID can also be viewed through the SHOW LOAD statement. We can select the QueryId corresponding to the Profile we want to see to see the specific situation
### Example
1. List all Load Profiles
```sql
mysql> show load profile "/"\G
*************************** 1. row ***************************
JobId: 20010
QueryId: 980014623046410a-af5d36f23381017f
User: root
DefaultDb: default_cluster:test
SQL: LOAD LABEL xxx
QueryType: Load
StartTime: 2023-03-07 19:48:24
EndTime: 2023-03-07 19:50:45
TotalTime: 2m21s
QueryState: N/A
TraceId:
AnalysisTime: NULL
PlanTime: NULL
ScheduleTime: NULL
FetchResultTime: NULL
WriteResultTime: NULL
WaitAndFetchResultTime: NULL
*************************** 2. row ***************************
JobId: N/A
QueryId: 7cc2d0282a7a4391-8dd75030185134d8
User: root
DefaultDb: default_cluster:test
SQL: insert into xxx
QueryType: Load
StartTime: 2023-03-07 19:49:15
EndTime: 2023-03-07 19:49:15
TotalTime: 102ms
QueryState: OK
TraceId:
AnalysisTime: 825.277us
PlanTime: 4.126ms
ScheduleTime: N/A
FetchResultTime: 0ns
WriteResultTime: 0ns
WaitAndFetchResultTime: N/A
```
2. View an overview of the subtasks with imported jobs:
```sql
mysql> show load profile "/980014623046410a-af5d36f23381017f";
+-----------------------------------+------------+
| TaskId | ActiveTime |
+-----------------------------------+------------+
| 980014623046410a-af5d36f23381017f | 3m14s |
+-----------------------------------+------------+
```
3. View the plan tree of the specified subtask
```sql
show load profile "/980014623046410a-af5d36f23381017f/980014623046410a-af5d36f23381017f";
┌───────────────────────┐
│[-1: OlapTableSink] │
│Fragment: 0 │
│MaxActiveTime: 86.541ms│
└───────────────────────┘
┌───────────────────┐
│[1: VEXCHANGE_NODE]│
│Fragment: 0 │
└───────────────────┘
┌─────────────────────────┴───────┐
│ │
┌─────────────┐ ┌───────────────────────┐
│[MemoryUsage]│ │[1: VDataStreamSender] │
│Fragment: 0 │ │Fragment: 1 │
└─────────────┘ │MaxActiveTime: 34.882ms│
└───────────────────────┘
┌───────────────────────────┐
│[0: VNewOlapScanNode(tbl1)]│
│Fragment: 1 │
└───────────────────────────┘
┌─────────────────┴───────┐
│ │
┌─────────────┐ ┌───────────┐
│[MemoryUsage]│ │[VScanner] │
│Fragment: 1 │ │Fragment: 1│
└─────────────┘ └───────────┘
┌───────┴─────────┐
│ │
┌─────────────────┐ ┌─────────────┐
│[SegmentIterator]│ │[MemoryUsage]│
│Fragment: 1 │ │Fragment: 1 │
└─────────────────┘ └─────────────┘
```sql
This will show the plan tree and fragment id on it
4. View the Instance overview of the specified subtask
```sql
mysql> show load profile "/980014623046410a-af5d36f23381017f/980014623046410a-af5d36f23381017f/1"\G
+-----------------------------------+------------------+------------+
| Instances | Host | ActiveTime |
+-----------------------------------+------------------+------------+
| 980014623046410a-88e260f0c43031f2 | 10.81.85.89:9067 | 3m7s |
| 980014623046410a-88e260f0c43031f3 | 10.81.85.89:9067 | 3m6s |
| 980014623046410a-88e260f0c43031f4 | 10.81.85.89:9067 | 3m10s |
| 980014623046410a-88e260f0c43031f5 | 10.81.85.89:9067 | 3m14s |
+-----------------------------------+------------------+------------+
```
4. Continue to view the detailed Profile of each operator on a specific Instance
```sql
mysql> show load profile "/980014623046410a-af5d36f23381017f/980014623046410a-af5d36f23381017f/1/980014623046410a-88e260f0c43031f5"\G
*************************** 1. row ***************************
Instance:
┌-----------------------------------------┐
│[-1: OlapTableSink] │
│(Active: 2m17s, non-child: 70.91) │
│ - Counters: │
│ - CloseWaitTime: 1m53s │
│ - ConvertBatchTime: 0ns │
│ - MaxAddBatchExecTime: 1m46s │
│ - NonBlockingSendTime: 3m11s │
│ - NumberBatchAdded: 782 │
│ - NumberNodeChannels: 1 │
│ - OpenTime: 743.822us │
│ - RowsFiltered: 0 │
│ - RowsRead: 1.599729M (1599729) │
│ - RowsReturned: 1.599729M (1599729)│
│ - SendDataTime: 11s761ms │
│ - TotalAddBatchExecTime: 1m46s │
│ - ValidateDataTime: 9s802ms │
└-----------------------------------------┘
┌-----------------------------------------------------┐
│[0: BROKER_SCAN_NODE] │
│(Active: 56s537ms, non-child: 29.06) │
│ - Counters: │
│ - BytesDecompressed: 0.00 │
│ - BytesRead: 5.77 GB │
│ - DecompressTime: 0ns │
│ - FileReadTime: 34s263ms │
│ - MaterializeTupleTime(*): 45s54ms │
│ - NumDiskAccess: 0 │
│ - PeakMemoryUsage: 33.03 MB │
│ - RowsRead: 1.599729M (1599729) │
│ - RowsReturned: 1.599729M (1599729) │
│ - RowsReturnedRate: 28.295K sec │
│ - TotalRawReadTime(*): 1m20s │
│ - TotalReadThroughput: 30.39858627319336 MB/sec│
│ - WaitScannerTime: 56s528ms │
└-----------------------------------------------------┘
```
### Keywords
SHOW, LOAD, PROFILE
### Best Practice