blob: ce76c306fe04f4da7282fce437e7f0959c48e576 [file] [log] [blame]
PREHOOK: query: create table tmp_n1(col0 string, col1 string,col2 string,col3 string,col4 string,col5 string,col6 string,col7 string,col8 string,col9 string,col10 string,col11 string)
PREHOOK: type: CREATETABLE
PREHOOK: Output: database:default
PREHOOK: Output: default@tmp_n1
POSTHOOK: query: create table tmp_n1(col0 string, col1 string,col2 string,col3 string,col4 string,col5 string,col6 string,col7 string,col8 string,col9 string,col10 string,col11 string)
POSTHOOK: type: CREATETABLE
POSTHOOK: Output: database:default
POSTHOOK: Output: default@tmp_n1
PREHOOK: query: insert overwrite table tmp_n1 select key, cast(key + 1 as int), key +2, key+3, key+4, cast(key+5 as int), key+6, key+7, key+8, key+9, key+10, cast(key+11 as int) from src where key = 100
PREHOOK: type: QUERY
PREHOOK: Input: default@src
PREHOOK: Output: default@tmp_n1
POSTHOOK: query: insert overwrite table tmp_n1 select key, cast(key + 1 as int), key +2, key+3, key+4, cast(key+5 as int), key+6, key+7, key+8, key+9, key+10, cast(key+11 as int) from src where key = 100
POSTHOOK: type: QUERY
POSTHOOK: Input: default@src
POSTHOOK: Output: default@tmp_n1
POSTHOOK: Lineage: tmp_n1.col0 SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: tmp_n1.col1 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col10 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col11 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col2 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col3 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col4 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col5 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col6 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col7 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col8 EXPRESSION []
POSTHOOK: Lineage: tmp_n1.col9 EXPRESSION []
PREHOOK: query: select * from tmp_n1
PREHOOK: type: QUERY
PREHOOK: Input: default@tmp_n1
#### A masked pattern was here ####
POSTHOOK: query: select * from tmp_n1
POSTHOOK: type: QUERY
POSTHOOK: Input: default@tmp_n1
#### A masked pattern was here ####
100 101 102.0 103.0 104.0 105 106.0 107.0 108.0 109.0 110.0 111
100 101 102.0 103.0 104.0 105 106.0 107.0 108.0 109.0 110.0 111
PREHOOK: query: explain
FROM src a JOIN tmp_n1 b ON (a.key = b.col11)
SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count
where b.col11 = 111
group by a.value, b.col5
PREHOOK: type: QUERY
POSTHOOK: query: explain
FROM src a JOIN tmp_n1 b ON (a.key = b.col11)
SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count
where b.col11 = 111
group by a.value, b.col5
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
Stage-5 is a root stage
Stage-2 depends on stages: Stage-5
Stage-0 depends on stages: Stage-2
STAGE PLANS:
Stage: Stage-5
Map Reduce Local Work
Alias -> Map Local Tables:
$hdt$_1:b
Fetch Operator
limit: -1
Alias -> Map Local Operator Tree:
$hdt$_1:b
TableScan
alias: b
Statistics: Num rows: 2 Data size: 126 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: (UDFToDouble(col11) = 111.0D) (type: boolean)
Statistics: Num rows: 1 Data size: 63 Basic stats: COMPLETE Column stats: NONE
Select Operator
expressions: col5 (type: string), col11 (type: string)
outputColumnNames: _col0, _col1
Statistics: Num rows: 1 Data size: 63 Basic stats: COMPLETE Column stats: NONE
HashTable Sink Operator
keys:
0 _col0 (type: string)
1 _col1 (type: string)
Stage: Stage-2
Map Reduce
Map Operator Tree:
TableScan
alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: (UDFToDouble(key) = 111.0D) (type: boolean)
Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
Select Operator
expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
Map Join Operator
condition map:
Inner Join 0 to 1
keys:
0 _col0 (type: string)
1 _col1 (type: string)
outputColumnNames: _col1, _col2
Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
Group By Operator
aggregations: count()
keys: _col1 (type: string), _col2 (type: string)
mode: hash
outputColumnNames: _col0, _col1, _col2
Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
Map-reduce partition columns: _col0 (type: string), _col1 (type: string)
Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
value expressions: _col2 (type: bigint)
Execution mode: vectorized
Local Work:
Map Reduce Local Work
Reduce Operator Tree:
Group By Operator
aggregations: count(VALUE._col0)
keys: KEY._col0 (type: string), KEY._col1 (type: string)
mode: mergepartial
outputColumnNames: _col0, _col1, _col2
Statistics: Num rows: 137 Data size: 1455 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
Statistics: Num rows: 137 Data size: 1455 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.SequenceFileInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Stage: Stage-0
Fetch Operator
limit: -1
Processor Tree:
ListSink
PREHOOK: query: FROM src a JOIN tmp_n1 b ON (a.key = b.col11)
SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count
where b.col11 = 111
group by a.value, b.col5
PREHOOK: type: QUERY
PREHOOK: Input: default@src
PREHOOK: Input: default@tmp_n1
#### A masked pattern was here ####
POSTHOOK: query: FROM src a JOIN tmp_n1 b ON (a.key = b.col11)
SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count
where b.col11 = 111
group by a.value, b.col5
POSTHOOK: type: QUERY
POSTHOOK: Input: default@src
POSTHOOK: Input: default@tmp_n1
#### A masked pattern was here ####
val_111 105 2