| PREHOOK: query: create table tmp_n1(col0 string, col1 string,col2 string,col3 string,col4 string,col5 string,col6 string,col7 string,col8 string,col9 string,col10 string,col11 string) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@tmp_n1 |
| POSTHOOK: query: create table tmp_n1(col0 string, col1 string,col2 string,col3 string,col4 string,col5 string,col6 string,col7 string,col8 string,col9 string,col10 string,col11 string) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@tmp_n1 |
| PREHOOK: query: insert overwrite table tmp_n1 select key, cast(key + 1 as int), key +2, key+3, key+4, cast(key+5 as int), key+6, key+7, key+8, key+9, key+10, cast(key+11 as int) from src where key = 100 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| PREHOOK: Output: default@tmp_n1 |
| POSTHOOK: query: insert overwrite table tmp_n1 select key, cast(key + 1 as int), key +2, key+3, key+4, cast(key+5 as int), key+6, key+7, key+8, key+9, key+10, cast(key+11 as int) from src where key = 100 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| POSTHOOK: Output: default@tmp_n1 |
| POSTHOOK: Lineage: tmp_n1.col0 SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] |
| POSTHOOK: Lineage: tmp_n1.col1 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col10 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col11 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col2 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col3 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col4 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col5 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col6 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col7 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col8 EXPRESSION [] |
| POSTHOOK: Lineage: tmp_n1.col9 EXPRESSION [] |
| PREHOOK: query: select * from tmp_n1 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@tmp_n1 |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from tmp_n1 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@tmp_n1 |
| #### A masked pattern was here #### |
| 100 101 102.0 103.0 104.0 105 106.0 107.0 108.0 109.0 110.0 111 |
| 100 101 102.0 103.0 104.0 105 106.0 107.0 108.0 109.0 110.0 111 |
| PREHOOK: query: explain |
| FROM src a JOIN tmp_n1 b ON (a.key = b.col11) |
| SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count |
| where b.col11 = 111 |
| group by a.value, b.col5 |
| PREHOOK: type: QUERY |
| POSTHOOK: query: explain |
| FROM src a JOIN tmp_n1 b ON (a.key = b.col11) |
| SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count |
| where b.col11 = 111 |
| group by a.value, b.col5 |
| POSTHOOK: type: QUERY |
| STAGE DEPENDENCIES: |
| Stage-5 is a root stage |
| Stage-2 depends on stages: Stage-5 |
| Stage-0 depends on stages: Stage-2 |
| |
| STAGE PLANS: |
| Stage: Stage-5 |
| Map Reduce Local Work |
| Alias -> Map Local Tables: |
| $hdt$_1:b |
| Fetch Operator |
| limit: -1 |
| Alias -> Map Local Operator Tree: |
| $hdt$_1:b |
| TableScan |
| alias: b |
| Statistics: Num rows: 2 Data size: 126 Basic stats: COMPLETE Column stats: NONE |
| Filter Operator |
| predicate: (UDFToDouble(col11) = 111.0D) (type: boolean) |
| Statistics: Num rows: 1 Data size: 63 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: col5 (type: string), col11 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 63 Basic stats: COMPLETE Column stats: NONE |
| HashTable Sink Operator |
| keys: |
| 0 _col0 (type: string) |
| 1 _col1 (type: string) |
| |
| Stage: Stage-2 |
| Map Reduce |
| Map Operator Tree: |
| TableScan |
| alias: a |
| Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE |
| Filter Operator |
| predicate: (UDFToDouble(key) = 111.0D) (type: boolean) |
| Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE |
| Map Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col0 (type: string) |
| 1 _col1 (type: string) |
| outputColumnNames: _col1, _col2 |
| Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| aggregations: count() |
| keys: _col1 (type: string), _col2 (type: string) |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE |
| value expressions: _col2 (type: bigint) |
| Execution mode: vectorized |
| Local Work: |
| Map Reduce Local Work |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: string), KEY._col1 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 137 Data size: 1455 Basic stats: COMPLETE Column stats: NONE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 137 Data size: 1455 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: FROM src a JOIN tmp_n1 b ON (a.key = b.col11) |
| SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count |
| where b.col11 = 111 |
| group by a.value, b.col5 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| PREHOOK: Input: default@tmp_n1 |
| #### A masked pattern was here #### |
| POSTHOOK: query: FROM src a JOIN tmp_n1 b ON (a.key = b.col11) |
| SELECT /*+ MAPJOIN(a) */ a.value, b.col5, count(1) as count |
| where b.col11 = 111 |
| group by a.value, b.col5 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| POSTHOOK: Input: default@tmp_n1 |
| #### A masked pattern was here #### |
| val_111 105 2 |