| PREHOOK: query: explain |
| select * |
| from src b |
| group by key, value |
| having not exists |
| (select a.key |
| from src a |
| where b.value = a.value and a.key = b.key and a.value > 'val_12' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select * |
| from src b |
| group by key, value |
| having not exists |
| (select a.key |
| from src a |
| where b.value = a.value and a.key = b.key and a.value > 'val_12' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: key, value |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: key (type: string), value (type: string) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((value > 'val_12') and key is not null) (type: boolean) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 83 Data size: 14774 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 83 Data size: 14774 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Anti Join 0 to 1 |
| keys: |
| 0 _col0 (type: string), _col1 (type: string) |
| 1 _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 167 Data size: 29726 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 167 Data size: 29726 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * |
| from src b |
| group by key, value |
| having not exists |
| (select a.key |
| from src a |
| where b.value = a.value and a.key = b.key and a.value > 'val_12' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * |
| from src b |
| group by key, value |
| having not exists |
| (select a.key |
| from src a |
| where b.value = a.value and a.key = b.key and a.value > 'val_12' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 0 val_0 |
| 10 val_10 |
| 100 val_100 |
| 103 val_103 |
| 104 val_104 |
| 105 val_105 |
| 11 val_11 |
| 111 val_111 |
| 113 val_113 |
| 114 val_114 |
| 116 val_116 |
| 118 val_118 |
| 119 val_119 |
| 12 val_12 |
| PREHOOK: query: explain |
| select * |
| from src b |
| group by key, value |
| having not exists |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.value > 'val_12' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select * |
| from src b |
| group by key, value |
| having not exists |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.value > 'val_12' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE), Reducer 4 (SIMPLE_EDGE) |
| Reducer 4 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: key, value |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: value (type: string), key (type: string) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (value > 'val_12') (type: boolean) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: value (type: string), key (type: string) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 83 Data size: 14774 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 83 Data size: 14774 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: string), _col0 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: string) |
| Statistics: Num rows: 250 Data size: 44500 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Anti Join 0 to 1 |
| keys: |
| 0 _col1 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 209 Data size: 37202 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 209 Data size: 37202 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 83 Data size: 14774 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 83 Data size: 7553 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.5060241 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 41 Data size: 3731 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 41 Data size: 3731 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * |
| from src b |
| group by key, value |
| having not exists |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.value > 'val_12' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * |
| from src b |
| group by key, value |
| having not exists |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.value > 'val_12' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 0 val_0 |
| 10 val_10 |
| 100 val_100 |
| 103 val_103 |
| 104 val_104 |
| 105 val_105 |
| 11 val_11 |
| 111 val_111 |
| 113 val_113 |
| 114 val_114 |
| 116 val_116 |
| 118 val_118 |
| 119 val_119 |
| 12 val_12 |