| PREHOOK: query: explain |
| select * |
| from src |
| where src.key in (select key from src s1 where s1.key > '9') |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select * |
| from src |
| where src.key in (select key from src s1 where s1.key > '9') |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: src |
| filterExpr: (key > '9') (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (key > '9') (type: boolean) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: s1 |
| filterExpr: (key > '9') (type: boolean) |
| Statistics: Num rows: 500 Data size: 43500 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (key > '9') (type: boolean) |
| Statistics: Num rows: 166 Data size: 14442 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 166 Data size: 14442 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 105 Data size: 9135 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 105 Data size: 9135 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * |
| from src |
| where src.key in (select key from src s1 where s1.key > '9') |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * |
| from src |
| where src.key in (select key from src s1 where s1.key > '9') |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 90 val_90 |
| 90 val_90 |
| 90 val_90 |
| 92 val_92 |
| 95 val_95 |
| 95 val_95 |
| 96 val_96 |
| 97 val_97 |
| 97 val_97 |
| 98 val_98 |
| 98 val_98 |
| PREHOOK: query: explain |
| select * |
| from src b |
| where b.key in |
| (select a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select * |
| from src b |
| where b.key in |
| (select a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| filterExpr: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: a |
| filterExpr: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string), _col1 (type: string) |
| 1 _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * |
| from src b |
| where b.key in |
| (select a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * |
| from src b |
| where b.key in |
| (select a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 90 val_90 |
| 90 val_90 |
| 90 val_90 |
| 92 val_92 |
| 95 val_95 |
| 95 val_95 |
| 96 val_96 |
| 97 val_97 |
| 97 val_97 |
| 98 val_98 |
| 98 val_98 |
| PREHOOK: query: explain |
| select p_name, p_size |
| from |
| part where part.p_size in |
| (select avg(p_size) |
| from (select p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select p_name, p_size |
| from |
| part where part.p_size in |
| (select avg(p_size) |
| from (select p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (CUSTOM_SIMPLE_EDGE) |
| Reducer 4 <- Map 1 (SIMPLE_EDGE), Reducer 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| Top N Key Operator |
| sort order: ++ |
| keys: p_mfgr (type: string), p_size (type: int) |
| null sort order: az |
| Map-reduce partition columns: p_mfgr (type: string) |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| top n: 3 |
| Reduce Output Operator |
| key expressions: p_mfgr (type: string), p_size (type: int) |
| null sort order: az |
| sort order: ++ |
| Map-reduce partition columns: p_mfgr (type: string) |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: UDFToDouble(p_size) is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: UDFToDouble(_col1) (type: double) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: UDFToDouble(_col1) (type: double) |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string), _col1 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Select Operator |
| expressions: KEY.reducesinkkey0 (type: string), KEY.reducesinkkey1 (type: int) |
| outputColumnNames: _col2, _col5 |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| PTF Operator |
| Function definitions: |
| Input definition |
| input alias: ptf_0 |
| output shape: _col2: string, _col5: int |
| type: WINDOWING |
| Windowing table definition |
| input alias: ptf_1 |
| name: windowingtablefunction |
| order by: _col5 ASC NULLS LAST |
| partition by: _col2 |
| raw input shape: |
| window functions: |
| window function definition |
| alias: rank_window_0 |
| arguments: _col5 |
| name: rank |
| window function: GenericUDAFRankEvaluator |
| window frame: ROWS PRECEDING(MAX)~FOLLOWING(MAX) |
| isPivotResult: true |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (rank_window_0 <= 2) (type: boolean) |
| Statistics: Num rows: 8 Data size: 816 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col5 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 8 Data size: 816 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: sum(_col0), count(_col0) |
| minReductionHashAggr: 0.875 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 1 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: bigint), _col1 (type: bigint) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: sum(VALUE._col0), count(VALUE._col1) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (_col1 is not null and UDFToDouble(_col0) is not null) (type: boolean) |
| Statistics: Num rows: 1 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: (UDFToDouble(_col0) / _col1) (type: double) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: double) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: double) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: double) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 4 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 UDFToDouble(_col1) (type: double) |
| 1 _col0 (type: double) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 125 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 1 Data size: 125 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_name, p_size |
| from |
| part where part.p_size in |
| (select avg(p_size) |
| from (select p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_name, p_size |
| from |
| part where part.p_size in |
| (select avg(p_size) |
| from (select p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| almond antique medium spring khaki 6 |
| almond antique salmon chartreuse burlywood 6 |
| PREHOOK: query: explain |
| select p_mfgr, p_name, p_size |
| from part b where b.p_size in |
| (select min(p_size) |
| from (select p_mfgr, p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 and b.p_mfgr = a.p_mfgr |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select p_mfgr, p_name, p_size |
| from part b where b.p_size in |
| (select min(p_size) |
| from (select p_mfgr, p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 and b.p_mfgr = a.p_mfgr |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 4 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| filterExpr: ((p_mfgr is not null and p_size is not null) or p_mfgr is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_mfgr is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_mfgr (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col2 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col2 (type: int) |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Filter Operator |
| predicate: p_mfgr is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| Top N Key Operator |
| sort order: ++ |
| keys: p_mfgr (type: string), p_size (type: int) |
| null sort order: az |
| Map-reduce partition columns: p_mfgr (type: string) |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| top n: 3 |
| Reduce Output Operator |
| key expressions: p_mfgr (type: string), p_size (type: int) |
| null sort order: az |
| sort order: ++ |
| Map-reduce partition columns: p_mfgr (type: string) |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col2 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 6 Data size: 1338 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: string), _col0 (type: string), _col2 (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 6 Data size: 1338 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 6 Data size: 1338 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Select Operator |
| expressions: KEY.reducesinkkey0 (type: string), KEY.reducesinkkey1 (type: int) |
| outputColumnNames: _col2, _col5 |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| PTF Operator |
| Function definitions: |
| Input definition |
| input alias: ptf_0 |
| output shape: _col2: string, _col5: int |
| type: WINDOWING |
| Windowing table definition |
| input alias: ptf_1 |
| name: windowingtablefunction |
| order by: _col5 ASC NULLS LAST |
| partition by: _col2 |
| raw input shape: |
| window functions: |
| window function definition |
| alias: rank_window_0 |
| arguments: _col5 |
| name: rank |
| window function: GenericUDAFRankEvaluator |
| window frame: ROWS PRECEDING(MAX)~FOLLOWING(MAX) |
| isPivotResult: true |
| Statistics: Num rows: 26 Data size: 2652 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (rank_window_0 <= 2) (type: boolean) |
| Statistics: Num rows: 8 Data size: 816 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col2 (type: string), _col5 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 8 Data size: 816 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(_col1) |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 5 Data size: 510 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 5 Data size: 510 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 5 Data size: 510 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 5 Data size: 510 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 5 Data size: 510 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 5 Data size: 510 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_mfgr, p_name, p_size |
| from part b where b.p_size in |
| (select min(p_size) |
| from (select p_mfgr, p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 and b.p_mfgr = a.p_mfgr |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_mfgr, p_name, p_size |
| from part b where b.p_size in |
| (select min(p_size) |
| from (select p_mfgr, p_size, rank() over(partition by p_mfgr order by p_size) as r from part) a |
| where r <= 2 and b.p_mfgr = a.p_mfgr |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| Manufacturer#1 almond antique burnished rose metallic 2 |
| Manufacturer#1 almond antique burnished rose metallic 2 |
| Manufacturer#2 almond aquamarine midnight light salmon 2 |
| Manufacturer#3 almond antique misty red olive 1 |
| Manufacturer#4 almond aquamarine yellow dodger mint 7 |
| Manufacturer#5 almond antique sky peru orange 2 |
| PREHOOK: query: explain |
| select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| filterExpr: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: a |
| filterExpr: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((key > '9') and value is not null) (type: boolean) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string), _col1 (type: string) |
| 1 _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value = a.value and a.key > '9' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 90 val_90 |
| 90 val_90 |
| 90 val_90 |
| 92 val_92 |
| 95 val_95 |
| 95 val_95 |
| 96 val_96 |
| 97 val_97 |
| 97 val_97 |
| 98 val_98 |
| 98 val_98 |
| PREHOOK: query: explain |
| select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value <> a.key and a.key > '9' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value <> a.key and a.key > '9' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 3 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| filterExpr: (key is not null or (key > '9')) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: key is not null (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string) |
| Filter Operator |
| predicate: (key > '9') (type: boolean) |
| Statistics: Num rows: 166 Data size: 14442 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: key (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 105 Data size: 9135 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 105 Data size: 9135 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1, _col3 |
| residual filter predicates: {(_col1 <> _col3)} |
| Statistics: Num rows: 166 Data size: 43990 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 105 Data size: 9135 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col0 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 105 Data size: 18270 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 105 Data size: 18270 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 105 Data size: 18270 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value <> a.key and a.key > '9' |
| ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * |
| from src b |
| where b.key in |
| (select distinct a.key |
| from src a |
| where b.value <> a.key and a.key > '9' |
| ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 90 val_90 |
| 90 val_90 |
| 90 val_90 |
| 92 val_92 |
| 95 val_95 |
| 95 val_95 |
| 96 val_96 |
| 97 val_97 |
| 97 val_97 |
| 98 val_98 |
| 98 val_98 |
| PREHOOK: query: explain select * from src b where b.key in (select distinct key from src a where a.value > b.value) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from src b where b.key in (select distinct key from src a where a.value > b.value) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 3 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| filterExpr: (key is not null and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (key is not null and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string) |
| Group By Operator |
| keys: key (type: string), value (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 56248 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 316 Data size: 56248 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1, _col3 |
| residual filter predicates: {(_col3 > _col1)} |
| Statistics: Num rows: 166 Data size: 44654 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 166 Data size: 29548 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 56248 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 56248 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 316 Data size: 56248 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from src b where b.key in (select distinct key from src a where a.value > b.value) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from src b where b.key in (select distinct key from src a where a.value > b.value) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| PREHOOK: query: select p_mfgr, p_name, p_size |
| from part |
| where part.p_size in |
| (select first_value(p_size) over(partition by p_mfgr order by p_size) from part) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_mfgr, p_name, p_size |
| from part |
| where part.p_size in |
| (select first_value(p_size) over(partition by p_mfgr order by p_size) from part) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| Manufacturer#1 almond antique burnished rose metallic 2 |
| Manufacturer#1 almond antique burnished rose metallic 2 |
| Manufacturer#2 almond aquamarine midnight light salmon 2 |
| Manufacturer#3 almond antique misty red olive 1 |
| Manufacturer#4 almond aquamarine yellow dodger mint 7 |
| Manufacturer#5 almond antique sky peru orange 2 |
| PREHOOK: query: explain |
| select p.p_partkey, li.l_suppkey |
| from (select distinct l_partkey as p_partkey from lineitem) p join lineitem li on p.p_partkey = li.l_partkey |
| where li.l_linenumber = 1 and |
| li.l_orderkey in (select l_orderkey from lineitem where l_shipmode = 'AIR') |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@lineitem |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain |
| select p.p_partkey, li.l_suppkey |
| from (select distinct l_partkey as p_partkey from lineitem) p join lineitem li on p.p_partkey = li.l_partkey |
| where li.l_linenumber = 1 and |
| li.l_orderkey in (select l_orderkey from lineitem where l_shipmode = 'AIR') |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@lineitem |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) |
| Reducer 3 <- Map 4 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: li |
| filterExpr: ((l_linenumber = 1) and l_partkey is not null and l_orderkey is not null) (type: boolean) |
| Statistics: Num rows: 100 Data size: 1600 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((l_linenumber = 1) and l_partkey is not null and l_orderkey is not null) (type: boolean) |
| Statistics: Num rows: 14 Data size: 224 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: l_orderkey (type: int), l_partkey (type: int), l_suppkey (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 14 Data size: 168 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: int) |
| Statistics: Num rows: 14 Data size: 168 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col2 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 4 |
| Map Operator Tree: |
| TableScan |
| alias: lineitem |
| filterExpr: (((l_shipmode = 'AIR') and l_orderkey is not null) or l_partkey is not null) (type: boolean) |
| Statistics: Num rows: 100 Data size: 9200 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((l_shipmode = 'AIR') and l_orderkey is not null) (type: boolean) |
| Statistics: Num rows: 14 Data size: 1288 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: l_orderkey (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 14 Data size: 56 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 14 Data size: 56 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 14 Data size: 56 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: l_partkey is not null (type: boolean) |
| Statistics: Num rows: 100 Data size: 400 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: l_partkey (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 100 Data size: 400 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 100 Data size: 400 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 100 Data size: 400 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 14 Data size: 168 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int), _col0 (type: int), _col2 (type: int) |
| outputColumnNames: _col0, _col1, _col3 |
| Statistics: Num rows: 14 Data size: 168 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: int) |
| Statistics: Num rows: 14 Data size: 168 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col3 (type: int) |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col3 |
| Statistics: Num rows: 14 Data size: 112 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: int), _col3 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 14 Data size: 112 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 14 Data size: 112 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p.p_partkey, li.l_suppkey |
| from (select distinct l_partkey as p_partkey from lineitem) p join lineitem li on p.p_partkey = li.l_partkey |
| where li.l_linenumber = 1 and |
| li.l_orderkey in (select l_orderkey from lineitem where l_shipmode = 'AIR') |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@lineitem |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p.p_partkey, li.l_suppkey |
| from (select distinct l_partkey as p_partkey from lineitem) p join lineitem li on p.p_partkey = li.l_partkey |
| where li.l_linenumber = 1 and |
| li.l_orderkey in (select l_orderkey from lineitem where l_shipmode = 'AIR') |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@lineitem |
| #### A masked pattern was here #### |
| 108570 8571 |
| 115118 7630 |
| 115209 7721 |
| 155190 7706 |
| 2320 9821 |
| 40216 217 |
| 4297 1798 |
| 61336 8855 |
| 64128 9141 |
| 82704 7721 |
| PREHOOK: query: select p.p_partkey, li.l_suppkey |
| from (select distinct l_partkey as p_partkey from lineitem) p join lineitem li on p.p_partkey = li.l_partkey |
| where li.l_linenumber = 1 and |
| li.l_orderkey in (select l_orderkey from lineitem where l_shipmode = 'AIR' and l_linenumber = li.l_linenumber) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@lineitem |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p.p_partkey, li.l_suppkey |
| from (select distinct l_partkey as p_partkey from lineitem) p join lineitem li on p.p_partkey = li.l_partkey |
| where li.l_linenumber = 1 and |
| li.l_orderkey in (select l_orderkey from lineitem where l_shipmode = 'AIR' and l_linenumber = li.l_linenumber) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@lineitem |
| #### A masked pattern was here #### |
| 108570 8571 |
| 4297 1798 |
| PREHOOK: query: explain select sum(l_extendedprice) from lineitem, part where p_partkey = l_partkey and l_quantity IN (select avg(l_quantity) from lineitem where l_partkey = p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@lineitem |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select sum(l_extendedprice) from lineitem, part where p_partkey = l_partkey and l_quantity IN (select avg(l_quantity) from lineitem where l_partkey = p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@lineitem |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 6 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE), Reducer 5 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (CUSTOM_SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: lineitem |
| filterExpr: ((l_partkey is not null and l_quantity is not null) or l_partkey is not null) (type: boolean) |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (l_partkey is not null and l_quantity is not null) (type: boolean) |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: l_partkey (type: int), l_quantity (type: double), l_extendedprice (type: double) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: double), _col2 (type: double) |
| Filter Operator |
| predicate: l_partkey is not null (type: boolean) |
| Statistics: Num rows: 100 Data size: 1200 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: sum(l_quantity), count(l_quantity) |
| keys: l_partkey (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: double), _col2 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 6 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: p_partkey is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: p_partkey is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col0 (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col1, _col2, _col3 |
| Statistics: Num rows: 26 Data size: 520 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: double), _col3 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: double), _col3 (type: int) |
| Statistics: Num rows: 26 Data size: 520 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col2 (type: double) |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: double), _col3 (type: int) |
| 1 _col0 (type: double), _col1 (type: int) |
| outputColumnNames: _col2 |
| Statistics: Num rows: 26 Data size: 208 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: sum(_col2) |
| minReductionHashAggr: 0.96153843 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: double) |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: sum(VALUE._col0) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: sum(VALUE._col0), count(VALUE._col1) |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (_col1 is not null and _col2 is not null) (type: boolean) |
| Statistics: Num rows: 100 Data size: 2000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: (_col1 / _col2) (type: double), _col0 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 100 Data size: 1200 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: double), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 100 Data size: 1200 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: double), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: double), _col1 (type: int) |
| Statistics: Num rows: 100 Data size: 1200 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select sum(l_extendedprice) from lineitem, part where p_partkey = l_partkey and l_quantity IN (select avg(l_quantity) from lineitem where l_partkey = p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@lineitem |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select sum(l_extendedprice) from lineitem, part where p_partkey = l_partkey and l_quantity IN (select avg(l_quantity) from lineitem where l_partkey = p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@lineitem |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| NULL |
| PREHOOK: query: explain select * from part where p_brand <> 'Brand#14' AND p_size IN (select (p_size) from part p where p.p_type = part.p_type group by p_size) AND p_size <> 340 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_brand <> 'Brand#14' AND p_size IN (select (p_size) from part p where p.p_type = part.p_type group by p_size) AND p_size <> 340 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 3 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (((p_size <> 340) and (p_brand <> 'Brand#14') and p_type is not null) or ((p_size <> 340) and p_type is not null)) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((p_size <> 340) and (p_brand <> 'Brand#14') and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col4 (type: string), _col5 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col4 (type: string), _col5 (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: ((p_size <> 340) and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: p_type (type: string), p_size (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col4 (type: string), _col5 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where p_brand <> 'Brand#14' AND p_size IN (select (p_size) from part p where p.p_type = part.p_type group by p_size) AND p_size <> 340 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_brand <> 'Brand#14' AND p_size IN (select (p_size) from part p where p.p_type = part.p_type group by p_size) AND p_size <> 340 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 almond antique violet chocolate turquoise Manufacturer#2 Brand#22 MEDIUM ANODIZED COPPER 14 MED CAN 1690.68 ly pending requ |
| 110592 almond antique salmon chartreuse burlywood Manufacturer#1 Brand#15 PROMO BURNISHED NICKEL 6 JUMBO PKG 1602.59 to the furiously |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 132666 almond aquamarine rose maroon antique Manufacturer#2 Brand#24 SMALL POLISHED NICKEL 25 MED BOX 1698.66 even |
| 144293 almond antique olive coral navajo Manufacturer#3 Brand#34 STANDARD POLISHED STEEL 45 JUMBO CAN 1337.29 ag furiously about |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17273 almond antique forest lavender goldenrod Manufacturer#3 Brand#35 PROMO ANODIZED TIN 14 JUMBO CASE 1190.27 along the |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 192697 almond antique blue firebrick mint Manufacturer#5 Brand#52 MEDIUM BURNISHED TIN 31 LG DRUM 1789.69 ickly ir |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 33357 almond azure aquamarine papaya violet Manufacturer#4 Brand#41 STANDARD ANODIZED TIN 12 WRAP CASE 1290.35 reful |
| 40982 almond antique misty red olive Manufacturer#3 Brand#32 ECONOMY PLATED COPPER 1 LG PKG 1922.98 c foxes can s |
| 42669 almond antique medium spring khaki Manufacturer#5 Brand#51 STANDARD BURNISHED TIN 6 MED CAN 1611.66 sits haggl |
| 45261 almond aquamarine floral ivory bisque Manufacturer#4 Brand#42 SMALL PLATED STEEL 27 WRAP CASE 1206.26 careful |
| 48427 almond antique violet mint lemon Manufacturer#4 Brand#42 PROMO POLISHED STEEL 39 SM CASE 1375.42 hely ironic i |
| 49671 almond antique gainsboro frosted violet Manufacturer#4 Brand#41 SMALL BRUSHED BRASS 10 SM BOX 1620.67 ccounts run quick |
| 65667 almond aquamarine pink moccasin thistle Manufacturer#1 Brand#12 LARGE BURNISHED STEEL 42 JUMBO CASE 1632.66 e across the expr |
| 78486 almond azure blanched chiffon midnight Manufacturer#5 Brand#52 LARGE BRUSHED BRASS 23 MED BAG 1464.48 hely blith |
| 85768 almond antique chartreuse lavender yellow Manufacturer#1 Brand#12 LARGE BRUSHED STEEL 34 SM BAG 1753.76 refull |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| 90681 almond antique chartreuse khaki white Manufacturer#3 Brand#31 MEDIUM BURNISHED TIN 17 SM CASE 1671.68 are slyly after the sl |
| PREHOOK: query: explain select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: p_type, p_size |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(p_size) |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Filter Operator |
| predicate: p_size is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: (_col5 - 1) (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: (_col5 - 1) (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col1 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 (_col5 - 1) (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| PREHOOK: query: explain select * from part where (p_partkey*p_size) IN (select min(p_partkey) from part group by p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where (p_partkey*p_size) IN (select min(p_partkey) from part group by p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_type (type: string) |
| outputColumnNames: p_partkey, p_type |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(p_partkey) |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Filter Operator |
| predicate: (p_partkey is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: (_col0 * _col5) (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: (_col0 * _col5) (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col1 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 (_col0 * _col5) (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 24 Data size: 14856 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 24 Data size: 14856 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where (p_partkey*p_size) IN (select min(p_partkey) from part group by p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where (p_partkey*p_size) IN (select min(p_partkey) from part group by p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 40982 almond antique misty red olive Manufacturer#3 Brand#32 ECONOMY PLATED COPPER 1 LG PKG 1922.98 c foxes can s |
| PREHOOK: query: explain select count(*) as c from part as e where p_size + 100 IN (select p_partkey from part where p_name = e.p_name) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select count(*) as c from part as e where p_size + 100 IN (select p_partkey from part where p_name = e.p_name) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (CUSTOM_SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: e |
| filterExpr: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), (p_size + 100) (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 4 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (p_name is not null and p_partkey is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_name is not null and p_partkey is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_partkey (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 3250 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string), _col1 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 26 Data size: 208 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| minReductionHashAggr: 0.96153843 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: bigint) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select count(*) as c from part as e where p_size + 100 IN (select p_partkey from part where p_name = e.p_name) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select count(*) as c from part as e where p_size + 100 IN (select p_partkey from part where p_name = e.p_name) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 0 |
| PREHOOK: query: explain select * from part where floor(p_retailprice) IN (select floor(min(p_retailprice)) from part group by p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where floor(p_retailprice) IN (select floor(min(p_retailprice)) from part group by p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 2912 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_retailprice (type: double) |
| outputColumnNames: p_type, p_retailprice |
| Statistics: Num rows: 26 Data size: 2912 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(p_retailprice) |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: double) |
| Filter Operator |
| predicate: p_retailprice is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: floor(_col7) (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: floor(_col7) (type: bigint) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: double) |
| outputColumnNames: _col1 |
| Statistics: Num rows: 24 Data size: 192 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 24 Data size: 192 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: floor(_col1) (type: bigint) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 192 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: bigint) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 192 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: bigint) |
| Statistics: Num rows: 24 Data size: 192 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 floor(_col7) (type: bigint) |
| 1 _col0 (type: bigint) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 24 Data size: 14856 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 24 Data size: 14856 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where floor(p_retailprice) IN (select floor(min(p_retailprice)) from part group by p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where floor(p_retailprice) IN (select floor(min(p_retailprice)) from part group by p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 almond antique violet chocolate turquoise Manufacturer#2 Brand#22 MEDIUM ANODIZED COPPER 14 MED CAN 1690.68 ly pending requ |
| 110592 almond antique salmon chartreuse burlywood Manufacturer#1 Brand#15 PROMO BURNISHED NICKEL 6 JUMBO PKG 1602.59 to the furiously |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 132666 almond aquamarine rose maroon antique Manufacturer#2 Brand#24 SMALL POLISHED NICKEL 25 MED BOX 1698.66 even |
| 144293 almond antique olive coral navajo Manufacturer#3 Brand#34 STANDARD POLISHED STEEL 45 JUMBO CAN 1337.29 ag furiously about |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17273 almond antique forest lavender goldenrod Manufacturer#3 Brand#35 PROMO ANODIZED TIN 14 JUMBO CASE 1190.27 along the |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 33357 almond azure aquamarine papaya violet Manufacturer#4 Brand#41 STANDARD ANODIZED TIN 12 WRAP CASE 1290.35 reful |
| 40982 almond antique misty red olive Manufacturer#3 Brand#32 ECONOMY PLATED COPPER 1 LG PKG 1922.98 c foxes can s |
| 42669 almond antique medium spring khaki Manufacturer#5 Brand#51 STANDARD BURNISHED TIN 6 MED CAN 1611.66 sits haggl |
| 45261 almond aquamarine floral ivory bisque Manufacturer#4 Brand#42 SMALL PLATED STEEL 27 WRAP CASE 1206.26 careful |
| 48427 almond antique violet mint lemon Manufacturer#4 Brand#42 PROMO POLISHED STEEL 39 SM CASE 1375.42 hely ironic i |
| 49671 almond antique gainsboro frosted violet Manufacturer#4 Brand#41 SMALL BRUSHED BRASS 10 SM BOX 1620.67 ccounts run quick |
| 65667 almond aquamarine pink moccasin thistle Manufacturer#1 Brand#12 LARGE BURNISHED STEEL 42 JUMBO CASE 1632.66 e across the expr |
| 78486 almond azure blanched chiffon midnight Manufacturer#5 Brand#52 LARGE BRUSHED BRASS 23 MED BAG 1464.48 hely blith |
| 85768 almond antique chartreuse lavender yellow Manufacturer#1 Brand#12 LARGE BRUSHED STEEL 34 SM BAG 1753.76 refull |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| 90681 almond antique chartreuse khaki white Manufacturer#3 Brand#31 MEDIUM BURNISHED TIN 17 SM CASE 1671.68 are slyly after the sl |
| PREHOOK: query: explain select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_size + 121150 = p.p_partkey ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_size + 121150 = p.p_partkey ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string), (p_size + 121150) (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col9 |
| Statistics: Num rows: 26 Data size: 16198 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col5 (type: int), _col9 (type: int) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col1 (type: string), _col5 (type: int), _col9 (type: int) |
| Statistics: Num rows: 26 Data size: 16198 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: p |
| filterExpr: (p_size is not null and p_partkey is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_partkey is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_size (type: int), p_partkey (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int), _col2 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 3225 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: int) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: int) |
| Statistics: Num rows: 25 Data size: 3225 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col5 (type: int), _col9 (type: int) |
| 1 _col0 (type: string), _col1 (type: int), _col2 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_size + 121150 = p.p_partkey ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_size + 121150 = p.p_partkey ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| PREHOOK: query: explain select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_partkey= p.p_partkey ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_partkey= p.p_partkey ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (p_partkey is not null and p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_partkey is not null and p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), _col1 (type: string), _col5 (type: int) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: int), _col1 (type: string), _col5 (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col2 (type: string), _col3 (type: string), _col4 (type: string), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: p |
| filterExpr: (p_size is not null and p_partkey is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_partkey is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int), _col1 (type: string), _col2 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 3225 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), _col1 (type: string), _col2 (type: int) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: int), _col1 (type: string), _col2 (type: int) |
| Statistics: Num rows: 25 Data size: 3225 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: int), _col1 (type: string), _col5 (type: int) |
| 1 _col0 (type: int), _col1 (type: string), _col2 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_partkey= p.p_partkey ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_name IN (select p_name from part p where p.p_size = part.p_size AND part.p_partkey= p.p_partkey ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 almond antique violet chocolate turquoise Manufacturer#2 Brand#22 MEDIUM ANODIZED COPPER 14 MED CAN 1690.68 ly pending requ |
| 110592 almond antique salmon chartreuse burlywood Manufacturer#1 Brand#15 PROMO BURNISHED NICKEL 6 JUMBO PKG 1602.59 to the furiously |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 132666 almond aquamarine rose maroon antique Manufacturer#2 Brand#24 SMALL POLISHED NICKEL 25 MED BOX 1698.66 even |
| 144293 almond antique olive coral navajo Manufacturer#3 Brand#34 STANDARD POLISHED STEEL 45 JUMBO CAN 1337.29 ag furiously about |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17273 almond antique forest lavender goldenrod Manufacturer#3 Brand#35 PROMO ANODIZED TIN 14 JUMBO CASE 1190.27 along the |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 192697 almond antique blue firebrick mint Manufacturer#5 Brand#52 MEDIUM BURNISHED TIN 31 LG DRUM 1789.69 ickly ir |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 33357 almond azure aquamarine papaya violet Manufacturer#4 Brand#41 STANDARD ANODIZED TIN 12 WRAP CASE 1290.35 reful |
| 40982 almond antique misty red olive Manufacturer#3 Brand#32 ECONOMY PLATED COPPER 1 LG PKG 1922.98 c foxes can s |
| 42669 almond antique medium spring khaki Manufacturer#5 Brand#51 STANDARD BURNISHED TIN 6 MED CAN 1611.66 sits haggl |
| 45261 almond aquamarine floral ivory bisque Manufacturer#4 Brand#42 SMALL PLATED STEEL 27 WRAP CASE 1206.26 careful |
| 48427 almond antique violet mint lemon Manufacturer#4 Brand#42 PROMO POLISHED STEEL 39 SM CASE 1375.42 hely ironic i |
| 49671 almond antique gainsboro frosted violet Manufacturer#4 Brand#41 SMALL BRUSHED BRASS 10 SM BOX 1620.67 ccounts run quick |
| 65667 almond aquamarine pink moccasin thistle Manufacturer#1 Brand#12 LARGE BURNISHED STEEL 42 JUMBO CASE 1632.66 e across the expr |
| 78486 almond azure blanched chiffon midnight Manufacturer#5 Brand#52 LARGE BRUSHED BRASS 23 MED BAG 1464.48 hely blith |
| 85768 almond antique chartreuse lavender yellow Manufacturer#1 Brand#12 LARGE BRUSHED STEEL 34 SM BAG 1753.76 refull |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| 90681 almond antique chartreuse khaki white Manufacturer#3 Brand#31 MEDIUM BURNISHED TIN 17 SM CASE 1671.68 are slyly after the sl |
| PREHOOK: query: explain select p_name from (select p_name, p_type, p_brand as brand from part) fpart where fpart.p_type IN (select p_type from part where part.p_brand = fpart.brand) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select p_name from (select p_name, p_type, p_brand as brand from part) fpart where fpart.p_type IN (select p_type from part where part.p_brand = fpart.brand) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (p_type is not null and p_brand is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 8242 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_type is not null and p_brand is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 8242 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_type (type: string), p_brand (type: string) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 8242 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col2 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col2 (type: string) |
| Statistics: Num rows: 26 Data size: 8242 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (p_brand is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5096 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_brand is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5096 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_brand (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 5096 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 4704 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 24 Data size: 4704 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col2 (type: string) |
| 1 _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_name from (select p_name, p_type, p_brand as brand from part) fpart where fpart.p_type IN (select p_type from part where part.p_brand = fpart.brand) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_name from (select p_name, p_type, p_brand as brand from part) fpart where fpart.p_type IN (select p_type from part where part.p_brand = fpart.brand) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| almond antique blue firebrick mint |
| almond antique burnished rose metallic |
| almond antique burnished rose metallic |
| almond antique chartreuse khaki white |
| almond antique chartreuse lavender yellow |
| almond antique forest lavender goldenrod |
| almond antique gainsboro frosted violet |
| almond antique medium spring khaki |
| almond antique metallic orange dim |
| almond antique misty red olive |
| almond antique olive coral navajo |
| almond antique salmon chartreuse burlywood |
| almond antique sky peru orange |
| almond antique violet chocolate turquoise |
| almond antique violet mint lemon |
| almond antique violet turquoise frosted |
| almond aquamarine burnished black steel |
| almond aquamarine dodger light gainsboro |
| almond aquamarine floral ivory bisque |
| almond aquamarine midnight light salmon |
| almond aquamarine pink moccasin thistle |
| almond aquamarine rose maroon antique |
| almond aquamarine sandy cyan gainsboro |
| almond aquamarine yellow dodger mint |
| almond azure aquamarine papaya violet |
| almond azure blanched chiffon midnight |
| PREHOOK: query: explain select p_name from (select p_name, p_type, p_size+1 as size from part) fpart where fpart.p_type IN (select p_type from part where (part.p_size+1) = fpart.size) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select p_name from (select p_name, p_type, p_size+1 as size from part) fpart where fpart.p_type IN (select p_type from part where (part.p_size+1) = fpart.size) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (p_type is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5954 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_type is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5954 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_type (type: string), (p_size + 1) (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 5954 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col2 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col2 (type: int) |
| Statistics: Num rows: 26 Data size: 5954 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), (p_size + 1) (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col2 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_name from (select p_name, p_type, p_size+1 as size from part) fpart where fpart.p_type IN (select p_type from part where (part.p_size+1) = fpart.size) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_name from (select p_name, p_type, p_size+1 as size from part) fpart where fpart.p_type IN (select p_type from part where (part.p_size+1) = fpart.size) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| almond antique blue firebrick mint |
| almond antique burnished rose metallic |
| almond antique burnished rose metallic |
| almond antique chartreuse khaki white |
| almond antique chartreuse lavender yellow |
| almond antique forest lavender goldenrod |
| almond antique gainsboro frosted violet |
| almond antique medium spring khaki |
| almond antique metallic orange dim |
| almond antique misty red olive |
| almond antique olive coral navajo |
| almond antique salmon chartreuse burlywood |
| almond antique sky peru orange |
| almond antique violet chocolate turquoise |
| almond antique violet mint lemon |
| almond antique violet turquoise frosted |
| almond aquamarine burnished black steel |
| almond aquamarine dodger light gainsboro |
| almond aquamarine floral ivory bisque |
| almond aquamarine midnight light salmon |
| almond aquamarine pink moccasin thistle |
| almond aquamarine rose maroon antique |
| almond aquamarine sandy cyan gainsboro |
| almond aquamarine yellow dodger mint |
| almond azure aquamarine papaya violet |
| almond azure blanched chiffon midnight |
| PREHOOK: query: explain select key, count(*) from src where value IN (select value from src) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select key, count(*) from src where value IN (select value from src) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 6 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE), Reducer 5 (SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: src |
| filterExpr: (value is not null or (key = '90')) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: value is not null (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: string) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Filter Operator |
| predicate: (key = '90') (type: boolean) |
| Statistics: Num rows: 2 Data size: 174 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| Statistics: Num rows: 2 Data size: 174 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: true (type: boolean) |
| minReductionHashAggr: 0.5 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: boolean) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: boolean) |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 6 |
| Map Operator Tree: |
| TableScan |
| alias: src |
| filterExpr: value is not null (type: boolean) |
| Statistics: Num rows: 500 Data size: 45500 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: value is not null (type: boolean) |
| Statistics: Num rows: 500 Data size: 45500 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: value (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 500 Data size: 45500 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 307 Data size: 27937 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 307 Data size: 27937 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 500 Data size: 43500 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: bigint) |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Reducer 4 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: bigint) |
| 1 _col0 (type: bigint) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 95 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 1 Data size: 95 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: boolean) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: bigint) |
| outputColumnNames: _col1 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: bigint) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: bigint) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: bigint) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select key, count(*) from src where value IN (select value from src) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select key, count(*) from src where value IN (select value from src) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 0 3 |
| 119 3 |
| 128 3 |
| 167 3 |
| 187 3 |
| 193 3 |
| 199 3 |
| 208 3 |
| 273 3 |
| 298 3 |
| 311 3 |
| 316 3 |
| 318 3 |
| 327 3 |
| 35 3 |
| 369 3 |
| 384 3 |
| 396 3 |
| 403 3 |
| 409 3 |
| 417 3 |
| 430 3 |
| 431 3 |
| 438 3 |
| 454 3 |
| 466 3 |
| 480 3 |
| 498 3 |
| 5 3 |
| 70 3 |
| 90 3 |
| PREHOOK: query: explain select key, count(*) from src where value IN (select value from src sc where sc.key = src.key ) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select key, count(*) from src where value IN (select value from src sc where sc.key = src.key ) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 6 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE), Reducer 5 (SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: src |
| filterExpr: ((key is not null and value is not null) or (key = '90')) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (key is not null and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (key = '90') (type: boolean) |
| Statistics: Num rows: 2 Data size: 174 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| Statistics: Num rows: 2 Data size: 174 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: true (type: boolean) |
| minReductionHashAggr: 0.5 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: boolean) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: boolean) |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 6 |
| Map Operator Tree: |
| TableScan |
| alias: sc |
| filterExpr: (key is not null and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (key is not null and value is not null) (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 56248 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 316 Data size: 56248 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string), _col1 (type: string) |
| 1 _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 500 Data size: 43500 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: bigint) |
| Statistics: Num rows: 316 Data size: 30020 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Reducer 4 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: bigint) |
| 1 _col0 (type: bigint) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 95 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 1 Data size: 95 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: boolean) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: bigint) |
| outputColumnNames: _col1 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: bigint) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: bigint) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: bigint) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select key, count(*) from src where value IN (select value from src sc where sc.key = src.key ) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select key, count(*) from src where value IN (select value from src sc where sc.key = src.key ) group by key having count(*) in (select count(*) from src s1 where s1.key = '90' group by s1.key ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| 0 3 |
| 119 3 |
| 128 3 |
| 167 3 |
| 187 3 |
| 193 3 |
| 199 3 |
| 208 3 |
| 273 3 |
| 298 3 |
| 311 3 |
| 316 3 |
| 318 3 |
| 327 3 |
| 35 3 |
| 369 3 |
| 384 3 |
| 396 3 |
| 403 3 |
| 409 3 |
| 417 3 |
| 430 3 |
| 431 3 |
| 438 3 |
| 454 3 |
| 466 3 |
| 480 3 |
| 498 3 |
| 5 3 |
| 70 3 |
| 90 3 |
| PREHOOK: query: explain select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: p_type, p_size |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(p_size) |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Filter Operator |
| predicate: p_size is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: (_col5 - 1) (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: (_col5 - 1) (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col1 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 (_col5 - 1) (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col3 (type: string) |
| null sort order: z |
| sort order: + |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Select Operator |
| expressions: VALUE._col0 (type: int), VALUE._col1 (type: string), VALUE._col2 (type: string), KEY.reducesinkkey0 (type: string), VALUE._col3 (type: string), VALUE._col4 (type: int), VALUE._col5 (type: string), VALUE._col6 (type: double), VALUE._col7 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| PREHOOK: query: explain select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand limit 4 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand limit 4 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: p_type, p_size |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(p_size) |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Filter Operator |
| predicate: p_size is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: (_col5 - 1) (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: (_col5 - 1) (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col1 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 24 Data size: 96 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 (_col5 - 1) (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Top N Key Operator |
| sort order: + |
| keys: _col3 (type: string) |
| null sort order: z |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| top n: 4 |
| Reduce Output Operator |
| key expressions: _col3 (type: string) |
| null sort order: z |
| sort order: + |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Select Operator |
| expressions: VALUE._col0 (type: int), VALUE._col1 (type: string), VALUE._col2 (type: string), KEY.reducesinkkey0 (type: string), VALUE._col3 (type: string), VALUE._col4 (type: int), VALUE._col5 (type: string), VALUE._col6 (type: double), VALUE._col7 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Limit |
| Number of rows: 4 |
| Statistics: Num rows: 4 Data size: 2476 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 4 Data size: 2476 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: 4 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand limit 4 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where (p_size-1) IN (select min(p_size) from part group by p_type) order by p_brand limit 4 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| PREHOOK: query: explain select * from src where key IN (select p_name from part UNION ALL select p_brand from part) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from src where key IN (select p_name from part UNION ALL select p_brand from part) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Map 3 <- Union 4 (CONTAINS) |
| Map 5 <- Union 4 (CONTAINS) |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Union 4 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: src |
| filterExpr: key is not null (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: key is not null (type: boolean) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: key (type: string), value (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 500 Data size: 89000 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: p_name is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: p_name is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.5192308 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 5 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: p_brand is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 2392 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: p_brand is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 2392 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_brand (type: string) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 2392 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string) |
| minReductionHashAggr: 0.5192308 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 39 Data size: 6942 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 39 Data size: 6942 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Union 4 |
| Vertex: Union 4 |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from src where key IN (select p_name from part UNION ALL select p_brand from part) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| PREHOOK: Input: default@src |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from src where key IN (select p_name from part UNION ALL select p_brand from part) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| POSTHOOK: Input: default@src |
| #### A masked pattern was here #### |
| PREHOOK: query: explain select p_mfgr, b.p_name, p_size from part b where b.p_name in |
| (select p_name from (select p_mfgr, p_name, p_size as r from part) a where r < 10 and b.p_mfgr = a.p_mfgr ) order by p_mfgr,p_size |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select p_mfgr, b.p_name, p_size from part b where b.p_name in |
| (select p_name from (select p_mfgr, p_name, p_size as r from part) a where r < 10 and b.p_mfgr = a.p_mfgr ) order by p_mfgr,p_size |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: b |
| filterExpr: (p_name is not null and p_mfgr is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_name is not null and p_mfgr is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_mfgr (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col0 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col0 (type: string) |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col2 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 4 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: ((p_size < 10) and p_mfgr is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5798 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: ((p_size < 10) and p_mfgr is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 5 Data size: 1115 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_mfgr (type: string), p_name (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 5 Data size: 1095 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 5 Data size: 1095 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string) |
| Statistics: Num rows: 5 Data size: 1095 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col0 (type: string) |
| 1 _col0 (type: string), _col1 (type: string) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 5 Data size: 1115 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col1 (type: string), _col2 (type: int) |
| outputColumnNames: _col1, _col3, _col4 |
| Statistics: Num rows: 5 Data size: 1115 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col3 (type: string), _col4 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Statistics: Num rows: 5 Data size: 1115 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Select Operator |
| expressions: KEY.reducesinkkey0 (type: string), VALUE._col0 (type: string), KEY.reducesinkkey1 (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 5 Data size: 1115 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 5 Data size: 1115 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_mfgr, b.p_name, p_size from part b where b.p_name in |
| (select p_name from (select p_mfgr, p_name, p_size as r from part) a where r < 10 and b.p_mfgr = a.p_mfgr ) order by p_mfgr,p_size |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_mfgr, b.p_name, p_size from part b where b.p_name in |
| (select p_name from (select p_mfgr, p_name, p_size as r from part) a where r < 10 and b.p_mfgr = a.p_mfgr ) order by p_mfgr,p_size |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| Manufacturer#1 almond antique burnished rose metallic 2 |
| Manufacturer#1 almond antique burnished rose metallic 2 |
| Manufacturer#1 almond antique salmon chartreuse burlywood 6 |
| Manufacturer#2 almond aquamarine midnight light salmon 2 |
| Manufacturer#3 almond antique misty red olive 1 |
| Manufacturer#4 almond aquamarine yellow dodger mint 7 |
| Manufacturer#5 almond antique medium spring khaki 6 |
| Manufacturer#5 almond antique sky peru orange 2 |
| PREHOOK: query: explain select p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: p |
| filterExpr: ((p_type is not null and p_name is not null) or (p_name is not null and p_size is not null)) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_type is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_type (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: string) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Filter Operator |
| predicate: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col2 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col2 (type: int) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 4 |
| Map Operator Tree: |
| TableScan |
| alias: pp |
| filterExpr: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col1 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col3 |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col3 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col2 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 |
| 110592 |
| 112398 |
| 121152 |
| 121152 |
| 132666 |
| 144293 |
| 146985 |
| 15103 |
| 155733 |
| 17273 |
| 17927 |
| 191709 |
| 192697 |
| 195606 |
| 33357 |
| 40982 |
| 42669 |
| 45261 |
| 48427 |
| 49671 |
| 65667 |
| 78486 |
| 85768 |
| 86428 |
| 90681 |
| PREHOOK: query: explain select p_partkey from part where p_name in |
| (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size and p.p_size=part.p_size) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select p_partkey from part where p_name in |
| (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size and p.p_size=part.p_size) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: p |
| filterExpr: ((p_size is not null and p_type is not null and p_name is not null) or (p_name is not null and p_size is not null)) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5954 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_type is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5954 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_type (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: string) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Filter Operator |
| predicate: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col2 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col2 (type: int) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 4 |
| Map Operator Tree: |
| TableScan |
| alias: pp |
| filterExpr: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col1 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col3 |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col3 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col2 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_partkey from part where p_name in |
| (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size and p.p_size=part.p_size) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_partkey from part where p_name in |
| (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size and p.p_size=part.p_size) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 |
| 110592 |
| 112398 |
| 121152 |
| 121152 |
| 132666 |
| 144293 |
| 146985 |
| 15103 |
| 155733 |
| 17273 |
| 17927 |
| 191709 |
| 192697 |
| 195606 |
| 33357 |
| 40982 |
| 42669 |
| 45261 |
| 48427 |
| 49671 |
| 65667 |
| 78486 |
| 85768 |
| 86428 |
| 90681 |
| PREHOOK: query: explain select p_partkey from part where p_name in |
| (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size and p.p_type=part.p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select p_partkey from part where p_name in |
| (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size and p.p_type=part.p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 3 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: ((p_name is not null and p_type is not null and p_size is not null) or (p_type is not null and p_name is not null)) (type: boolean) |
| Statistics: Num rows: 26 Data size: 6058 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_name is not null and p_type is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 6058 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_type (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3 |
| Statistics: Num rows: 26 Data size: 6058 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col2 (type: string), _col3 (type: int) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col1 (type: string), _col2 (type: string), _col3 (type: int) |
| Statistics: Num rows: 26 Data size: 6058 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| Filter Operator |
| predicate: (p_type is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_type (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: string) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 4 |
| Map Operator Tree: |
| TableScan |
| alias: pp |
| filterExpr: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col2 (type: string), _col3 (type: int) |
| 1 _col0 (type: string), _col1 (type: string), _col2 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col1 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1, _col3 |
| Statistics: Num rows: 28 Data size: 6412 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col1 (type: string), _col3 (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 28 Data size: 6412 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: string), _col2 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 5725 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: string), _col2 (type: int) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: string), _col2 (type: int) |
| Statistics: Num rows: 25 Data size: 5725 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select p_partkey from |
| (select p_size, p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size)) subq |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select p_partkey from |
| (select p_size, p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size)) subq |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: p |
| filterExpr: ((p_type is not null and p_name is not null) or (p_name is not null and p_size is not null)) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_type is not null and p_name is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_type (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: string) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Filter Operator |
| predicate: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col2 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col2 (type: int) |
| Statistics: Num rows: 26 Data size: 3354 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 4 |
| Map Operator Tree: |
| TableScan |
| alias: pp |
| filterExpr: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_size is not null and p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col1 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col3 |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: string), _col3 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col2 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 104 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select p_partkey from |
| (select p_size, p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size)) subq |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select p_partkey from |
| (select p_size, p_partkey from part where p_name in (select p.p_name from part p left outer join part pp on p.p_type = pp.p_type where pp.p_size = part.p_size)) subq |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 |
| 110592 |
| 112398 |
| 121152 |
| 121152 |
| 132666 |
| 144293 |
| 146985 |
| 15103 |
| 155733 |
| 17273 |
| 17927 |
| 191709 |
| 192697 |
| 195606 |
| 33357 |
| 40982 |
| 42669 |
| 45261 |
| 48427 |
| 49671 |
| 65667 |
| 78486 |
| 85768 |
| 86428 |
| 90681 |
| PREHOOK: query: explain select * from part where p_size IN (select count(*) from part pp where pp.p_type = part.p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_size IN (select count(*) from part pp where pp.p_type = part.p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 4 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE), Reducer 5 (SIMPLE_EDGE) |
| Reducer 4 <- Map 1 (SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: ((p_type is not null and UDFToLong(p_size) is not null) or p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_type is not null and UDFToLong(p_size) is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col4 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col4 (type: string) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: p_type is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 2704 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Outer Join 0 to 1 |
| keys: |
| 0 _col4 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col10 |
| Statistics: Num rows: 26 Data size: 16302 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: CASE WHEN (_col10 is null) THEN (sq_count_check(0L, true)) ELSE (sq_count_check(_col10, true)) END (type: boolean) |
| Statistics: Num rows: 13 Data size: 8151 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col4 (type: string), UDFToLong(_col5) (type: bigint) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col4 (type: string), UDFToLong(_col5) (type: bigint) |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col4 (type: string), UDFToLong(_col5) (type: bigint) |
| 1 _col0 (type: string), _col1 (type: bigint) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: _col0 (type: string) |
| mode: complete |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: bigint) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: bigint) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where p_size IN (select count(*) from part pp where pp.p_type = part.p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size IN (select count(*) from part pp where pp.p_type = part.p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 40982 almond antique misty red olive Manufacturer#3 Brand#32 ECONOMY PLATED COPPER 1 LG PKG 1922.98 c foxes can s |
| PREHOOK: query: explain select * from part where p_size in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_size in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 3 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: ((p_partkey is not null and UDFToDouble(p_size) is not null) or p_partkey is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_partkey is not null and UDFToDouble(p_size) is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), UDFToDouble(_col5) (type: double) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: int), UDFToDouble(_col5) (type: double) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: p_partkey is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 208 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: sum(p_size), count(p_size) |
| keys: p_partkey (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint), _col2 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: int), UDFToDouble(_col5) (type: double) |
| 1 _col0 (type: int), _col1 (type: double) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: sum(VALUE._col0), count(VALUE._col1) |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (_col2 is not null and UDFToDouble(_col1) is not null) (type: boolean) |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: int), (UDFToDouble(_col1) / _col2) (type: double) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 300 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int), _col1 (type: double) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 300 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), _col1 (type: double) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: int), _col1 (type: double) |
| Statistics: Num rows: 25 Data size: 300 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where p_size in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 almond antique violet chocolate turquoise Manufacturer#2 Brand#22 MEDIUM ANODIZED COPPER 14 MED CAN 1690.68 ly pending requ |
| 110592 almond antique salmon chartreuse burlywood Manufacturer#1 Brand#15 PROMO BURNISHED NICKEL 6 JUMBO PKG 1602.59 to the furiously |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 132666 almond aquamarine rose maroon antique Manufacturer#2 Brand#24 SMALL POLISHED NICKEL 25 MED BOX 1698.66 even |
| 144293 almond antique olive coral navajo Manufacturer#3 Brand#34 STANDARD POLISHED STEEL 45 JUMBO CAN 1337.29 ag furiously about |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17273 almond antique forest lavender goldenrod Manufacturer#3 Brand#35 PROMO ANODIZED TIN 14 JUMBO CASE 1190.27 along the |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 192697 almond antique blue firebrick mint Manufacturer#5 Brand#52 MEDIUM BURNISHED TIN 31 LG DRUM 1789.69 ickly ir |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 33357 almond azure aquamarine papaya violet Manufacturer#4 Brand#41 STANDARD ANODIZED TIN 12 WRAP CASE 1290.35 reful |
| 40982 almond antique misty red olive Manufacturer#3 Brand#32 ECONOMY PLATED COPPER 1 LG PKG 1922.98 c foxes can s |
| 42669 almond antique medium spring khaki Manufacturer#5 Brand#51 STANDARD BURNISHED TIN 6 MED CAN 1611.66 sits haggl |
| 45261 almond aquamarine floral ivory bisque Manufacturer#4 Brand#42 SMALL PLATED STEEL 27 WRAP CASE 1206.26 careful |
| 48427 almond antique violet mint lemon Manufacturer#4 Brand#42 PROMO POLISHED STEEL 39 SM CASE 1375.42 hely ironic i |
| 49671 almond antique gainsboro frosted violet Manufacturer#4 Brand#41 SMALL BRUSHED BRASS 10 SM BOX 1620.67 ccounts run quick |
| 65667 almond aquamarine pink moccasin thistle Manufacturer#1 Brand#12 LARGE BURNISHED STEEL 42 JUMBO CASE 1632.66 e across the expr |
| 78486 almond azure blanched chiffon midnight Manufacturer#5 Brand#52 LARGE BRUSHED BRASS 23 MED BAG 1464.48 hely blith |
| 85768 almond antique chartreuse lavender yellow Manufacturer#1 Brand#12 LARGE BRUSHED STEEL 34 SM BAG 1753.76 refull |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| 90681 almond antique chartreuse khaki white Manufacturer#3 Brand#31 MEDIUM BURNISHED TIN 17 SM CASE 1671.68 are slyly after the sl |
| Warning: Shuffle Join MERGEJOIN[58][tables = [$hdt$_1, $hdt$_2]] in Stage 'Reducer 3' is a cross product |
| PREHOOK: query: explain select * from part where p_size in (select min(pp.p_size) from part pp where pp.p_partkey > part.p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_size in (select min(pp.p_size) from part pp where pp.p_partkey > part.p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 4 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (XPROD_EDGE), Reducer 5 (XPROD_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: ((p_partkey is not null and p_size is not null) or p_partkey is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_partkey is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), _col5 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: int), _col5 (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: p_partkey is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 208 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 208 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 26 Data size: 208 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: int) |
| Group By Operator |
| keys: p_partkey (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 100 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 25 Data size: 100 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col0 (type: int), _col5 (type: int) |
| 1 _col0 (type: int), _col1 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 |
| 1 |
| outputColumnNames: _col0, _col1, _col2 |
| residual filter predicates: {(_col0 > _col2)} |
| Statistics: Num rows: 216 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int), _col2 (type: int) |
| outputColumnNames: _col1, _col2 |
| Statistics: Num rows: 216 Data size: 2592 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(_col1) |
| keys: _col2 (type: int) |
| minReductionHashAggr: 0.8842593 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 200 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 25 Data size: 200 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 200 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 25 Data size: 200 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: int), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 200 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: int), _col1 (type: int) |
| Statistics: Num rows: 25 Data size: 200 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 100 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 25 Data size: 100 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| Warning: Shuffle Join MERGEJOIN[58][tables = [$hdt$_1, $hdt$_2]] in Stage 'Reducer 3' is a cross product |
| PREHOOK: query: select * from part where p_size in (select min(pp.p_size) from part pp where pp.p_partkey > part.p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size in (select min(pp.p_size) from part pp where pp.p_partkey > part.p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| PREHOOK: query: explain select * from part where p_size NOT IN (select count(*) from part pp where pp.p_type = part.p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_size NOT IN (select count(*) from part pp where pp.p_type = part.p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 5 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE), Reducer 6 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE), Reducer 7 (SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| Reducer 6 <- Map 1 (SIMPLE_EDGE) |
| Reducer 7 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col4 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col4 (type: string) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: p_type is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 2704 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Group By Operator |
| aggregations: count() |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Outer Join 0 to 1 |
| keys: |
| 0 _col4 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col10 |
| Statistics: Num rows: 26 Data size: 16302 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: CASE WHEN (_col10 is null) THEN (sq_count_check(0L, true)) ELSE (sq_count_check(_col10, true)) END (type: boolean) |
| Statistics: Num rows: 13 Data size: 8151 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col4 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col4 (type: string) |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Outer Join 0 to 1 |
| keys: |
| 0 _col4 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col10, _col11 |
| Statistics: Num rows: 26 Data size: 16318 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col4 (type: string), UDFToLong(_col5) (type: bigint) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col4 (type: string), UDFToLong(_col5) (type: bigint) |
| Statistics: Num rows: 26 Data size: 16318 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string), _col10 (type: bigint), _col11 (type: bigint) |
| Reducer 4 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Outer Join 0 to 1 |
| keys: |
| 0 _col4 (type: string), UDFToLong(_col5) (type: bigint) |
| 1 _col2 (type: string), _col0 (type: bigint) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col10, _col11, _col13 |
| Statistics: Num rows: 48 Data size: 30396 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (_col10 is null or (_col10 = 0L) or (_col13 is not null or _col5 is null or (_col11 < _col10)) is not true) (type: boolean) |
| Statistics: Num rows: 39 Data size: 24693 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 39 Data size: 24141 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 39 Data size: 24141 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: _col0 (type: string) |
| mode: complete |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Reducer 6 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count(), count(_col1) |
| keys: _col0 (type: string) |
| mode: complete |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2880 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2880 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint), _col2 (type: bigint) |
| Reducer 7 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 24 Data size: 2688 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: bigint), true (type: boolean), _col0 (type: string) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2784 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col2 (type: string), _col0 (type: bigint) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col2 (type: string), _col0 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2784 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: boolean) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where p_size NOT IN (select count(*) from part pp where pp.p_type = part.p_type) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size NOT IN (select count(*) from part pp where pp.p_type = part.p_type) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 almond antique violet chocolate turquoise Manufacturer#2 Brand#22 MEDIUM ANODIZED COPPER 14 MED CAN 1690.68 ly pending requ |
| 110592 almond antique salmon chartreuse burlywood Manufacturer#1 Brand#15 PROMO BURNISHED NICKEL 6 JUMBO PKG 1602.59 to the furiously |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 132666 almond aquamarine rose maroon antique Manufacturer#2 Brand#24 SMALL POLISHED NICKEL 25 MED BOX 1698.66 even |
| 144293 almond antique olive coral navajo Manufacturer#3 Brand#34 STANDARD POLISHED STEEL 45 JUMBO CAN 1337.29 ag furiously about |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17273 almond antique forest lavender goldenrod Manufacturer#3 Brand#35 PROMO ANODIZED TIN 14 JUMBO CASE 1190.27 along the |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 192697 almond antique blue firebrick mint Manufacturer#5 Brand#52 MEDIUM BURNISHED TIN 31 LG DRUM 1789.69 ickly ir |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 33357 almond azure aquamarine papaya violet Manufacturer#4 Brand#41 STANDARD ANODIZED TIN 12 WRAP CASE 1290.35 reful |
| 42669 almond antique medium spring khaki Manufacturer#5 Brand#51 STANDARD BURNISHED TIN 6 MED CAN 1611.66 sits haggl |
| 45261 almond aquamarine floral ivory bisque Manufacturer#4 Brand#42 SMALL PLATED STEEL 27 WRAP CASE 1206.26 careful |
| 48427 almond antique violet mint lemon Manufacturer#4 Brand#42 PROMO POLISHED STEEL 39 SM CASE 1375.42 hely ironic i |
| 49671 almond antique gainsboro frosted violet Manufacturer#4 Brand#41 SMALL BRUSHED BRASS 10 SM BOX 1620.67 ccounts run quick |
| 65667 almond aquamarine pink moccasin thistle Manufacturer#1 Brand#12 LARGE BURNISHED STEEL 42 JUMBO CASE 1632.66 e across the expr |
| 78486 almond azure blanched chiffon midnight Manufacturer#5 Brand#52 LARGE BRUSHED BRASS 23 MED BAG 1464.48 hely blith |
| 85768 almond antique chartreuse lavender yellow Manufacturer#1 Brand#12 LARGE BRUSHED STEEL 34 SM BAG 1753.76 refull |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| 90681 almond antique chartreuse khaki white Manufacturer#3 Brand#31 MEDIUM BURNISHED TIN 17 SM CASE 1671.68 are slyly after the sl |
| PREHOOK: query: explain select * from part where p_size not in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_size not in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 6 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE), Reducer 5 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (SIMPLE_EDGE), Reducer 5 (SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| Reducer 6 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: p_partkey is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 208 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: sum(p_size), count(p_size) |
| keys: p_partkey (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint), _col2 (type: bigint) |
| Group By Operator |
| keys: p_partkey (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 100 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 25 Data size: 100 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Outer Join 0 to 1 |
| keys: |
| 0 _col0 (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col10 |
| Statistics: Num rows: 26 Data size: 16302 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: CASE WHEN (_col10 is null) THEN (sq_count_check(0L, true)) ELSE (sq_count_check(_col10, true)) END (type: boolean) |
| Statistics: Num rows: 13 Data size: 8151 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 13 Data size: 8047 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Outer Join 0 to 1 |
| keys: |
| 0 _col0 (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col10, _col11 |
| Statistics: Num rows: 26 Data size: 16318 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), UDFToDouble(_col5) (type: double) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: int), UDFToDouble(_col5) (type: double) |
| Statistics: Num rows: 26 Data size: 16318 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string), _col10 (type: bigint), _col11 (type: bigint) |
| Reducer 4 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Outer Join 0 to 1 |
| keys: |
| 0 _col0 (type: int), UDFToDouble(_col5) (type: double) |
| 1 _col2 (type: int), _col0 (type: double) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col10, _col11, _col13 |
| Statistics: Num rows: 50 Data size: 31666 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (_col10 is null or (_col10 = 0L) or (_col13 is not null or _col5 is null or (_col11 < _col10)) is not true) (type: boolean) |
| Statistics: Num rows: 40 Data size: 25344 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 40 Data size: 24760 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 40 Data size: 24760 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: sum(VALUE._col0), count(VALUE._col1) |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (_col2 is not null and UDFToDouble(_col1) is not null) (type: boolean) |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: (UDFToDouble(_col1) / _col2) (type: double), true (type: boolean), _col0 (type: int) |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 400 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col2 (type: int), _col0 (type: double) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col2 (type: int), _col0 (type: double) |
| Statistics: Num rows: 25 Data size: 400 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: boolean) |
| Select Operator |
| expressions: _col0 (type: int), (UDFToDouble(_col1) / _col2) (type: double) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count(), count(_col1) |
| keys: _col0 (type: int) |
| mode: complete |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 25 Data size: 500 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint), _col2 (type: bigint) |
| Reducer 6 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 100 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: _col0 (type: int) |
| mode: complete |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 300 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 25 Data size: 300 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from part where p_size not in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size not in (select avg(pp.p_size) from part pp where pp.p_partkey = part.p_partkey) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| PREHOOK: query: create table t_n22(i int) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@t_n22 |
| POSTHOOK: query: create table t_n22(i int) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@t_n22 |
| PREHOOK: query: insert into t_n22 values(1) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: _dummy_database@_dummy_table |
| PREHOOK: Output: default@t_n22 |
| POSTHOOK: query: insert into t_n22 values(1) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: _dummy_database@_dummy_table |
| POSTHOOK: Output: default@t_n22 |
| POSTHOOK: Lineage: t_n22.i SCRIPT [] |
| PREHOOK: query: insert into t_n22 values(0) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: _dummy_database@_dummy_table |
| PREHOOK: Output: default@t_n22 |
| POSTHOOK: query: insert into t_n22 values(0) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: _dummy_database@_dummy_table |
| POSTHOOK: Output: default@t_n22 |
| POSTHOOK: Lineage: t_n22.i SCRIPT [] |
| PREHOOK: query: create table tempty_n2(i int) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@tempty_n2 |
| POSTHOOK: query: create table tempty_n2(i int) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@tempty_n2 |
| PREHOOK: query: explain select * from t_n22 where i IN (select count(*) from tempty_n2) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@t_n22 |
| PREHOOK: Input: default@tempty_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from t_n22 where i IN (select count(*) from tempty_n2) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@t_n22 |
| POSTHOOK: Input: default@tempty_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 4 (SIMPLE_EDGE) |
| Reducer 4 <- Map 3 (CUSTOM_SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: t_n22 |
| filterExpr: UDFToLong(i) is not null (type: boolean) |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: UDFToLong(i) is not null (type: boolean) |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: i (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: UDFToLong(_col0) (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: UDFToLong(_col0) (type: bigint) |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: tempty_n2 |
| Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column stats: COMPLETE |
| Select Operator |
| Statistics: Num rows: 1 Data size: 0 Basic stats: PARTIAL Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: PARTIAL Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 1 Data size: 8 Basic stats: PARTIAL Column stats: COMPLETE |
| value expressions: _col0 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 UDFToLong(_col0) (type: bigint) |
| 1 _col0 (type: bigint) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 2 Data size: 8 Basic stats: PARTIAL Column stats: NONE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 2 Data size: 8 Basic stats: PARTIAL Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: PARTIAL Column stats: COMPLETE |
| Filter Operator |
| predicate: _col0 is not null (type: boolean) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: PARTIAL Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: PARTIAL Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: bigint) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: bigint) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: PARTIAL Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from t_n22 where i IN (select count(*) from tempty_n2) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@t_n22 |
| PREHOOK: Input: default@tempty_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from t_n22 where i IN (select count(*) from tempty_n2) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@t_n22 |
| POSTHOOK: Input: default@tempty_n2 |
| #### A masked pattern was here #### |
| 0 |
| PREHOOK: query: drop table t_n22 |
| PREHOOK: type: DROPTABLE |
| PREHOOK: Input: default@t_n22 |
| PREHOOK: Output: default@t_n22 |
| POSTHOOK: query: drop table t_n22 |
| POSTHOOK: type: DROPTABLE |
| POSTHOOK: Input: default@t_n22 |
| POSTHOOK: Output: default@t_n22 |
| PREHOOK: query: create table tnull_n2(i int) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@tnull_n2 |
| POSTHOOK: query: create table tnull_n2(i int) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@tnull_n2 |
| PREHOOK: query: insert into tnull_n2 values(NULL) , (NULL) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: _dummy_database@_dummy_table |
| PREHOOK: Output: default@tnull_n2 |
| POSTHOOK: query: insert into tnull_n2 values(NULL) , (NULL) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: _dummy_database@_dummy_table |
| POSTHOOK: Output: default@tnull_n2 |
| POSTHOOK: Lineage: tnull_n2.i EXPRESSION [] |
| PREHOOK: query: select * from part where p_size IN (select i from tempty_n2) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| PREHOOK: Input: default@tempty_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size IN (select i from tempty_n2) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| POSTHOOK: Input: default@tempty_n2 |
| #### A masked pattern was here #### |
| PREHOOK: query: select * from tnull_n2 where i IN (select i from tempty_n2) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@tempty_n2 |
| PREHOOK: Input: default@tnull_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from tnull_n2 where i IN (select i from tempty_n2) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@tempty_n2 |
| POSTHOOK: Input: default@tnull_n2 |
| #### A masked pattern was here #### |
| PREHOOK: query: select * from part where p_size IN (select i from tnull_n2) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| PREHOOK: Input: default@tnull_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size IN (select i from tnull_n2) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| POSTHOOK: Input: default@tnull_n2 |
| #### A masked pattern was here #### |
| PREHOOK: query: select * from tnull_n2 where i IN (select i from tnull_n2) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@tnull_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from tnull_n2 where i IN (select i from tnull_n2) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@tnull_n2 |
| #### A masked pattern was here #### |
| PREHOOK: query: drop table tempty_n2 |
| PREHOOK: type: DROPTABLE |
| PREHOOK: Input: default@tempty_n2 |
| PREHOOK: Output: default@tempty_n2 |
| POSTHOOK: query: drop table tempty_n2 |
| POSTHOOK: type: DROPTABLE |
| POSTHOOK: Input: default@tempty_n2 |
| POSTHOOK: Output: default@tempty_n2 |
| PREHOOK: query: create table t_n22(i int, j int) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@t_n22 |
| POSTHOOK: query: create table t_n22(i int, j int) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@t_n22 |
| PREHOOK: query: insert into t_n22 values(0,1), (0,2) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: _dummy_database@_dummy_table |
| PREHOOK: Output: default@t_n22 |
| POSTHOOK: query: insert into t_n22 values(0,1), (0,2) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: _dummy_database@_dummy_table |
| POSTHOOK: Output: default@t_n22 |
| POSTHOOK: Lineage: t_n22.i SCRIPT [] |
| POSTHOOK: Lineage: t_n22.j SCRIPT [] |
| PREHOOK: query: create table tt_n2(i int, j int) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@tt_n2 |
| POSTHOOK: query: create table tt_n2(i int, j int) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@tt_n2 |
| PREHOOK: query: insert into tt_n2 values(0,3) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: _dummy_database@_dummy_table |
| PREHOOK: Output: default@tt_n2 |
| POSTHOOK: query: insert into tt_n2 values(0,3) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: _dummy_database@_dummy_table |
| POSTHOOK: Output: default@tt_n2 |
| POSTHOOK: Lineage: tt_n2.i SCRIPT [] |
| POSTHOOK: Lineage: tt_n2.j SCRIPT [] |
| PREHOOK: query: explain select * from t_n22 where i IN (select sum(i) from tt_n2 where tt_n2.j = t_n22.j) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@t_n22 |
| PREHOOK: Input: default@tt_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from t_n22 where i IN (select sum(i) from tt_n2 where tt_n2.j = t_n22.j) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@t_n22 |
| POSTHOOK: Input: default@tt_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 4 (SIMPLE_EDGE) |
| Reducer 4 <- Map 3 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: t_n22 |
| filterExpr: (UDFToLong(i) is not null and j is not null) (type: boolean) |
| Statistics: Num rows: 2 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (UDFToLong(i) is not null and j is not null) (type: boolean) |
| Statistics: Num rows: 2 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: i (type: int), j (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 2 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: UDFToLong(_col0) (type: bigint), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: UDFToLong(_col0) (type: bigint), _col1 (type: int) |
| Statistics: Num rows: 2 Data size: 16 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 3 |
| Map Operator Tree: |
| TableScan |
| alias: tt_n2 |
| filterExpr: j is not null (type: boolean) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: j is not null (type: boolean) |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: sum(i) |
| keys: j (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 UDFToLong(_col0) (type: bigint), _col1 (type: int) |
| 1 _col0 (type: bigint), _col1 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: sum(VALUE._col0) |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: bigint), _col0 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: bigint), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: bigint), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: bigint), _col1 (type: int) |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: select * from t_n22 where i IN (select sum(i) from tt_n2 where tt_n2.j = t_n22.j) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@t_n22 |
| PREHOOK: Input: default@tt_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from t_n22 where i IN (select sum(i) from tt_n2 where tt_n2.j = t_n22.j) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@t_n22 |
| POSTHOOK: Input: default@tt_n2 |
| #### A masked pattern was here #### |
| PREHOOK: query: drop table t_n22 |
| PREHOOK: type: DROPTABLE |
| PREHOOK: Input: default@t_n22 |
| PREHOOK: Output: default@t_n22 |
| POSTHOOK: query: drop table t_n22 |
| POSTHOOK: type: DROPTABLE |
| POSTHOOK: Input: default@t_n22 |
| POSTHOOK: Output: default@t_n22 |
| PREHOOK: query: drop table tt_n2 |
| PREHOOK: type: DROPTABLE |
| PREHOOK: Input: default@tt_n2 |
| PREHOOK: Output: default@tt_n2 |
| POSTHOOK: query: drop table tt_n2 |
| POSTHOOK: type: DROPTABLE |
| POSTHOOK: Input: default@tt_n2 |
| POSTHOOK: Output: default@tt_n2 |
| Warning: Shuffle Join MERGEJOIN[54][tables = [$hdt$_1, $hdt$_2]] in Stage 'Reducer 2' is a cross product |
| PREHOOK: query: explain select * from part where p_size IN (select max(p_size) from part p where p.p_type <> part.p_name) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_size IN (select max(p_size) from part p where p.p_type <> part.p_name) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (XPROD_EDGE), Reducer 5 (XPROD_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE) |
| Reducer 4 <- Map 1 (SIMPLE_EDGE), Reducer 3 (SIMPLE_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: p |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string), _col1 (type: int) |
| Filter Operator |
| predicate: (p_name is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string), _col5 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col1 (type: string), _col5 (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: p_name is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 3146 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: p_name (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 |
| 1 |
| outputColumnNames: _col0, _col1, _col2 |
| residual filter predicates: {(_col0 <> _col2)} |
| Statistics: Num rows: 650 Data size: 148850 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col1 (type: int), _col2 (type: string) |
| outputColumnNames: _col1, _col2 |
| Statistics: Num rows: 650 Data size: 148850 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: max(_col1) |
| keys: _col2 (type: string) |
| minReductionHashAggr: 0.96153843 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: max(VALUE._col0) |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: _col1 is not null (type: boolean) |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 25 Data size: 3125 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 4 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col1 (type: string), _col5 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 25 Data size: 3025 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| Warning: Shuffle Join MERGEJOIN[54][tables = [$hdt$_1, $hdt$_2]] in Stage 'Reducer 2' is a cross product |
| PREHOOK: query: select * from part where p_size IN (select max(p_size) from part p where p.p_type <> part.p_name) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size IN (select max(p_size) from part p where p.p_type <> part.p_name) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| Warning: Shuffle Join MERGEJOIN[76][tables = [$hdt$_1, $hdt$_2, $hdt$_3]] in Stage 'Reducer 4' is a cross product |
| PREHOOK: query: explain select * from part where p_size IN (select pp.p_size from part p join part pp on pp.p_type = p.p_type where part.p_type <> p.p_name) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from part where p_size IN (select pp.p_size from part p join part pp on pp.p_type = p.p_type where part.p_type <> p.p_name) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Reducer 4 (SIMPLE_EDGE) |
| Reducer 3 <- Map 1 (SIMPLE_EDGE), Map 6 (SIMPLE_EDGE) |
| Reducer 4 <- Reducer 3 (XPROD_EDGE), Reducer 5 (XPROD_EDGE) |
| Reducer 5 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: part |
| filterExpr: ((p_type is not null and p_size is not null) or p_type is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_type is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_partkey (type: int), p_name (type: string), p_mfgr (type: string), p_brand (type: string), p_type (type: string), p_size (type: int), p_container (type: string), p_retailprice (type: double), p_comment (type: string) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col4 (type: string), _col5 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col4 (type: string), _col5 (type: int) |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col6 (type: string), _col7 (type: double), _col8 (type: string) |
| Filter Operator |
| predicate: p_type is not null (type: boolean) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_name (type: string), p_type (type: string) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: string) |
| Statistics: Num rows: 26 Data size: 5850 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| Group By Operator |
| keys: p_type (type: string) |
| minReductionHashAggr: 0.4 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 6 |
| Map Operator Tree: |
| TableScan |
| alias: pp |
| filterExpr: (p_type is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (p_type is not null and p_size is not null) (type: boolean) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: p_type (type: string), p_size (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: string) |
| Statistics: Num rows: 26 Data size: 2808 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col1 (type: int) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Left Semi Join 0 to 1 |
| keys: |
| 0 _col4 (type: string), _col5 (type: int) |
| 1 _col0 (type: string), _col1 (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8 |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 26 Data size: 16094 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 3 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col1 (type: string) |
| 1 _col0 (type: string) |
| outputColumnNames: _col0, _col3 |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 28 Data size: 3500 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string), _col3 (type: int) |
| Reducer 4 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 |
| 1 |
| outputColumnNames: _col0, _col3, _col4 |
| residual filter predicates: {(_col4 <> _col0)} |
| Statistics: Num rows: 672 Data size: 153888 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col4 (type: string), _col3 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 672 Data size: 72576 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: _col0 (type: string), _col1 (type: int) |
| minReductionHashAggr: 0.83779764 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 336 Data size: 36288 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 336 Data size: 36288 Basic stats: COMPLETE Column stats: COMPLETE |
| Reducer 5 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 24 Data size: 2496 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: string) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| Warning: Shuffle Join MERGEJOIN[76][tables = [$hdt$_1, $hdt$_2, $hdt$_3]] in Stage 'Reducer 4' is a cross product |
| PREHOOK: query: select * from part where p_size IN (select pp.p_size from part p join part pp on pp.p_type = p.p_type where part.p_type <> p.p_name) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@part |
| #### A masked pattern was here #### |
| POSTHOOK: query: select * from part where p_size IN (select pp.p_size from part p join part pp on pp.p_type = p.p_type where part.p_type <> p.p_name) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@part |
| #### A masked pattern was here #### |
| 105685 almond antique violet chocolate turquoise Manufacturer#2 Brand#22 MEDIUM ANODIZED COPPER 14 MED CAN 1690.68 ly pending requ |
| 110592 almond antique salmon chartreuse burlywood Manufacturer#1 Brand#15 PROMO BURNISHED NICKEL 6 JUMBO PKG 1602.59 to the furiously |
| 112398 almond antique metallic orange dim Manufacturer#3 Brand#32 MEDIUM BURNISHED BRASS 19 JUMBO JAR 1410.39 ole car |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 121152 almond antique burnished rose metallic Manufacturer#1 Brand#14 PROMO PLATED TIN 2 JUMBO BOX 1173.15 e pinto beans h |
| 132666 almond aquamarine rose maroon antique Manufacturer#2 Brand#24 SMALL POLISHED NICKEL 25 MED BOX 1698.66 even |
| 144293 almond antique olive coral navajo Manufacturer#3 Brand#34 STANDARD POLISHED STEEL 45 JUMBO CAN 1337.29 ag furiously about |
| 146985 almond aquamarine midnight light salmon Manufacturer#2 Brand#23 MEDIUM BURNISHED COPPER 2 SM CASE 2031.98 s cajole caref |
| 15103 almond aquamarine dodger light gainsboro Manufacturer#5 Brand#53 ECONOMY BURNISHED STEEL 46 LG PACK 1018.1 packages hinder carefu |
| 155733 almond antique sky peru orange Manufacturer#5 Brand#53 SMALL PLATED BRASS 2 WRAP DRUM 1788.73 furiously. bra |
| 17273 almond antique forest lavender goldenrod Manufacturer#3 Brand#35 PROMO ANODIZED TIN 14 JUMBO CASE 1190.27 along the |
| 17927 almond aquamarine yellow dodger mint Manufacturer#4 Brand#41 ECONOMY BRUSHED COPPER 7 SM PKG 1844.92 ites. eve |
| 191709 almond antique violet turquoise frosted Manufacturer#2 Brand#22 ECONOMY POLISHED STEEL 40 MED BOX 1800.7 haggle |
| 192697 almond antique blue firebrick mint Manufacturer#5 Brand#52 MEDIUM BURNISHED TIN 31 LG DRUM 1789.69 ickly ir |
| 195606 almond aquamarine sandy cyan gainsboro Manufacturer#2 Brand#25 STANDARD PLATED TIN 18 SM PKG 1701.6 ic de |
| 33357 almond azure aquamarine papaya violet Manufacturer#4 Brand#41 STANDARD ANODIZED TIN 12 WRAP CASE 1290.35 reful |
| 40982 almond antique misty red olive Manufacturer#3 Brand#32 ECONOMY PLATED COPPER 1 LG PKG 1922.98 c foxes can s |
| 42669 almond antique medium spring khaki Manufacturer#5 Brand#51 STANDARD BURNISHED TIN 6 MED CAN 1611.66 sits haggl |
| 45261 almond aquamarine floral ivory bisque Manufacturer#4 Brand#42 SMALL PLATED STEEL 27 WRAP CASE 1206.26 careful |
| 48427 almond antique violet mint lemon Manufacturer#4 Brand#42 PROMO POLISHED STEEL 39 SM CASE 1375.42 hely ironic i |
| 49671 almond antique gainsboro frosted violet Manufacturer#4 Brand#41 SMALL BRUSHED BRASS 10 SM BOX 1620.67 ccounts run quick |
| 65667 almond aquamarine pink moccasin thistle Manufacturer#1 Brand#12 LARGE BURNISHED STEEL 42 JUMBO CASE 1632.66 e across the expr |
| 78486 almond azure blanched chiffon midnight Manufacturer#5 Brand#52 LARGE BRUSHED BRASS 23 MED BAG 1464.48 hely blith |
| 85768 almond antique chartreuse lavender yellow Manufacturer#1 Brand#12 LARGE BRUSHED STEEL 34 SM BAG 1753.76 refull |
| 86428 almond aquamarine burnished black steel Manufacturer#1 Brand#12 STANDARD ANODIZED STEEL 28 WRAP BAG 1414.42 arefully |
| 90681 almond antique chartreuse khaki white Manufacturer#3 Brand#31 MEDIUM BURNISHED TIN 17 SM CASE 1671.68 are slyly after the sl |
