| PREHOOK: query: create table if not exists loc_staging_n2 ( |
| state string, |
| locid int, |
| zip bigint, |
| year int |
| ) row format delimited fields terminated by '|' stored as textfile |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@loc_staging_n2 |
| POSTHOOK: query: create table if not exists loc_staging_n2 ( |
| state string, |
| locid int, |
| zip bigint, |
| year int |
| ) row format delimited fields terminated by '|' stored as textfile |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@loc_staging_n2 |
| PREHOOK: query: create table loc_orc_n2 like loc_staging_n2 |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@loc_orc_n2 |
| POSTHOOK: query: create table loc_orc_n2 like loc_staging_n2 |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@loc_orc_n2 |
| PREHOOK: query: alter table loc_orc_n2 set fileformat orc |
| PREHOOK: type: ALTERTABLE_FILEFORMAT |
| PREHOOK: Input: default@loc_orc_n2 |
| PREHOOK: Output: default@loc_orc_n2 |
| POSTHOOK: query: alter table loc_orc_n2 set fileformat orc |
| POSTHOOK: type: ALTERTABLE_FILEFORMAT |
| POSTHOOK: Input: default@loc_orc_n2 |
| POSTHOOK: Output: default@loc_orc_n2 |
| PREHOOK: query: load data local inpath '../../data/files/loc.txt' overwrite into table loc_staging_n2 |
| PREHOOK: type: LOAD |
| #### A masked pattern was here #### |
| PREHOOK: Output: default@loc_staging_n2 |
| POSTHOOK: query: load data local inpath '../../data/files/loc.txt' overwrite into table loc_staging_n2 |
| POSTHOOK: type: LOAD |
| #### A masked pattern was here #### |
| POSTHOOK: Output: default@loc_staging_n2 |
| PREHOOK: query: insert overwrite table loc_orc_n2 select * from loc_staging_n2 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_staging_n2 |
| PREHOOK: Output: default@loc_orc_n2 |
| POSTHOOK: query: insert overwrite table loc_orc_n2 select * from loc_staging_n2 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_staging_n2 |
| POSTHOOK: Output: default@loc_orc_n2 |
| POSTHOOK: Lineage: loc_orc_n2.locid SIMPLE [(loc_staging_n2)loc_staging_n2.FieldSchema(name:locid, type:int, comment:null), ] |
| POSTHOOK: Lineage: loc_orc_n2.state SIMPLE [(loc_staging_n2)loc_staging_n2.FieldSchema(name:state, type:string, comment:null), ] |
| POSTHOOK: Lineage: loc_orc_n2.year SIMPLE [(loc_staging_n2)loc_staging_n2.FieldSchema(name:year, type:int, comment:null), ] |
| POSTHOOK: Lineage: loc_orc_n2.zip SIMPLE [(loc_staging_n2)loc_staging_n2.FieldSchema(name:zip, type:bigint, comment:null), ] |
| PREHOOK: query: explain select * from loc_orc_n2 |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select * from loc_orc_n2 |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-0 is a root stage |
| |
| STAGE PLANS: |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Select Operator |
| expressions: state (type: string), locid (type: int), zip (type: bigint), year (type: int) |
| outputColumnNames: _col0, _col1, _col2, _col3 |
| ListSink |
| |
| PREHOOK: query: analyze table loc_orc_n2 compute statistics for columns state |
| PREHOOK: type: ANALYZE_TABLE |
| PREHOOK: Input: default@loc_orc_n2 |
| PREHOOK: Output: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: analyze table loc_orc_n2 compute statistics for columns state |
| POSTHOOK: type: ANALYZE_TABLE |
| POSTHOOK: Input: default@loc_orc_n2 |
| POSTHOOK: Output: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| PREHOOK: query: explain select a, c, min(b) |
| from ( select state as a, locid as b, count(*) as c |
| from loc_orc_n2 |
| group by state,locid |
| ) sq1 |
| group by a,c |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select a, c, min(b) |
| from ( select state as a, locid as b, count(*) as c |
| from loc_orc_n2 |
| group by state,locid |
| ) sq1 |
| group by a,c |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: state (type: string), locid (type: int) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col2 (type: bigint) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: string), KEY._col1 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(_col1) |
| keys: _col0 (type: string), _col2 (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: bigint) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: bigint) |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col2 (type: int) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0) |
| keys: KEY._col0 (type: string), KEY._col1 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: analyze table loc_orc_n2 compute statistics for columns state,locid,year |
| PREHOOK: type: ANALYZE_TABLE |
| PREHOOK: Input: default@loc_orc_n2 |
| PREHOOK: Output: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: analyze table loc_orc_n2 compute statistics for columns state,locid,year |
| POSTHOOK: type: ANALYZE_TABLE |
| POSTHOOK: Input: default@loc_orc_n2 |
| POSTHOOK: Output: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| PREHOOK: query: explain select year from loc_orc_n2 group by year |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select year from loc_orc_n2 group by year |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 32 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: year (type: int) |
| outputColumnNames: year |
| Statistics: Num rows: 8 Data size: 32 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: year (type: int) |
| minReductionHashAggr: 0.75 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 8 Data size: 32 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 8 Data size: 32 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int) |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with rollup |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with rollup |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by rollup( state,locid ) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by rollup( state,locid ) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state)) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state)) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 8 Data size: 784 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid)) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid)) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid),()) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid),()) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 24 Data size: 2352 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state,locid),(state),(locid),()) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state,locid),(state),(locid),()) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 32 Data size: 3136 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select year from loc_orc_n2 group by year |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select year from loc_orc_n2 group by year |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 32 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: year (type: int) |
| outputColumnNames: year |
| Statistics: Num rows: 8 Data size: 32 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: year (type: int) |
| minReductionHashAggr: 0.875 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 2 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 1 Data size: 4 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 1 Data size: 4 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 720 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 16 Data size: 1568 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,zip from loc_orc_n2 group by state,zip |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,zip from loc_orc_n2 group by state,zip |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 752 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: state (type: string), zip (type: bigint) |
| outputColumnNames: state, zip |
| Statistics: Num rows: 8 Data size: 752 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| keys: state (type: string), zip (type: bigint) |
| minReductionHashAggr: 0.0 |
| mode: hash |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 4 Data size: 376 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: bigint) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: bigint) |
| Statistics: Num rows: 4 Data size: 376 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 4 Data size: 376 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 4 Data size: 376 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 32 Data size: 3184 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 32 Data size: 3184 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with rollup |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with rollup |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2388 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2388 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 12 Data size: 1194 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 12 Data size: 1194 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by rollup (state,locid) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by rollup (state,locid) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2388 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2388 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 12 Data size: 1194 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 12 Data size: 1194 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state)) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state)) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 4 Data size: 398 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 4 Data size: 398 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid)) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid)) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid),()) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state),(locid),()) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 24 Data size: 2388 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 24 Data size: 2388 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 12 Data size: 1194 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 12 Data size: 1194 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state,locid),(state),(locid),()) |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid grouping sets((state,locid),(state),(locid),()) |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 32 Data size: 3184 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 32 Data size: 3184 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select year from loc_orc_n2 group by year |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select year from loc_orc_n2 group by year |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: year (type: int) |
| outputColumnNames: year |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: year (type: int) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0 |
| Statistics: Num rows: 4 Data size: 398 Basic stats: COMPLETE Column stats: NONE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 4 Data size: 398 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select state,locid from loc_orc_n2 group by state,locid with cube |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@loc_orc_n2 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Reducer 2 <- Map 1 (SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: loc_orc_n2 |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Select Operator |
| expressions: state (type: string), locid (type: int) |
| outputColumnNames: state, locid |
| Statistics: Num rows: 8 Data size: 796 Basic stats: COMPLETE Column stats: NONE |
| Group By Operator |
| keys: state (type: string), locid (type: int), 0L (type: bigint) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 32 Data size: 3184 Basic stats: COMPLETE Column stats: NONE |
| Reduce Output Operator |
| key expressions: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| null sort order: zzz |
| sort order: +++ |
| Map-reduce partition columns: _col0 (type: string), _col1 (type: int), _col2 (type: bigint) |
| Statistics: Num rows: 32 Data size: 3184 Basic stats: COMPLETE Column stats: NONE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| keys: KEY._col0 (type: string), KEY._col1 (type: int), KEY._col2 (type: bigint) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| pruneGroupingSetId: true |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 16 Data size: 1592 Basic stats: COMPLETE Column stats: NONE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: create table t1_uq12(i int, j int) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@t1_uq12 |
| POSTHOOK: query: create table t1_uq12(i int, j int) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@t1_uq12 |
| PREHOOK: query: alter table t1_uq12 update statistics set('numRows'='10000', 'rawDataSize'='18000') |
| PREHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| PREHOOK: Input: default@t1_uq12 |
| PREHOOK: Output: default@t1_uq12 |
| POSTHOOK: query: alter table t1_uq12 update statistics set('numRows'='10000', 'rawDataSize'='18000') |
| POSTHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| POSTHOOK: Input: default@t1_uq12 |
| POSTHOOK: Output: default@t1_uq12 |
| PREHOOK: query: alter table t1_uq12 update statistics for column i set('numDVs'='2500','numNulls'='50','highValue'='1000','lowValue'='0') |
| PREHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| PREHOOK: Input: default@t1_uq12 |
| PREHOOK: Output: default@t1_uq12 |
| POSTHOOK: query: alter table t1_uq12 update statistics for column i set('numDVs'='2500','numNulls'='50','highValue'='1000','lowValue'='0') |
| POSTHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| POSTHOOK: Input: default@t1_uq12 |
| POSTHOOK: Output: default@t1_uq12 |
| PREHOOK: query: alter table t1_uq12 update statistics for column j set('numDVs'='500','numNulls'='30','highValue'='100','lowValue'='50') |
| PREHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| PREHOOK: Input: default@t1_uq12 |
| PREHOOK: Output: default@t1_uq12 |
| POSTHOOK: query: alter table t1_uq12 update statistics for column j set('numDVs'='500','numNulls'='30','highValue'='100','lowValue'='50') |
| POSTHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| POSTHOOK: Input: default@t1_uq12 |
| POSTHOOK: Output: default@t1_uq12 |
| PREHOOK: query: create table t2_uq12(i2 int, j2 int) |
| PREHOOK: type: CREATETABLE |
| PREHOOK: Output: database:default |
| PREHOOK: Output: default@t2_uq12 |
| POSTHOOK: query: create table t2_uq12(i2 int, j2 int) |
| POSTHOOK: type: CREATETABLE |
| POSTHOOK: Output: database:default |
| POSTHOOK: Output: default@t2_uq12 |
| PREHOOK: query: alter table t2_uq12 update statistics set('numRows'='100000000', 'rawDataSize'='10000') |
| PREHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| PREHOOK: Input: default@t2_uq12 |
| PREHOOK: Output: default@t2_uq12 |
| POSTHOOK: query: alter table t2_uq12 update statistics set('numRows'='100000000', 'rawDataSize'='10000') |
| POSTHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| POSTHOOK: Input: default@t2_uq12 |
| POSTHOOK: Output: default@t2_uq12 |
| PREHOOK: query: alter table t2_uq12 update statistics for column i2 set('numDVs'='10000000','numNulls'='0','highValue'='8000','lowValue'='0') |
| PREHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| PREHOOK: Input: default@t2_uq12 |
| PREHOOK: Output: default@t2_uq12 |
| POSTHOOK: query: alter table t2_uq12 update statistics for column i2 set('numDVs'='10000000','numNulls'='0','highValue'='8000','lowValue'='0') |
| POSTHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| POSTHOOK: Input: default@t2_uq12 |
| POSTHOOK: Output: default@t2_uq12 |
| PREHOOK: query: alter table t2_uq12 update statistics for column j2 set('numDVs'='10','numNulls'='0','highValue'='800','lowValue'='-1') |
| PREHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| PREHOOK: Input: default@t2_uq12 |
| PREHOOK: Output: default@t2_uq12 |
| POSTHOOK: query: alter table t2_uq12 update statistics for column j2 set('numDVs'='10','numNulls'='0','highValue'='800','lowValue'='-1') |
| POSTHOOK: type: ALTERTABLE_UPDATETABLESTATS |
| POSTHOOK: Input: default@t2_uq12 |
| POSTHOOK: Output: default@t2_uq12 |
| PREHOOK: query: explain select count (1) from t1_uq12,t2_uq12 where t1_uq12.j=t2_uq12.i2 group by t1_uq12.i, t1_uq12.j |
| PREHOOK: type: QUERY |
| PREHOOK: Input: default@t1_uq12 |
| PREHOOK: Input: default@t2_uq12 |
| #### A masked pattern was here #### |
| POSTHOOK: query: explain select count (1) from t1_uq12,t2_uq12 where t1_uq12.j=t2_uq12.i2 group by t1_uq12.i, t1_uq12.j |
| POSTHOOK: type: QUERY |
| POSTHOOK: Input: default@t1_uq12 |
| POSTHOOK: Input: default@t2_uq12 |
| #### A masked pattern was here #### |
| STAGE DEPENDENCIES: |
| Stage-1 is a root stage |
| Stage-0 depends on stages: Stage-1 |
| |
| STAGE PLANS: |
| Stage: Stage-1 |
| Tez |
| #### A masked pattern was here #### |
| Edges: |
| Map 5 <- Reducer 4 (BROADCAST_EDGE) |
| Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 5 (SIMPLE_EDGE) |
| Reducer 3 <- Reducer 2 (SIMPLE_EDGE) |
| Reducer 4 <- Map 1 (CUSTOM_SIMPLE_EDGE) |
| #### A masked pattern was here #### |
| Vertices: |
| Map 1 |
| Map Operator Tree: |
| TableScan |
| alias: t1_uq12 |
| filterExpr: j is not null (type: boolean) |
| Statistics: Num rows: 10000 Data size: 79688 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: j is not null (type: boolean) |
| Statistics: Num rows: 9970 Data size: 79448 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: i (type: int), j (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 9970 Data size: 79448 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col1 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col1 (type: int) |
| Statistics: Num rows: 9970 Data size: 79448 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int) |
| Select Operator |
| expressions: _col1 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 9970 Data size: 79528 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: min(_col0), max(_col0), bloom_filter(_col0, expectedEntries=1000000) |
| minReductionHashAggr: 0.99 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: int), _col2 (type: binary) |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Map 5 |
| Map Operator Tree: |
| TableScan |
| alias: t2_uq12 |
| filterExpr: (i2 is not null and i2 BETWEEN DynamicValue(RS_6_t1_uq12_j_min) AND DynamicValue(RS_6_t1_uq12_j_max) and in_bloom_filter(i2, DynamicValue(RS_6_t1_uq12_j_bloom_filter))) (type: boolean) |
| Statistics: Num rows: 100000000 Data size: 400000000 Basic stats: COMPLETE Column stats: COMPLETE |
| Filter Operator |
| predicate: (i2 is not null and i2 BETWEEN DynamicValue(RS_6_t1_uq12_j_min) AND DynamicValue(RS_6_t1_uq12_j_max) and in_bloom_filter(i2, DynamicValue(RS_6_t1_uq12_j_bloom_filter))) (type: boolean) |
| Statistics: Num rows: 100000000 Data size: 400000000 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: i2 (type: int) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 100000000 Data size: 400000000 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int) |
| null sort order: z |
| sort order: + |
| Map-reduce partition columns: _col0 (type: int) |
| Statistics: Num rows: 100000000 Data size: 400000000 Basic stats: COMPLETE Column stats: COMPLETE |
| Execution mode: vectorized, llap |
| LLAP IO: all inputs |
| Reducer 2 |
| Execution mode: llap |
| Reduce Operator Tree: |
| Merge Join Operator |
| condition map: |
| Inner Join 0 to 1 |
| keys: |
| 0 _col1 (type: int) |
| 1 _col0 (type: int) |
| outputColumnNames: _col0, _col1 |
| Statistics: Num rows: 99700 Data size: 797288 Basic stats: COMPLETE Column stats: COMPLETE |
| Group By Operator |
| aggregations: count() |
| keys: _col0 (type: int), _col1 (type: int) |
| minReductionHashAggr: 0.43852556 |
| mode: hash |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 9970 Data size: 159496 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| key expressions: _col0 (type: int), _col1 (type: int) |
| null sort order: zz |
| sort order: ++ |
| Map-reduce partition columns: _col0 (type: int), _col1 (type: int) |
| Statistics: Num rows: 9970 Data size: 159496 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col2 (type: bigint) |
| Reducer 3 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: count(VALUE._col0) |
| keys: KEY._col0 (type: int), KEY._col1 (type: int) |
| mode: mergepartial |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 9970 Data size: 159496 Basic stats: COMPLETE Column stats: COMPLETE |
| Select Operator |
| expressions: _col2 (type: bigint) |
| outputColumnNames: _col0 |
| Statistics: Num rows: 9970 Data size: 79760 Basic stats: COMPLETE Column stats: COMPLETE |
| File Output Operator |
| compressed: false |
| Statistics: Num rows: 9970 Data size: 79760 Basic stats: COMPLETE Column stats: COMPLETE |
| table: |
| input format: org.apache.hadoop.mapred.SequenceFileInputFormat |
| output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat |
| serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe |
| Reducer 4 |
| Execution mode: vectorized, llap |
| Reduce Operator Tree: |
| Group By Operator |
| aggregations: min(VALUE._col0), max(VALUE._col1), bloom_filter(VALUE._col2, expectedEntries=1000000) |
| mode: final |
| outputColumnNames: _col0, _col1, _col2 |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| Reduce Output Operator |
| null sort order: |
| sort order: |
| Statistics: Num rows: 1 Data size: 12 Basic stats: COMPLETE Column stats: COMPLETE |
| value expressions: _col0 (type: int), _col1 (type: int), _col2 (type: binary) |
| |
| Stage: Stage-0 |
| Fetch Operator |
| limit: -1 |
| Processor Tree: |
| ListSink |
| |
| PREHOOK: query: drop table t1_uq12 |
| PREHOOK: type: DROPTABLE |
| PREHOOK: Input: default@t1_uq12 |
| PREHOOK: Output: default@t1_uq12 |
| POSTHOOK: query: drop table t1_uq12 |
| POSTHOOK: type: DROPTABLE |
| POSTHOOK: Input: default@t1_uq12 |
| POSTHOOK: Output: default@t1_uq12 |
| PREHOOK: query: drop table t2_uq12 |
| PREHOOK: type: DROPTABLE |
| PREHOOK: Input: default@t2_uq12 |
| PREHOOK: Output: default@t2_uq12 |
| POSTHOOK: query: drop table t2_uq12 |
| POSTHOOK: type: DROPTABLE |
| POSTHOOK: Input: default@t2_uq12 |
| POSTHOOK: Output: default@t2_uq12 |
