tree 10a54bf8e7abf30a4b24780006adfb549b12621a
parent 85c9895c119a0dcc5872dde29d8d8b1c243f7903
author Csaba Ringhofer <csringhofer@cloudera.com> 1575486931 +0100
committer Impala Public Jenkins <impala-public-jenkins@cloudera.com> 1575641790 +0000

IMPALA-8184: Add timestamp validation to ORC scanner

Hive can write timestamps that are outside Impala's valid
range (Impala: 1400-9999 Hive: 0001-9999). This change adds
validation logic to ORC reading that replaces out-of-range
timestamps with NULLs and adds a warning to the query.

The logic is very similar to the existing validation in
Parquet. Some differences:
- "time of day" is not checked separately as it doesn't make
  sense with ORC's encoding
- instead of column name only column id is added to the warning

Testing:
- added a simple EE test that scans an existing ORC file

Change-Id: I8ee2ba83a54f93d37e8832e064f2c8418b503490
Reviewed-on: http://gerrit.cloudera.org:8080/14832
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>