IMPALA-15135: Calcite planner: added support for Kudu tables This commit enables the Calcite planner to support queries on Kudu tables. Highlights include: - The Kudu tables can have an auto_incrementing_id column that does not show up when a "select *" is done on the query. Special logic has been added to support this. If the user expliclity selects the auto_incrementing_id column, the query will fall back to the original planner (IMPALA-15136 has been filed for this). - A small refactor was done for PrunedPartitionHelper to handle Kudu tables because it does not support code in the HdfsPartitionPruner. - A small refactor was done in CalciteDb to handle FeKuduTable - IMPALA-15134 has been filed on an issue where the cardinality on the KuduScan table is different from the original planner. - Added some code in the test framework to handle the section CALCITE_PLANNER_RUNTIME_PROFILE for when a table format is specified. Change-Id: Ie22a66f0edad195cade74a8447efc83a8ce526f7 Reviewed-on: http://gerrit.cloudera.org:8080/24528 Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com> Reviewed-by: Steve Carlin <scarlin@cloudera.com>
Lightning-fast, distributed SQL queries for petabytes of data stored in open data and table formats.
Impala is a modern, massively-distributed, massively-parallel, C++ query engine that lets you analyze, transform and combine data from a variety of data sources:
The fastest way to try out Impala is a quickstart Docker container. You can try out running queries and processing data sets in Impala on a single machine without installing dependencies. It can automatically load test data sets into Apache Kudu and Apache Parquet formats and you can start playing around with Apache Impala SQL within minutes.
To learn more about Impala as a user or administrator, or to try Impala, please visit the Impala homepage. Detailed documentation for administrators and users is available at Apache Impala documentation.
If you are interested in contributing to Impala as a developer, or learning more about Impala's internals and architecture, visit the Impala wiki.
Impala only supports Linux at the moment. Impala supports x86_64 and arm64 (as of Impala 4.4). Impala Requirements contains more detailed information on the minimum CPU requirements.
Impala runs on Linux systems only. The supported distros are
Other systems, e.g. SLES15/16, may also be supported but are not tested by the community.
This distribution uses cryptographic software and may be subject to export controls. Please refer to EXPORT_CONTROL.md for more information.
See Impala's developer documentation to get started.
Detailed build notes has some detailed information on the project layout and build.