commit | ea75e68f9e07d9bec211adea2c9d0e0dd0f9c3bc | [log] [tgz] |
---|---|---|
author | Tim Armstrong <tarmstrong@cloudera.com> | Wed Aug 26 15:29:42 2020 -0700 |
committer | Impala Public Jenkins <impala-public-jenkins@cloudera.com> | Sat Aug 29 05:48:37 2020 +0000 |
tree | 2921aa33458a426a4a31fa2017f5d5bdbb73610c | |
parent | 5daff3472440dc6174f0f31a28bbdafee4f68716 [diff] |
IMPALA-10110: bloom filter target fpp query option This adds a BLOOM_FILTER_ERROR_RATE option that takes a value between 0 and 1 (exclusive) that can override the default target false positive probability (fpp) value of 0.75 for selecting the filter size. It does not affect whether filters are disabled at runtime. Adds estimated FPP and bloom size to the routing table so we have some observability. Here is an example: tpch_kudu> select count(*) from customer join nation on n_nationkey = c_nationkey; ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled Bloom Size Est fpp ----------------------------------------------------------------------------------------------------------------------------------------- 1 2 0 LOCAL false 0 (3) N/A N/A true MIN_MAX 0 2 0 LOCAL false 0 (3) N/A N/A true 1.00 MB 1.04e-37 Testing: Added a test that shows the query option affecting filter size. Ran core tests. Change-Id: Ifb123a0ea1e0e95d95df9837c1f0222fd60361f3 Reviewed-on: http://gerrit.cloudera.org:8080/16377 Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Lightning-fast, distributed SQL queries for petabytes of data stored in Apache Hadoop clusters.
Impala is a modern, massively-distributed, massively-parallel, C++ query engine that lets you analyze, transform and combine data from a variety of data sources:
To learn more about Impala as a business user, or to try Impala live or in a VM, please visit the Impala homepage. Detailed documentation for administrators and users is available at Apache Impala documentation.
If you are interested in contributing to Impala as a developer, or learning more about Impala's internals and architecture, visit the Impala wiki.
Impala only supports Linux at the moment.
This distribution uses cryptographic software and may be subject to export controls. Please refer to EXPORT_CONTROL.md for more information.
See Impala's developer documentation to get started.
Detailed build notes has some detailed information on the project layout and build.