tree 2921aa33458a426a4a31fa2017f5d5bdbb73610c
parent 5daff3472440dc6174f0f31a28bbdafee4f68716
author Tim Armstrong <tarmstrong@cloudera.com> 1598480982 -0700
committer Impala Public Jenkins <impala-public-jenkins@cloudera.com> 1598680117 +0000

IMPALA-10110: bloom filter target fpp query option

This adds a BLOOM_FILTER_ERROR_RATE option that takes a
value between 0 and 1 (exclusive) that can override
the default target false positive probability (fpp)
value of 0.75 for selecting the filter size.

It does not affect whether filters are disabled
at runtime.

Adds estimated FPP and bloom size to the routing
table so we have some observability. Here is an
example:

tpch_kudu> select count(*) from customer join nation on n_nationkey = c_nationkey;

 ID  Src. Node  Tgt. Node(s)  Target type  Partition filter  Pending (Expected)  First arrived  Completed  Enabled  Bloom Size    Est fpp
-----------------------------------------------------------------------------------------------------------------------------------------
  1          2             0        LOCAL             false               0 (3)            N/A        N/A     true     MIN_MAX
  0          2             0        LOCAL             false               0 (3)            N/A        N/A     true     1.00 MB   1.04e-37

Testing:
Added a test that shows the query option affecting filter size.

Ran core tests.

Change-Id: Ifb123a0ea1e0e95d95df9837c1f0222fd60361f3
Reviewed-on: http://gerrit.cloudera.org:8080/16377
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>