commit df7aac9517bb3777f15e583100a087e4d3525ece
author Gabor Kaszab <gaborkaszab@cloudera.com> Tue Apr 09 09:59:51 2024 +0200
committer Impala Public Jenkins <impala-public-jenkins@cloudera.com> Wed Apr 10 17:47:32 2024 +0000
tree 8573dd0a84dc0e91687b50a27198d517f53aa0b4
parent 8ff51fbf74b4572ce3d1e43389fc10d35a8dd576

IMPALA-12970: Fix ConcurrentModificationException for Iceberg table scans

When a table is partitioned IcebergScanNode sorts the file descriptors
for better scheduling. However, the list of file descriptors comes from
IcebergContentFileStore and is shared between different select queries
on the table. When another query tries to iterate the list of file
descriptors and at the same time the IcebergScanNode sorts them we get
a ConcurrentModificationException.
To solve this IceberScanNode now creates its own copy of the file
descriptor list not to interfere with other queries.

Manual testing:
300-400 SELECT * Iceberg queries were sent into Impala in a loop that
confidently reproduced the original issue. With the fix the issue is
gone.
The queries used for the repro:
1:
select *
from functional_parquet.iceberg_v2_partitioned_position_deletes_orc a,
functional_parquet.iceberg_partitioned_orc_external b
where a.action = b.action and b.id=3;
2:
select *
from functional_parquet.iceberg_v2_equality_delete_schema_evolution;

Change-Id: Iafe57f05ffa0fa6a0875c141cfafd5ee1607a5c3
Reviewed-on: http://gerrit.cloudera.org:8080/21267
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>