tree 7fc225da3d738d2d51520ad20faea825dc2cd553
parent 6321dbb61e9593e49c59318f3d9cb38a8b0e9c2a
author Matthias Boehm <mboehm7@gmail.com> 1612375285 +0100
committer Matthias Boehm <mboehm7@gmail.com> 1612375412 +0100

[SYSTEMDS-2641] Fix spark remove empty instruction (broadcasts handling)

This patch fixes a major issue with the spark remove empty handling of
broadcast flags. Since this flag is serialized as a normal named
parameter, the parsing logic was wrong and always returned false,
falling back to vector replication for a shuffle-based join of the
selection vector.

Furthermore, the patch also contains a minor improvement of the slice
finding algorithm to track the elapsed time per lattice level.