Google Git
Sign in
apache / arrow-experimental-rs-arrow2 / 0d1697f619c1bff8f64b19df5d4ec66634eaecf9
commit0d1697f619c1bff8f64b19df5d4ec66634eaecf9[log] [tgz]
authorChristoph Schulze <christoph.schulze@signavio.com>Wed Apr 14 07:08:00 2021 -0400
committerAndrew Lamb <andrew@nerdnetworks.org>Wed Apr 14 07:08:00 2021 -0400
tree4d9a6f81b2e5194204bd5568599a545f3248c33c
parent4314ce93c6ba649feeffd221c7fac44378493a43 [diff]
ARROW-12294: [Rust] Fix boolean kleene kernels with no remainder

[PR 9772](https://github.com/apache/arrow/pull/9772) introduced a bug. The boolean kleene kernel would not iterate over the bit chunks of the batch, if there is no validity bitmap on the left or the right input. It will only process the bits of the remainder word. The inital unit test didn't pick a large enough batch size to test this scenario, which is why this was not detected by the tests earlier.

Closes #9965 from ch-sc/ARROW-12294-boolean-kleene-kernels-no-remainder

Authored-by: Christoph Schulze <christoph.schulze@signavio.com>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
1 file changed
tree: 4d9a6f81b2e5194204bd5568599a545f3248c33c
  1. .github/
  2. ci/
  3. dev/
  4. format/
  5. rust/
  6. testing
  7. .asf.yaml
  8. .clang-format
  9. .clang-tidy
  10. .clang-tidy-ignore
  11. .dir-locals.el
  12. .dockerignore
  13. .env
  14. .gitattributes
  15. .gitignore
  16. .gitmodules
  17. .hadolint.yaml
  18. .pre-commit-config.yaml
  19. .readthedocs.yml
  20. .travis.yml
  21. appveyor.yml
  22. CHANGELOG.md
  23. cmake-format.py
  24. CODE_OF_CONDUCT.md
  25. CONTRIBUTING.md
  26. docker-compose.yml
  27. header
  28. LICENSE.txt
  29. NOTICE.txt
  30. README.md
  31. run-cmake-format.py
README.md

Apache Arrow

Build Status Coverage Status Fuzzing Status License Twitter Follow

Powering In-Memory Analytics

Apache Arrow is a development platform for in-memory analytics. It contains a set of technologies that enable big data systems to process and move data fast.

Major components of the project include:

Arrow is an Apache Software Foundation project. Learn more at arrow.apache.org.

What's in the Arrow libraries?

The reference Arrow libraries contain many distinct software components:

  • Columnar vector and table-like containers (similar to data frames) supporting flat or nested types
  • Fast, language agnostic metadata messaging layer (using Google's Flatbuffers library)
  • Reference-counted off-heap buffer memory management, for zero-copy memory sharing and handling memory-mapped files
  • IO interfaces to local and remote filesystems
  • Self-describing binary wire formats (streaming and batch/file-like) for remote procedure calls (RPC) and interprocess communication (IPC)
  • Integration tests for verifying binary compatibility between the implementations (e.g. sending data from Java to C++)
  • Conversions to and from other in-memory data structures
  • Readers and writers for various widely-used file formats (such as Parquet, CSV)

Implementation status

The official Arrow libraries in this repository are in different stages of implementing the Arrow format and related features. See our current feature matrix on git master.

How to Contribute

Please read our latest project contribution guide.

Getting involved

Even if you do not plan to contribute to Apache Arrow itself or Arrow integrations in other projects, we'd be happy to have you involved: