Google Git
Sign in
apache / arrow-rs / refs/tags/4.0.0
commit50bdaa58cc3837b03d38dd7b7378c70f8554a9cb[log] [tgz]
authorRaphael Taylor-Davies <r.taylordavies@googlemail.com>Sun Apr 18 06:52:52 2021 -0400
committerAndrew Lamb <andrew@nerdnetworks.org>Sun Apr 18 06:52:52 2021 -0400
treeac7da136a21b318521a0cc22b2a8ad1286944545
parente0edc954bdeee4d09b8e0c4be83754994fed1b2b [diff]
ARROW-12425: [Rust] Fix new_null_array dictionary creation

It is my understanding that an arrow array should always have a backing values array, even if the content is all nulls. new_null_array currently violates this as it doesn't allocate the backing store for DictionaryArrays. This causes the concat kernel, and possibly others, to panic with index violations

Signed-off-by: Raphael Taylor-Davies <r.taylordavies@googlemail.com>

Closes #10072 from tustvold/null-dictionary-creation

Authored-by: Raphael Taylor-Davies <r.taylordavies@googlemail.com>
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
1 file changed
tree: ac7da136a21b318521a0cc22b2a8ad1286944545
  1. .github/
  2. ci/
  3. dev/
  4. format/
  5. rust/
  6. testing
  7. .asf.yaml
  8. .clang-format
  9. .clang-tidy
  10. .clang-tidy-ignore
  11. .dir-locals.el
  12. .dockerignore
  13. .env
  14. .gitattributes
  15. .gitignore
  16. .gitmodules
  17. .hadolint.yaml
  18. .pre-commit-config.yaml
  19. .readthedocs.yml
  20. .travis.yml
  21. appveyor.yml
  22. CHANGELOG.md
  23. cmake-format.py
  24. CODE_OF_CONDUCT.md
  25. CONTRIBUTING.md
  26. docker-compose.yml
  27. header
  28. LICENSE.txt
  29. NOTICE.txt
  30. README.md
  31. run-cmake-format.py
README.md

Apache Arrow

Build Status Coverage Status Fuzzing Status License Twitter Follow

Powering In-Memory Analytics

Apache Arrow is a development platform for in-memory analytics. It contains a set of technologies that enable big data systems to process and move data fast.

Major components of the project include:

Arrow is an Apache Software Foundation project. Learn more at arrow.apache.org.

What's in the Arrow libraries?

The reference Arrow libraries contain many distinct software components:

  • Columnar vector and table-like containers (similar to data frames) supporting flat or nested types
  • Fast, language agnostic metadata messaging layer (using Google's Flatbuffers library)
  • Reference-counted off-heap buffer memory management, for zero-copy memory sharing and handling memory-mapped files
  • IO interfaces to local and remote filesystems
  • Self-describing binary wire formats (streaming and batch/file-like) for remote procedure calls (RPC) and interprocess communication (IPC)
  • Integration tests for verifying binary compatibility between the implementations (e.g. sending data from Java to C++)
  • Conversions to and from other in-memory data structures
  • Readers and writers for various widely-used file formats (such as Parquet, CSV)

Implementation status

The official Arrow libraries in this repository are in different stages of implementing the Arrow format and related features. See our current feature matrix on git master.

How to Contribute

Please read our latest project contribution guide.

Getting involved

Even if you do not plan to contribute to Apache Arrow itself or Arrow integrations in other projects, we'd be happy to have you involved: