Google Git
Sign in
apache / arrow / 24a39dcad4c9854dceb58c67f23675cad0207c2a
commit24a39dcad4c9854dceb58c67f23675cad0207c2a[log] [tgz]
authorliyafan82 <fan_li_ya@foxmail.com>Thu Jan 23 22:01:14 2020 -0800
committerMicah Kornfield <emkornfield@gmail.com>Thu Jan 23 22:01:14 2020 -0800
tree04d30dc6eab67232d8e7c0adc61111e6821153df
parent9e0f76a6674e8583d84fcb34574b0a19585956a7 [diff]
ARROW-6352: [Java] Add implementation of DenseUnionVector

Today only Sparse unions are supported.  We should have a dense union implementation vector that conforms to the IPC protocol (the current sparse union vector doesn't do this and there are other JIRAs covering making it compatible).

Closes #5473 from liyafan82/fly_0923_union and squashes the following commits:

47b31e778 <liyafan82>  Resolve comments
d95288039 <liyafan82>  Support multiple vectors for each vector type
95c8afb6f <liyafan82>  Support isNull with validity buffer of underlying vectors
fdf9f3a65 <liyafan82>  Support type id with byte
86e92dc6d <liyafan82>  Support arbitrary relative type
1d52a6aac <liyafan82>  Replace release method with close method
afd919925 <liyafan82>  Separate implementations for UnionVector and DenseUnionVector
b1cf2bbe7 <liyafan82>  Add implementation of DenseUnionVector

Authored-by: liyafan82 <fan_li_ya@foxmail.com>
Signed-off-by: Micah Kornfield <emkornfield@gmail.com>
11 files changed
tree: 04d30dc6eab67232d8e7c0adc61111e6821153df
  1. .github/
  2. c_glib/
  3. ci/
  4. cpp/
  5. csharp/
  6. dev/
  7. docs/
  8. format/
  9. go/
  10. integration/
  11. java/
  12. js/
  13. matlab/
  14. python/
  15. r/
  16. ruby/
  17. rust/
  18. testing
  19. .clang-format
  20. .clang-tidy
  21. .clang-tidy-ignore
  22. .dir-locals.el
  23. .dockerignore
  24. .env
  25. .gitattributes
  26. .gitignore
  27. .gitmodules
  28. .hadolint.yaml
  29. .pre-commit-config.yaml
  30. .readthedocs.yml
  31. appveyor.yml
  32. CHANGELOG.md
  33. cmake-format.py
  34. CODE_OF_CONDUCT.md
  35. CONTRIBUTING.md
  36. docker-compose.yml
  37. header
  38. LICENSE.txt
  39. Makefile.docker
  40. NOTICE.txt
  41. README.md
  42. run-cmake-format.py
README.md

Apache Arrow

Build Status Coverage Status Fuzzit Status License Twitter Follow

Powering In-Memory Analytics

Apache Arrow is a development platform for in-memory analytics. It contains a set of technologies that enable big data systems to process and move data fast.

Major components of the project include:

Arrow is an Apache Software Foundation project. Learn more at arrow.apache.org.

What's in the Arrow libraries?

The reference Arrow libraries contain a number of distinct software components:

  • Columnar vector and table-like containers (similar to data frames) supporting flat or nested types
  • Fast, language agnostic metadata messaging layer (using Google's Flatbuffers library)
  • Reference-counted off-heap buffer memory management, for zero-copy memory sharing and handling memory-mapped files
  • IO interfaces to local and remote filesystems
  • Self-describing binary wire formats (streaming and batch/file-like) for remote procedure calls (RPC) and interprocess communication (IPC)
  • Integration tests for verifying binary compatibility between the implementations (e.g. sending data from Java to C++)
  • Conversions to and from other in-memory data structures

How to Contribute

Please read our latest project contribution guide.

Getting involved

Even if you do not plan to contribute to Apache Arrow itself or Arrow integrations in other projects, we'd be happy to have you involved: