Google Git
Sign in
apache / arrow-julia / refs/tags/v2.8.0
tag1a3a0b562040b752b0203a1793dbbbfc8faa233d
taggergithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>Sun Dec 08 01:28:01 2024 +0000
object2583a66f54ac4087bfe7ae34c1ffbab3cb3c81f6 
[Diff since v2.7.4](https://github.com/apache/arrow-julia/compare/v2.7.4...v2.8.0)

**Merged pull requests:**
- Add reading metadata from Arrow.Table (#481) (@bkamins)
- Start support for ListView, BinaryView, Utf8View, etc. (#512) (@quinnj)
- Bump codecov/codecov-action from 1 to 5 (#531) (@dependabot[bot])
- Make DictEncoding reading threadsafe (#535) (@quinnj)
- Change an info log back to debug (#537) (@quinnj)

**Closed issues:**
- Arrow.jl fails to precompile with error "Magic file identifier "TZjf" not found." (#510)
- Reading multiple file corrupt values and is also order dependent (#534)
commit2583a66f54ac4087bfe7ae34c1ffbab3cb3c81f6[log] [tgz]
authorJacob Quinn <quinn.jacobd@gmail.com>Sat Dec 07 16:53:57 2024 -0700
committerJacob Quinn <quinn.jacobd@gmail.com>Sat Dec 07 16:53:57 2024 -0700
tree00f0b3f05bc33cc5b68db6cc22e4a7b16b65e505
parent76ae99209247043dbc37978f260c5deeb097d691 [diff]
Add compat for StringViews
1 file changed
tree: 00f0b3f05bc33cc5b68db6cc22e4a7b16b65e505
  1. .github/
  2. dev/
  3. docs/
  4. src/
  5. test/
  6. .asf.yaml
  7. .gitignore
  8. .JuliaFormatter.toml
  9. codecov.yaml
  10. LICENSE
  11. Project.toml
  12. README.md
README.md

Arrow

docs CI codecov

deps version pkgeval

This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code.

Please see this document for a description of the Arrow memory layout.

Installation

The package can be installed by typing in the following in a Julia REPL:

julia> using Pkg; Pkg.add("Arrow")

Local Development

When developing on Arrow.jl it is recommended that you run the following to ensure that any changes to ArrowTypes.jl are immediately available to Arrow.jl without requiring a release:

julia --project -e 'using Pkg; Pkg.develop(path="src/ArrowTypes")'

Format Support

This implementation supports the 1.0 version of the specification, including support for:

  • All primitive data types
  • All nested data types
  • Dictionary encodings and messages
  • Extension types
  • Streaming, file, record batch, and replacement and isdelta dictionary messages

It currently doesn't include support for:

  • Tensors or sparse tensors
  • Flight RPC
  • C data interface

Third-party data formats:

See the full documentation for details on reading and writing arrow data.