[Diff since v2.2.0](https://github.com/apache/arrow-julia/compare/v2.2.0...v2.2.1)

**Closed issues:**
- memory not freed reading python exported compressed feather format  (#93)
- error when metadata is present but empty? (#253)
- `pyarrow` unable to load Arrow data written by `Arrow.jl` (#261)
- Support for Decimal (#264)
- Transfer repository to apache organization (#265)
- Error with Julia 1.7.0 (#269)
- Add GitHub Actions used in this repository to allow list (#273)
- Future of the Julia arrow implementation (#284)
- Check license automatically (#286)
- Implement release script (#287)
- Implement release verification script (#288)
- Release script publishes the artifacts to wrong URL (#301)

**Merged pull requests:**
- Remove use of symlinks in CI matrix (#256) (@omus)
- Proposal: change `@scopedenum` to make modules to avoid type piracy (#267) (@NHDaly)
- Configure repository metadata (#272) (@kou)
- Send issue comments notification to github@arrow.apache.org (#274) (@kou)
- Fix case where metadata is provided but empty (#276) (@quinnj)
- Introduce Release audit tool (Rat) (#289) (@kou)
- Add release scripts (#290) (@kou)
- Add verification script (#292) (@kou)
- Bump version for release (#299) (@quinnj)
- Fix wrong release artifacts URL (#302) (@kou)
Fix wrong release artifacts URL (#302)

fix #301

We should not add "apache-" prefix in
https://dist.apache.org/repos/dist/release/arrow/ because other
releases don't have "apache-" prefix.
1 file changed
tree: 85013d248b128cf13ae62c827c4bf05872e97f78
  1. .github/
  2. dev/
  3. docs/
  4. src/
  5. test/
  6. .asf.yaml
  7. .gitignore
  8. codecov.yaml
  9. LICENSE
  10. Project.toml
  11. README.md
README.md

Arrow

docs CI codecov

deps version pkgeval

This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code.

Please see this document for a description of the Arrow memory layout.

Installation

The package can be installed by typing in the following in a Julia REPL:

julia> using Pkg; Pkg.add("Arrow")

or to use the official-apache code that follows the official apache release process, you can do:

julia> using Pkg; Pkg.add(url="https://github.com/apache/arrow", subdir="julia/Arrow.jl")

Local Development

When developing on Arrow.jl it is recommended that you run the following to ensure that any changes to ArrowTypes.jl are immediately available to Arrow.jl without requiring a release:

julia --project -e 'using Pkg; Pkg.develop(path="src/ArrowTypes")'

Difference between this code and the apache/arrow/julia/Arrow repository

The code in the apache/arrow repository is officially part of the apache/arrow project and as such follows the regulated release cadence of the entire project, following standard community voting protocols. The JuliaData/Arrow.jl repository can be viewed as a sort of “dev” or “latest” branch of this code that may release more frequently, but without following official apache release guidelines. The two repositories are synced, however, so any bugfix patches in JuliaData will be upstreamed to apache/arrow for each release.

Format Support

This implementation supports the 1.0 version of the specification, including support for:

  • All primitive data types
  • All nested data types
  • Dictionary encodings and messages
  • Extension types
  • Streaming, file, record batch, and replacement and isdelta dictionary messages

It currently doesn't include support for:

  • Tensors or sparse tensors
  • Flight RPC
  • C data interface

Third-party data formats:

See the full documentation for details on reading and writing arrow data.