Google Git
Sign in
apache / arrow-julia / refs/tags/v1.5.0
tag176856803ae94c64c6e081ae796c2ccc798ab5df
taggergithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>Mon May 31 19:08:21 2021 +0000
object4bc1256309ddea68f208a24e06e5d7b0f4967376 
## Arrow v1.5.0

[Diff since v1.4.1](https://github.com/JuliaData/Arrow.jl/compare/v1.4.1...v1.5.0)


**Closed issues:**
- Better fallback when registered types don't match (#133)
- Issue with `Tables.rowtable` when entries contain a vector of strings (#167)
- VersionNumbers don't serialize (#200)
- Error in "arrow json integration tests" (#202)
- Automated conversion fails for `Date{MILLISECOND, Int64}` (#206)

**Merged pull requests:**
- Ensure requested List type is requested on List getindex (#182) (@quinnj)
- Add global metadata lock to ensure thread safety of global metadata (#183) (@quinnj)
- Handle empty tuple (#201) (@omus)
- Support `VersionNumber` (#205) (@omus)
- support Date with type parameter ms (#207) (@piever)
- bump Project.toml from v1.4.1 to v1.5.0 (#208) (@jrevels)
commit4bc1256309ddea68f208a24e06e5d7b0f4967376[log] [tgz]
authorJarrett Revels <jarrettrevels@gmail.com>Mon May 31 14:51:50 2021 -0400
committerGitHub <noreply@github.com>Mon May 31 14:51:50 2021 -0400
tree228562b4e3156212a1085cc580af18edbe53abdd
parentd3b32ea1d276ab95ecc971f070e1a491f74fd8e9 [diff]
bump Project.toml from v1.4.1 to v1.5.0 (#208)
1 file changed
tree: 228562b4e3156212a1085cc580af18edbe53abdd
  1. .github/
  2. docs/
  3. scripts/
  4. src/
  5. test/
  6. .gitignore
  7. LICENSE.md
  8. Project.toml
  9. README.md
README.md

Arrow

docs CI codecov

deps version pkgeval

This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code.

Please see this document for a description of the Arrow memory layout.

Installation

The package can be installed by typing in the following in a Julia REPL:

julia> using Pkg; Pkg.add("Arrow")

or to use the official-apache code that follows the official apache release process, you can do:

julia> using Pkg; Pkg.add(url="https://github.com/apache/arrow", subdir="julia/Arrow.jl")

Difference between this code and the apache/arrow/julia/Arrow repository

The code in the apache/arrow repository is officially part of the apache/arrow project and as such follows the regulated release cadence of the entire project, following standard community voting protocols. The JuliaData/Arrow.jl repository can be viewed as a sort of “dev” or “latest” branch of this code that may release more frequently, but without following official apache release guidelines. The two repositories are synced, however, so any bugfix patches in JuliaData will be upstreamed to apache/arrow for each release.

Format Support

This implementation supports the 1.0 version of the specification, including support for:

  • All primitive data types
  • All nested data types
  • Dictionary encodings and messages
  • Extension types
  • Streaming, file, record batch, and replacement and isdelta dictionary messages

It currently doesn't include support for:

  • Tensors or sparse tensors
  • Flight RPC
  • C data interface

Third-party data formats:

  • csv and parquet support via the existing CSV.jl and Parquet.jl packages
  • Other Tables.jl-compatible packages automatically supported (DataFrames.jl, JSONTables.jl, JuliaDB.jl, SQLite.jl, MySQL.jl, JDBC.jl, ODBC.jl, XLSX.jl, etc.)
  • No current Julia packages support ORC or Avro data formats

See the full documentation for details on reading and writing arrow data.