tag | 44578440a1e3b869097a6b2b36e5e5a7b662c9fc | |
---|---|---|
tagger | Sutou Kouhei <kou@clear-code.com> | Tue May 07 07:05:27 2024 +0900 |
object | 64fc730f767de84835a5f1b4fc9b7831a3c2d15b |
2.7.2 RC1
commit | 64fc730f767de84835a5f1b4fc9b7831a3c2d15b | [log] [tgz] |
---|---|---|
author | Romain Poncet <romain.pct@gmail.com> | Sun May 05 20:07:12 2024 +0100 |
committer | GitHub <noreply@github.com> | Sun May 05 15:07:12 2024 -0400 |
tree | f8d411d1b45459368567dc51f683ed78a919d795 | |
parent | ac199b0e377502ea0f1fa5ced7fda897a01b82a9 [diff] |
Compatibility of schemas with nested types (#504) Hi, Here is a minimal example of the issue I've encountered. ```julia struct A x::Int end struct B a::A end v = [B(A(i)) for i =1:3] io = IOBuffer() Arrow.write(io, v; file=false) seekstart(io) Arrow.append(io, v) # throws ``` I don't know if this is really necessary, or if I'm not using this library properly, but this issue makes it difficult to append to arrow files with nested types. Since I've only added more cases where the call to `append` can succeed, I do not think that this creates retro-compatibility issues. Thanks for the review! --------- Co-authored-by: Ben Baumgold <4933671+baumgold@users.noreply.github.com>
This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector
objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code.
Please see this document for a description of the Arrow memory layout.
The package can be installed by typing in the following in a Julia REPL:
julia> using Pkg; Pkg.add("Arrow")
When developing on Arrow.jl it is recommended that you run the following to ensure that any changes to ArrowTypes.jl are immediately available to Arrow.jl without requiring a release:
julia --project -e 'using Pkg; Pkg.develop(path="src/ArrowTypes")'
This implementation supports the 1.0 version of the specification, including support for:
It currently doesn't include support for:
Third-party data formats:
See the full documentation for details on reading and writing arrow data.