| commit | c33a8186d1f5f3972483c87ab9307afb58d936db | [log] [tgz] |
|---|---|---|
| author | Jacob Quinn <quinn.jacobd@gmail.com> | Thu Nov 19 10:36:57 2020 -0700 |
| committer | GitHub <noreply@github.com> | Thu Nov 19 10:36:57 2020 -0700 |
| tree | 7121a95dfe343a176ae457b2eec281915dc3ea2e | |
| parent | 73e08dbc8e1cfa7e1fc8bbc9938d0a3660ce2b45 [diff] |
Check field nullability for custom extension types (#69)
For custom extension types (currently automatically supported for `Char`
and `Symbol` types), we were failing to take into account whether the
field was nullable or not; this led to the case where a column might be
`['a', missing]`, but when deserializing, the column type was just
`Char` instead of `Union{Char, Missing}`. The fix is to enhance the
`ArrowTypes.extensiontype` function to also take the `field` argument
and check the nullability before returning.
This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code.
Please see this document for a description of the Arrow memory layout.
This implementation supports the 1.0 version of the specification, including support for:
It currently doesn't include support for:
Third-party data formats:
See the full documentation for details on reading and writing arrow data.