tree 051993b9662d31e9f5edb4727ba0850026235bbc
parent 6ab16f3ae8e4a76ea28a704d88267bb342ba407b
author Wes McKinney <wes.mckinney@twosigma.com> 1513509207 +0100
committer Uwe L. Korn <uwe@apache.org> 1513509207 +0100

PARQUET-1092: Support writing chunked arrow::Table columns

I did quite a bit of refactoring to make this easier / simpler. I think there's some additional work we could do to make the write-path code cleaner, but we should probably wait to do some of that until we implement complete nested data write and read.

I will follow up shortly with some functional tests for ARROW-232 to make sure this works end-to-end on the pyarrow side.

Author: Wes McKinney <wes.mckinney@twosigma.com>

Closes #426 from wesm/PARQUET-1092 and squashes the following commits:

7aa3fab [Wes McKinney] Fix compiler warnings
a72ad12 [Wes McKinney] Test and fix bugs with chunked writes. Ensure that primitive types use right transfer functor on read path
c5006cb [Wes McKinney] Fix and expand date64->date32 conversion unit test
61e364c [Wes McKinney] Compiling again with test failure
c7e6696 [Wes McKinney] More refactoring, chunked writes
9f35818 [Wes McKinney] More refactoring
3e297cc [Wes McKinney] Start refactoring, totally broken