tree 52387a14ac48fbc0226c9abbdc5fa9a33ea460f4
parent 6f3f909ef410852713cc3865aa72e65eb21f9323
author emkornfield <emkornfield@gmail.com> 1699994903 -0800
committer GitHub <noreply@github.com> 1699994903 -0800
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJlU90XCRBK7hj4Ov3rIwAAymcIAHvcjuip/Z5YaAxuOjz2ECnA
 EBGigIB6xCWfnjxhjgNd+o5voWanuFdcs4y3iPWzvsQOWERzkzICrmAV0BDGVjts
 XnmSjvhtVxjQwcybu/X/gJgxWtDI8dK7wmbSi7lQxMd0fPa9BPLsN3yBw+/8gFAN
 MH62kM5JDanr4c/NO4RXywPoQNEWcER25HhoThs3puD6YKXQ5mRx4/9MF+KWpVf+
 tPecz3KX9NfmUUBSXBA2+kFRpRcRZ+yKo9sSYUmJyYKhrxjn+LaXUe1edKxVHdkf
 mJxOi+TiXpxpyRnFvH3OFpfhdVb7uBZxYJix9ckYH1tPR7zllES+/NST438thhk=
 =WcwA
 -----END PGP SIGNATURE-----
 

PARQUET-2261: add statistics for better estimating unencoded/uncompressed sizes and finer grained filtering (#197)

Adds histograms of repetition/definition level and unencoded byte_array sizes to column chunks and to page indices.

---------

Co-authored-by: Gang Wu <ustcwg@gmail.com>
Co-authored-by: Gabor Szadovszky <gabor@apache.org>
Co-authored-by: Antoine Pitrou <pitrou@free.fr>
Co-authored-by: mwish <1506118561@qq.com>
Co-authored-by: JFinis <jan_finis@gmx.de>