Changelog

19.0.0 (2022-07-22)

Full Changelog

Breaking changes:

• Rename DecimalArray``/DecimalBuilder to Decimal128Array/Decimal128Builder #2101 [arrow]
• Change builder append methods to be infallible where possible #2103 [parquet] [arrow] (jhorstmann)
• Return reference from UnionArray::child (#2035) #2099 [arrow] (tustvold)
• Remove preserve_order feature from serde_json dependency (#2095) #2098 [parquet] [arrow] (tustvold)
• Rename weekday and weekday0 kernels to to num_days_from_monday and num_days_since_sunday #2066 [arrow] (alamb)
• Remove null_count from write_batch_with_statistics #2047 [parquet] (tustvold)

Implemented enhancements:

• Use total_cmp from std #2130 [arrow]
• Permit parallel fetching of column chunks in ParquetRecordBatchStream #2110 [parquet]
• The GenericBinaryBuilder should use buffer builders directly. #2104 [arrow]
• Pass generate_decimal256_case arrow integration test #2093 [arrow]
• Rename weekday and weekday0 kernels to to num_days_from_monday and days_since_sunday #2065 [arrow]
• Improve performance of filter_dict #2062 [arrow]
• Improve performance of set_bits #2060 [arrow]
• Lazily materialize the null buffer builder of BooleanBuilder #2058 [arrow]
• BooleanArray::from_iter should omit validity buffer if all values are valid #2055 [arrow]
• FFI_ArrowSchema should set DICTIONARY_ORDERED flag if a field's dictionary is ordered #2049 [arrow]
• Support peek_next_page() and skip_next_page in SerializedPageReader #2043 [parquet]
• Support FFI / C Data Interface for MapType #2037 [arrow]
• The DecimalArrayBuilder should use FixedSizedBinaryBuilder #2026 [arrow]
• Enable serialized_reader read specific Page by passing row ranges. #1976 [parquet]

Fixed bugs:

• type_id and value_offset are incorrect for sliced UnionArray #2086 [arrow]
• Boolean take kernel does not handle null indices correctly #2057 [arrow]
• Don't double-count nulls in write_batch_with_statistics #2046 [parquet]
• Parquet Writer Ignores Statistics specification in WriterProperties #2014 [parquet]

Documentation updates:

• Improve docstrings + examples for as_primitive_array cast functions #2114 [arrow] (alamb)

Closed issues:

• Why does serde_json specify the preserve_order feature in arrow package #2095 [arrow]
• Support skip_values in DictionaryDecoder #2079 [parquet]
• Support skip_values in ColumnValueDecoderImpl #2078 [parquet]
• Support skip_values in ByteArrayColumnValueDecoder #2072 [parquet]
• Several Builder::append methods returning results even though they are infallible #2071
• Improve formatting of logical plans containing subqueries #2059
• Return reference from UnionArray::child #2035
• support write page index #1777 [parquet]

Merged pull requests:

• Use total_cmp from std #2131 [arrow] (Dandandan)
• fix clippy #2124 (alamb)
• Fix logical merge conflict: match arms have incompatible types #2121 (alamb)
• Update GenericBinaryBuilder to use buffer builders directly. #2117 [arrow] (HaoYang670)
• Simplify null mask preservation in parquet reader #2116 [parquet] (tustvold)
• Add get_byte_ranges method to AsyncFileReader trait #2115 [parquet] (thinkharderdev)
• add test for skip_values in DictionaryDecoder and fix it #2105 [parquet] (Ted-Jiang)
• Define Decimal128Builder and Decimal128Array #2102 [parquet] [arrow] (viirya)
• Support skip_values in DictionaryDecoder #2100 [parquet] (thinkharderdev)
• Pass generate_decimal256_case integration test, add DataType::Decimal256 #2094 [parquet] [arrow] (viirya)
• DecimalBuilder should use FixedSizeBinaryBuilder #2092 [arrow] (HaoYang670)
• Array writer indirection #2091 [parquet] (tustvold)
• Remove doc hidden from GenericColumnReader #2090 [parquet] (tustvold)
• Support skip_values in ColumnValueDecoderImpl #2089 [parquet] (thinkharderdev)
• type_id and value_offset are incorrect for sliced UnionArray #2087 [arrow] (viirya)
• Add IPC truncation test case for StructArray #2083 [arrow] (viirya)
• Improve performance of set_bits by using copy_from_slice instead of setting individual bytes #2077 [arrow] (jhorstmann)
• Support skip_values in ByteArrayColumnValueDecoder #2076 [parquet] (Ted-Jiang)
• Lazily materialize the null buffer builder of boolean builder #2073 [arrow] (HaoYang670)
• Fix windows CI (#2069) #2070 (tustvold)
• Test utf8_validation checks char boundaries #2068 [arrow] (tustvold)
• feat(compute): Support doy (day of year) for temporal #2067 [arrow] (ovr)
• Support nullable indices in boolean take kernel and some optimizations #2064 [arrow] (jhorstmann)
• Improve performance of filter_dict #2063 [arrow] (viirya)
• Ignore null buffer when creating ArrayData if null count is zero #2056 [arrow] (jhorstmann)
• feat(compute): Support week0 (PostgreSQL behaviour) for temporal #2052 [arrow] (ovr)
• Set DICTIONARY_ORDERED flag for FFI_ArrowSchema #2050 [arrow] (viirya)
• Generify parquet write path (#1764) #2045 [parquet] (tustvold)
• Support peek_next_page() and skip_next_page in serialized_reader. #2044 [parquet] (Ted-Jiang)
• Support MapType in FFI #2042 [arrow] (viirya)
• Add support of converting FixedSizeBinaryArray to DecimalArray #2041 [arrow] (HaoYang670)
• Truncate IPC record batch #2040 [arrow] (viirya)
• Refine the List builder #2034 [arrow] (HaoYang670)
• Add more tests of RecordReader Batch Size Edge Cases (#2025) #2032 [parquet] (tustvold)
• Add support for adding intervals to dates #2031 [arrow] (avantgardnerio)

* This Changelog was automatically generated by github_changelog_generator