feat(arrow): support schema evolution read with SchemaManager and field-ID-based index mapping
Introduce SchemaManager to load versioned schema files (schema/schema-{id})
and use field-ID-based index mapping (aligned with Java Paimon's
SchemaEvolutionUtil) for reading data files written under older schemas.
This supports add-column (null fill) and type promotion (cast) scenarios.
Also align paimon_type_to_arrow with Python's from_paimon_type:
- TIME always maps to Time32(Millisecond)
- TIMESTAMP precision 0 maps to Second
- Add nested type support: Array, Map, Multiset, Row
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
The rust implementation of Apache Paimon.
See Tracking issues of 0.1.0 version for Apache Paimon Rust
Apache Paimon Rust is an exciting project currently under active development. Whether you're looking to use it in your projects or contribute to its growth, there are several ways you can get involved:
The project documentation is built with MkDocs. See docs/README.md for details.
pip3 install mkdocs-material cd docs && mkdocs serve
Submit issues for bug report or asking questions in discussion.
Licensed under Apache License, Version 2.0.