Google Git
Sign in
apache/paimon-cpp/refs/heads/release-0.3
commit
efbfc848f8ce3d1d7a4df617a4ff1d0b17207d9b
[log]
author
Zhou Hongfeng <87103887+zhf999@users.noreply.github.com>
Wed Aug 05 19:50:48 2026 +0800
committer
Nicholas Jiang <programgeek@163.com>
Wed Aug 05 19:59:33 2026 +0800
tree
dad938797d1920f1d8111e66d3052abb792cd535
parent
794d39475677fada444d38f908511c0f4a83d75c [diff]
fix(parquet): avoid seeking into the middle of a row group when prefetch and page index filtering are both enabled (#185)

* test: add test cases to show problem

* fix: avoid seek to the middle of a RowGroup when reading a parquet with prefetch=on and page-inex-filter=on

* test: update test cases

* fix: partially-matched path do not push next_row_to_read

* test: update test comments and enable multi-thread reading

* style: update comments

* clang-format
5 files changed
tree: dad938797d1920f1d8111e66d3052abb792cd535
  1. .devcontainer/
  2. .github/
  3. apidoc/
  4. benchmark/
  5. build_support/
  6. ci/
  7. cmake_modules/
  8. crates/
  9. docs/
  10. examples/
  11. include/
  12. licenses/
  13. scripts/
  14. src/
  15. test/
  16. third_party/
  17. CLAUDE.md ⇨ AGENTS.md
  18. .asf.yaml
  19. .clang-format
  20. .clang-tidy
  21. .cmake-format.py
  22. .codespell_ignore
  23. .gitattributes
  24. .gitignore
  25. .pre-commit-config.yaml
  26. AGENTS.md
  27. build_and_package.sh
  28. CMakeLists.txt
  29. CONTRIBUTING.md
  30. LICENSE
  31. NOTICE
  32. PaimonConfig.cmake.in
  33. README.md
README.md

Apache Paimon C++

License

Paimon C++ is the C++ implementation of Apache Paimon. It provides native, high-performance, and extensible access to the Paimon lake format for C++ engines and services without JVM dependencies.

Background and documentation are available at paimon.apache.org.

Features

Paimon C++ currently provides:

  • Write: append table and primary key table write support with compaction.
  • Commit: append table commit support for simple append-only tables.
  • Scan: batch and stream scan for append tables and primary key tables without changelog.
  • Read: append table read, primary key table read with deletion vector, and primary key table merge-on-read.
  • Arrow integration: batch read and write interfaces based on the Arrow Columnar In-Memory Format.
  • File systems: file system abstraction with built-in local and Jindo file system support.
  • File formats: file format abstraction with built-in ORC, Parquet, and Avro support.
  • Runtime utilities: memory pool and thread pool abstractions with default implementations.
  • AI-Oriented Features: supports RowTracking and DataEvolution mode and provides Global Index capabilities including B-tree index, DiskANN-based vector search with Lumina, and Lucene-based full-text search.
  • Compatibility: compatibility with Apache Paimon Java format and communication protocols, including commit messages, data splits, and manifests.

Bitmap global index compatibility: Java Paimon now uses a dedicated bitmap global index format instead of the previously shared wrapped bitmap file index format. Paimon C++ therefore currently treats the bitmap global index type as unsupported. The legacy implementation remains in the codebase pending migration to the Java-compatible format.

Note: Only Linux x86_64 builds are currently supported and verified.

Building

git clone https://github.com/apache/paimon-cpp.git
cd paimon-cpp

Build with CMake:

cmake -B build
cmake --build build

Dev Containers

We provide Dev Container configuration file templates.

To use a Dev Container as your development environment, follow the steps below, then select Dev Containers: Reopen in Container from VS Code's Command Palette.

cd .devcontainer
cp Dockerfile.template Dockerfile
cp devcontainer.json.template devcontainer.json

Collaboration

Paimon C++ is an active open-source project and we welcome people who want to contribute or share good ideas! Before contributing, please read the Contributing Guide and the Code Style Guide. You are encouraged to check out our documentation.

License

This project is licensed under the Apache License 2.0.