Google Git
Sign in
apache/paimon-cpp/131b0921663a2f7384b863124657a9fcfc0f6f21
commit
131b0921663a2f7384b863124657a9fcfc0f6f21
[log]
author
Zhang Jiawei <30893610+zjw1111@users.noreply.github.com>
Thu Jul 23 14:01:55 2026 +0800
committer
GitHub <noreply@github.com>
Thu Jul 23 14:01:55 2026 +0800
tree
e9638063b75828694dcb68a53df7582d0db82d87
parent
2e94a8f2f4e2700051f3808c60f39d92fb8e6832 [diff]
fix: sync missing changes after repository migration (#154)

* fix(build): make package config relocatable (#306)

* fix: fix thread-safe problem for file store path factory (#323)

* feat(lumina): support null values in vector column during index building (#310)

* feat: add CreateReader api with field_name & index_type (#391)

* test: add tests for executor (#396)

* fix: fix IsThreadSafe() in UnionGlobalIndexReader (#395)

* fix: release global index writer before reader to avoid mem issue when write index failed (#398)

* fix: complete undefined shift fixes from #308

Migrate the two remaining hunks from alibaba/paimon-cpp@620adbe3590d4fea2c9835eebc5bb66fe41eb633; the other hunks are already present in Apache.

* chore: remove remaining Lance references

* feat: remove support for FLOAT/DOUBLE type partition field (#333)

* refactor: remove unused path-based reader builder

---------

Co-authored-by: Yonghao Fang <yonghao.fyh@alibaba-inc.com>
Co-authored-by: lxy <38709059+lxy-9602@users.noreply.github.com>
Co-authored-by: lszskye <57179283+lszskye@users.noreply.github.com>
51 files changed
tree: e9638063b75828694dcb68a53df7582d0db82d87
  1. .devcontainer/
  2. .github/
  3. apidoc/
  4. build_support/
  5. ci/
  6. cmake_modules/
  7. docs/
  8. examples/
  9. include/
  10. licenses/
  11. src/
  12. test/
  13. third_party/
  14. .asf.yaml
  15. .clang-format
  16. .clang-tidy
  17. .cmake-format.py
  18. .codespell_ignore
  19. .gitignore
  20. .pre-commit-config.yaml
  21. build_and_package.sh
  22. CMakeLists.txt
  23. CONTRIBUTING.md
  24. LICENSE
  25. NOTICE
  26. PaimonConfig.cmake.in
  27. README.md
README.md

Apache Paimon-cpp

License

Paimon-cpp is the C++ implementation of Apache Paimon. It provides native, high-performance, and extensible access to the Paimon lake format for C++ engines and services without JVM dependencies.

Background and documentation are available at paimon.apache.org.

Status

Paimon-cpp is currently undergoing repository migration. The original repository is hosted at github.com/alibaba/paimon-cpp, and the codebase is being migrated incrementally to the Apache Paimon community repository.

Features

Paimon-cpp currently provides:

  • Write: append table and primary key table write support with compaction.
  • Commit: append table commit support for simple append-only tables.
  • Scan: batch and stream scan for append tables and primary key tables without changelog.
  • Read: append table read, primary key table read with deletion vector, and primary key table merge-on-read.
  • Arrow integration: batch read and write interfaces based on the Arrow Columnar In-Memory Format.
  • File systems: file system abstraction with built-in local and Jindo file system support.
  • File formats: file format abstraction with built-in ORC, Parquet, and Avro support.
  • Runtime utilities: memory pool and thread pool abstractions with default implementations.
  • AI-Oriented Features: supports RowTracking and DataEvolution mode and provides Global Index capabilities including bitmap index, B-tree index, DiskANN-based vector search with Lumina, and Lucene-based full-text search.
  • Compatibility: compatibility with Apache Paimon Java format and communication protocols, including commit messages, data splits, and manifests.

The current implementation supports the x86_64 architecture.

Building

Note: The build system and source files are being migrated incrementally. The instructions below will work once the CMake build files and source code are available in this repository.

If you do not have git-lfs installed, install it first.

git clone https://github.com/apache/paimon-cpp.git
cd paimon-cpp
git lfs pull

Build with CMake:

cmake -B build
cmake --build build

Dev Containers

We provide Dev Container configuration file templates.

To use a Dev Container as your development environment, follow the steps below, then select Dev Containers: Reopen in Container from VS Code's Command Palette.

cd .devcontainer
cp Dockerfile.template Dockerfile
cp devcontainer.json.template devcontainer.json

Collaboration

Paimon-cpp is an active open-source project and we welcome people who want to contribute or share good ideas! Before contributing, please read the Contributing Guide and the Code Style Guide. You are encouraged to check out our documentation.

License

This project is licensed under the Apache License 2.0.