Release v0.4.0
chore: bump avro to 209a373 to preserve adjust-to-utc on primitives (#954) Move the avro-cpp pin from 997d50d to 209a373 (current main, 74 commits). The C++ changes in the range are a std::formatter fix for C++23 builds (#3815), a JSON decoder fix for the lone low surrogate U+DFFF (#3841), and AVRO-4351, which makes avro-cpp keep custom attributes on primitive schema nodes when parsing and printing schema JSON. AVRO-4351 is what matters here. `GetAdjustToUtc()` reads "adjust-to-utc" off the primitive node, and the reader takes its file schema from the Avro file header. With the old pin the attribute was dropped both when the writer printed the header and when the reader parsed it, so every timestamp read from a file looked like it had no timezone and projecting a `timestamptz` or `timestamptz_ns` column out of an Avro file failed with "Cannot read Iceberg type". No test wrote and re-read a timestamptz column through a real file, so this went unnoticed. Add schema-level projection tests that parse "adjust-to-utc" from JSON, and file-level round trips that write timestamptz columns, assert the attribute is present in the physical file schema, and read them back. All of them fail on the old pin and pass on the new one. Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
C++ implementation of Apache Iceberg™.
Required:
Optional:
git clone https://github.com/apache/iceberg-cpp.git cd iceberg-cpp cmake -S . -B build -G Ninja cmake --build build ctest --test-dir build --output-on-failure
cmake -S . -B build -G Ninja -DCMAKE_INSTALL_PREFIX=/path/to/install -DICEBERG_BUILD_STATIC=ON -DICEBERG_BUILD_SHARED=ON cmake --build build ctest --test-dir build --output-on-failure cmake --install build
To run a specific test suite:
ctest --test-dir build -R schema_test --output-on-failure
cmake -S . -B build -G Ninja -DCMAKE_INSTALL_PREFIX=/path/to/install -DICEBERG_BUILD_BUNDLE=ON cmake --build build ctest --test-dir build --output-on-failure cmake --install build
cmake -S . -B build -G Ninja -DCMAKE_INSTALL_PREFIX=/path/to/install -DCMAKE_PREFIX_PATH=/path/to/arrow -DICEBERG_BUILD_BUNDLE=ON cmake --build build ctest --test-dir build --output-on-failure cmake --install build
| Option | Default | Description |
|---|---|---|
ICEBERG_BUILD_STATIC | ON | Build static library |
ICEBERG_BUILD_SHARED | OFF | Build shared library |
ICEBERG_BUILD_TESTS | ON | Build tests |
ICEBERG_BUILD_BUNDLE | ON | Build the battery-included library |
ICEBERG_BUILD_REST | ON | Build REST catalog client |
ICEBERG_BUILD_REST_INTEGRATION_TESTS | OFF | Build REST catalog integration tests |
ICEBERG_SPDLOG | ON | Use spdlog as the default logging backend |
ICEBERG_BUILD_HIVE | OFF | Build Hive (HMS) catalog client |
ICEBERG_BUILD_SQL_CATALOG | OFF | Build SQL catalog client |
ICEBERG_SQL_SQLITE | OFF | Build the SQLite connector for the SQL catalog |
ICEBERG_SQL_POSTGRESQL | OFF | Build the PostgreSQL connector for the SQL catalog |
ICEBERG_SQL_MYSQL | OFF | Build the MySQL connector for the SQL catalog |
ICEBERG_ENABLE_ASAN | OFF | Enable Address Sanitizer |
ICEBERG_ENABLE_UBSAN | OFF | Enable Undefined Behavior Sanitizer |
After installing the core libraries, you can build the examples:
cd example cmake -S . -B build -G Ninja -DCMAKE_PREFIX_PATH=/path/to/install cmake --build build
If you are using provided Apache Arrow, include /path/to/arrow in CMAKE_PREFIX_PATH:
cmake -S . -B build -G Ninja -DCMAKE_PREFIX_PATH="/path/to/install;/path/to/arrow"
If you experience network issues when downloading dependencies, you can customize the download URLs using environment variables:
ICEBERG_ARROW_URL: Apache Arrow tarball URLICEBERG_AVRO_URL: Apache Avro tarball URLICEBERG_AVRO_GIT_URL: Apache Avro git repository URLICEBERG_NANOARROW_URL: Nanoarrow tarball URLICEBERG_CROARING_URL: CRoaring tarball URLICEBERG_UTF8PROC_URL: utf8proc tarball URLICEBERG_NLOHMANN_JSON_URL: nlohmann-json tarball URLICEBERG_SPDLOG_URL: spdlog tarball URLICEBERG_CPR_URL: cpr tarball URLExample:
export ICEBERG_ARROW_URL="https://your-mirror.com/apache-arrow-22.0.0.tar.gz" cmake -S . -B build
Apache Iceberg is an active open-source project, governed under the Apache Software Foundation (ASF). Iceberg-cpp is open to people who want to contribute to it. Here are some ways to get involved:
The Apache Iceberg community is built on the principles described in the Apache Way and all who engage with the community are expected to be respectful, open, come with the best interests of the community in mind, and abide by the Apache Foundation Code of Conduct.
In addition, contributors using AI-assisted tools must follow the documented guidelines for AI-assisted contributions available on the Iceberg website: https://iceberg.apache.org/contribute/#guidelines-for-ai-assisted-contributions.
Install the python package pre-commit and run once pre-commit install.
pip install pre-commit pre-commit install
This will setup a git pre-commit-hook that is executed on each commit and will report the linting problems. To run all hooks on all files use pre-commit run -a.
We provide Dev Container configuration file templates.
To use a Dev Container as your development environment, follow the steps below, then select Dev Containers: Reopen in Container from VS Code's Command Palette.
cd .devcontainer cp Dockerfile.template Dockerfile cp devcontainer.json.template devcontainer.json
If you make improvements that could benefit all developers, please update the template files and submit a pull request.
Licensed under the Apache License, Version 2.0