Apache Iceberg

Clone this repo:
  1. 7db4b01 chore: Change publish parallism back to 1 (#2254) by Shawn Chang · 8 hours ago main
  2. 0196cb1 fix(python): use resolving storage for python binding (#2246) by Shawn Chang · 14 hours ago
  3. c1497a9 doc: Update README.md to include more components (#2248) by Shawn Chang · 32 hours ago
  4. ffd6454 feat(storage): implement opendal resolving storage (#2231) by Shawn Chang · 2 days ago
  5. a54e442 feat(io): Add delete_stream to Storage trait (#2216) by Shawn Chang · 2 days ago

Apache Iceberg™ Rust

Rust implementation of Apache Iceberg™.

Components

The Apache Iceberg Rust project is composed of the following components:

NameReleaseDocs
icebergiceberg imagedocs release docs dev
iceberg-catalog-loadericeberg-catalog-loader imagedocs release docs dev
iceberg-catalog-glueiceberg-catalog-glue imagedocs release docs dev
iceberg-catalog-hmsiceberg-catalog-hms imagedocs release docs dev
iceberg-catalog-resticeberg-catalog-rest imagedocs release docs dev
iceberg-catalog-s3tablesiceberg-catalog-s3tables imagedocs release docs dev
iceberg-catalog-sqliceberg-catalog-sql imagedocs release docs dev
iceberg-cache-mokaiceberg-cache-moka imagedocs release docs dev
iceberg-datafusioniceberg-datafusion imagedocs release docs dev
iceberg-storage-opendaliceberg-storage-opendal imagedocs release docs dev

Iceberg Rust Implementation Status

The features that Iceberg Rust currently supports can be found here.

Supported Rust Version

Iceberg Rust is built and tested with stable rust, and will keep a rolling MSRV (minimum supported rust version). At least three months from latest rust release is supported. MSRV is updated when we release iceberg-rust.

Check the current MSRV on crates.io.

Contribute

Apache Iceberg is an active open-source project, governed under the Apache Software Foundation (ASF). Apache Iceberg Rust is always open to people who want to use or contribute to it. Here are some ways to get involved.

The Apache Iceberg community is built on the principles described in the Apache Way and all who engage with the community are expected to be respectful, open, come with the best interests of the community in mind, and abide by the Apache Foundation Code of Conduct.

Users

  • Databend: An open-source cloud data warehouse that serves as a cost-effective alternative to Snowflake.
  • Lakekeeper: An Apache-licensed Iceberg REST Catalog with data access controls.
  • Moonlink: A Rust library that enables sub-second mirroring (CDC) of Postgres tables into Iceberg.
  • RisingWave: A Postgres-compatible SQL database designed for real-time event streaming data processing, analysis, and management.
  • Wrappers: Postgres Foreign Data Wrapper development framework in Rust.
  • ETL: Stream your Postgres data anywhere in real-time.

License

Licensed under the Apache License, Version 2.0