Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

Clone this repo:
  1. 74f85ce [flink] supports writing to multiple partitions of kafka in unaware bucket mode. (#2459) by liming.1018 · 10 hours ago master
  2. 71057f3 [doc] Recommend to use 200MB bucket size by Jingsong · 10 hours ago
  3. 182d7c4 [cdc] Refactor database synchronization action (#2426) by Kerwin · 21 hours ago
  4. 5f9d265 [doc] Document available flink procedures (#2455) by yuzelin · 36 hours ago
  5. 3c6ad33 [spark] move spark.sql classes to paimon package (#2456) by Yann Byron · 2 days ago

Paimon

License Get on Slack

Paimon is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

Background and documentation are available at https://paimon.apache.org

Paimon's former name was Flink Table Store, developed from the Flink community. The architecture refers to some design concepts of Iceberg. Thanks to Apache Flink and Apache Iceberg.

Collaboration

Paimon tracks issues in GitHub and prefers to receive contributions as pull requests.

Mailing Lists

Please make sure you are subscribed to the mailing list you are posting to! If you are not subscribed to the mailing list, your message will either be rejected (dev@ list) or you won't receive the response (user@ list).

Slack

You can join the Paimon community on Slack. Paimon channel is in ASF Slack workspace.

  • Anyone with an @apache.org email address can become a full member of the ASF Slack workspace. Search Paimon channel and join it.
  • If you don't have an @apache.org email address, you can email to user@paimon.apache.org to apply for an ASF Slack invitation. Then join Paimon channel.

Don’t forget to introduce yourself in channel.

Building

JDK 8/11 is required for building the project.

  • Run the mvn clean install -DskipTests command to build the project.
  • Run the mvn spotless:apply to format the project (both Java and Scala).
  • IDE: Mark paimon-common/target/generated-sources/antlr4 as Sources Root.

How to Contribute

Contribution Guide.

License

The code in this repository is licensed under the Apache Software License 2.