[Feature] add stream load batch write (#168)

At present, the writing of Flink Connector can only rely on the writing of checkpoint.
Not very friendly to two scenarios:
1. Jobs that do not need to enable checkpoint
2. The ETL of Flink jobs is complicated, which makes the checkpoint very slow, but it does not want to affect the writing performance.
16 files changed
tree: 1aa133f983f7d125b5a338fa8fe356f34b3c90b3
  1. .github/
  2. .mvn/
  3. flink-doris-connector/
  4. .asf.yaml
  5. .gitignore
  6. .licenserc.yaml
  7. CODE_OF_CONDUCT.md
  8. CONTRIBUTING.md
  9. CONTRIBUTING_CN.md
  10. custom_env.sh.tpl
  11. env.sh
  12. LICENSE.txt
  13. mvnw
  14. NOTICE.txt
  15. README.md
README.md

Flink Connector for Apache Doris

License Join the Doris Community at Slack

Flink Doris Connector

Flink Doris Connector now support flink version from 1.11 to 1.17.

If you wish to contribute or use a connector from flink 1.13 (and earlier), please use the branch-for-flink-before-1.13

More information about compilation and usage, please visit Flink Doris Connector

License

Apache License, Version 2.0

How to Build

You need to copy customer_env.sh.tpl to customer_env.sh before build and you need to configure it before build.

git clone git@github.com:apache/doris-flink-connector.git
cd doris-flink-connector/flink-doris-connector
./build.sh

how-to-build

Report issues or submit pull request

If you find any bugs, feel free to file a GitHub issue or fix it by submitting a pull request.

Contact Us

Contact us through the following mailing list.

NameScope
dev@doris.apache.orgDevelopment-related discussionsSubscribeUnsubscribeArchives

Links