| commit | 2ce53280014f8e31a9089135ac0da72b84b674b8 | [log] [tgz] |
|---|---|---|
| author | wudi <676366545@qq.com> | Wed Jul 19 11:21:12 2023 +0800 |
| committer | GitHub <noreply@github.com> | Wed Jul 19 11:21:12 2023 +0800 |
| tree | a40b762c7e0762b80840e977d38cc9c45743f271 | |
| parent | 555425e4944a0640105504538cd349a4c6fa6fc7 [diff] |
[Feature ]add oracle database sync (#156)
1. Add Oracle whole database synchronization, the specific process is the same as #141.
The example is as follows:
```shell
bin/flink run \
-Dexecution.checkpointing.interval=10s\
-Dparallelism.default=1\
-c org.apache.doris.flink.tools.cdc.CdcTools\
./lib/flink-doris-connector-1.16-1.5.0-SNAPSHOT.jar\
oracle-sync-database \
--database db1\
--oracle-conf hostname=127.0.0.1 \
--oracle-conf port=1521 \
--oracle-conf username=admin \
--oracle-conf password="admin123" \
--oracle-conf database-name=XE \
--oracle-conf schema-name=ADMIN \
--including-tables "tbl1|tbl2" \
--sink-conf fenodes=127.0.0.1:8030 \
--sink-conf username=root \
--sink-conf password=\
--sink-conf jdbc-url=jdbc:mysql://127.0.0.1:9030 \
--sink-conf sink.label-prefix=label \
--sink-conf sink.enable-2pc=false \
--table-conf replication_num=1
```
Among them, oracle-conf is the configuration of flinkcdc oracle, which can be referred to [here](https://ververica.github.io/flink-cdc-connectors/master/content/connectors/oracle-cdc.html), other configurations are the same as MySQL #141
2. Add the parameter `--create-table-only`, when specified, only create the table without submitting the task.
Flink Doris Connector now support flink version from 1.11 to 1.17.
If you wish to contribute or use a connector from flink 1.13 (and earlier), please use the branch-for-flink-before-1.13
More information about compilation and usage, please visit Flink Doris Connector
You need to copy customer_env.sh.tpl to customer_env.sh before build and you need to configure it before build.
git clone git@github.com:apache/doris-flink-connector.git cd doris-flink-connector/flink-doris-connector ./build.sh
If you find any bugs, feel free to file a GitHub issue or fix it by submitting a pull request.
Contact us through the following mailing list.
| Name | Scope | |||
|---|---|---|---|---|
| dev@doris.apache.org | Development-related discussions | Subscribe | Unsubscribe | Archives |
