tree: fe0c4fc214b59a7bea73f7ca8e660b50159df5e3 [path history] [tgz]
  1. src/
  2. pom.xml
  3. README.md
rocketmq-connect-jdbc/README.md

rocketmq-connect-jdbc

rocketmq-connect-jdbc 打包

mvn clean install -DskipTest -U 

rocketmq-connect-jdbc 启动

  • jdbc-source-connector 启动
http://${runtime-ip}:${runtime-port}/connectors/${rocketmq-jdbc-source-connector-name}
?config={"connector-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector",“dbUrl”:"${source-db-ip}",dbPort”:"${source-db-port}",dbUsername”:"${source-db-username}",dbPassword”:"${source-db-password}","rocketmqTopic":"jdbcTopic","mode":"bulk","whiteDataBase":{"${source-db-name}":{"${source-table-name}":{"${source-column-name}":"${source-column-value}"}}},"source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}
  • jdbc-sink-connector 启动
http://${runtime-ip}:${runtime-port}/connectors/${rocketmq-jdbc-sink-connector-name}
?config={"connector-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSinkConnector",“dbUrl”:"${sink-db-ip}",dbPort”:"${sink-db-port}",dbUsername”:"${sink-db-username}",dbPassword”:"${sink-db-password}","rocketmqTopic":"jdbcTopic","mode":"bulk","topicNames":"${sink-topic-name}","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}

注: rocketmq-jdbc-connect 的启动依赖于rocketmq-connect-runtime项目的启动,需将打好的jar包放置到runtime项目中pluginPaths配置的路径后再执行上面的启动请求,该值配置在runtime项目下的connect.conf文件中

rocketmq-connect-jdbc 停止

http://${runtime-ip}:${runtime-port}/connectors/${rocketmq-jdbc-connector-name}/stop

rocketmq-connect-jdbc 参数说明

  • jdbc-source-connector 参数说明
参数类型是否必须描述样例
dbUrlStringsource端 DB ip192.168.1.2
dbPortStringsource端 DB port3306
dbUsernameStringsource端 DB 用户名root
dbPasswordStringsource端 DB 密码123456
whiteDataBaseStringsource端同步数据白名单,嵌套配置,为{DB名:{表名:{字段名:字段值}}},若无指定字段数据同步,字段名可设为NO-FILTER,值为任意{“DATABASE_TEST”:{“TEST_DATA”:{“name”:“test”}}}
modeStringsource-connector 模式,目前仅支持bulkbulk
rocketmqTopicString待废弃jdbcTopic
task-divide-strategyIntegertask 分配策略, 默认值为 0,表示按照topic分配任务,每一个table便是一个topic0
task-parallelismIntegertask parallelism,默认值为 1,表示将topic拆分为多少个任务进行执行2
source-record-converterStringsource data 解析org.apache.rocketmq.connect.runtime.converter.JsonConverter
  • jdbc-sink-connector 参数说明
参数类型是否必须描述样例
dbUrlStringsink端 DB ip192.168.1.2
dbPortStringsink端 DB port3306
dbUsernameStringsink端 DB 用户名root
dbPasswordStringsink端 DB 密码123456
topicNamesStringsink端同步数据的topic名字topic-1,topic-2
modeStringsource-connector 模式,目前仅支持bulkbulk
rocketmqTopicString待废弃jdbcTopic
task-divide-strategyIntegertask 分配策略, 默认值为 0,表示按照topic分配任务,每一个table便是一个topic0
task-parallelismIntegertask parallelism,默认值为 1,表示将topic拆分为多少个任务进行执行2
source-record-converterStringsource data 解析org.apache.rocketmq.connect.runtime.converter.JsonConverter