rocketmq-connect-cassandra

rocketmq-connect-cassandra 打包

mvn clean install -DskipTest -U 

目前安装会遇到的问题

目前的rocketmq-connect-cassandra 使用的是datastax-java-driver:4.5.0版本的cassandra-driver，由于在打包过程中还有没有解决的问题，该cassandra driver无法读取 位于driver包中的默认配置文件，因此我们需要手动下载cassandra driver的配置文件reference.conf 并将其放置于classpath中。

该问题还仍然在解决的过程中。

rocketmq-connect-cassandra 启动

• cassandra-source-connector 启动

http://${runtime-ip}:${runtime-port}/connectors/${rocketmq-cassandra-source-connector-name}
?config={"connector-class":"org.apache.rocketmq.connect.cassandra.connector.JdbcSourceConnector",“dbUrl”:"${source-db-ip}",dbPort”:"${source-db-port}",dbUsername”:"${source-db-username}",dbPassword”:"${source-db-password}","rocketmqTopic":"cassandraTopic","mode":"bulk","whiteDataBase":{"${source-db-name}":{"${source-table-name}":{"${source-column-name}":"${source-column-value}"}}},"source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}

• cassandra-sink-connector 启动

http://${runtime-ip}:${runtime-port}/connectors/${rocketmq-cassandra-sink-connector-name}
?config={"connector-class":"org.apache.rocketmq.connect.cassandra.connector.JdbcSinkConnector",“dbUrl”:"${sink-db-ip}",dbPort”:"${sink-db-port}",dbUsername”:"${sink-db-username}",dbPassword”:"${sink-db-password}","rocketmqTopic":"cassandraTopic","mode":"bulk","topicNames":"${sink-topic-name}","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}

注： rocketmq-cassandra-connect 的启动依赖于rocketmq-connect-runtime项目的启动，需将打好的jar包放置到runtime项目中pluginPaths配置的路径后再执行上面的启动请求,该值配置在runtime项目下的connect.conf文件中

rocketmq-connect-cassandra 停止

http://${runtime-ip}:${runtime-port}/connectors/${rocketmq-cassandra-connector-name}/stop

rocketmq-connect-cassandra 参数说明

• cassandra-source-connector 参数说明

示例配置如下

{
    "connector-class":"org.apache.rocketmq.connect.cassandra.connector.CassandraSourceConnector",
    "rocketmqTopic":"jdbc_cassandra",
    "topicNames": "jdbc_cassandra",
    "dbUrl":"127.0.0.1",
    "dbPort":"9042",
    "dbUsername":"cassandra",
    "dbPassword":"cassandra",
    "localDataCenter":"datacenter1",
    "whiteDataBase": {
        "jdbc":{
           "jdbc_cassandra": {"NO-FILTER": "10"}
         }
      },
    "mode": "bulk",
    "task-parallelism": 1,
    "source-cluster": "172.17.0.1:10911",
    "source-rocketmq": "127.0.0.1:9876",
    "source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"
 }

• cassandra-sink-connector 参数说明