tree: 9f7a0a726f302fb011b656d5bc3d6a2e9d43e811 [path history] [tgz]
  1. src/
  2. LICENSE-BIN
  3. NOTICE-BIN
  4. pom.xml
  5. README.md
rocketmq-hbase/rocketmq-hbase-source/README.md

RocketMQ-HBase Source

Overview

This project replicates RocketMQ topics to HBase tables.

Pre-requisites

  • HBase 1.2+
  • JDK 1.8+
  • RocketMQ 4.0.0+

Assumptions

  • Each specified RocketMQ topic is mapped to a HBase table with the same name
  • The HBase tables already exist

Properties

Have the below properties set in rocketmq_hbase.conf

keynullabledefaultdescription
topicsfalseA comma separated list of RocketMQ topics to replicate to HBase (e.g., topic1,topic2,topic3)
nameservertruelocalhost:9876RocketMQ name server address
consumerGrouptrueHBASE_CONSUMER_GROUPThe consumer group name
messageModeltrueBROADCASTINGRocketMQ message model, ‘BROADCASTING’ or ‘CLUSTERING’
zookeeperAddresstruelocalhostA comma separated list of the IP addresses of all ZooKeeper servers in the cluster
zookeeperPorttrue2181The port at which the clients will connect
batchSizetrue32The maximum number of messages to be consumed in batch from RocketMQ
pullIntervaltrue1000Time in milliseconds to wait between consecutive pulls