The HBase sink connector pulls the messages from Pulsar topics and persists the messages to HBase tables
The configuration of the HBase sink connector has the following properties.
Name | Type | Default | Required | Description |
---|---|---|---|---|
hbaseConfigResources | String | None | false | HBase system configuration hbase-site.xml file. |
zookeeperQuorum | String | None | true | HBase system configuration about hbase.zookeeper.quorum value. |
zookeeperClientPort | String | 2181 | false | HBase system configuration about hbase.zookeeper.property.clientPort value. |
zookeeperZnodeParent | String | /hbase | false | HBase system configuration about zookeeper.znode.parent value. |
tableName | None | String | true | HBase table, the value is namespace:tableName . |
rowKeyName | String | None | true | HBase table rowkey name. |
familyName | String | None | true | HBase table column family name. |
qualifierNames | String | None | true | HBase table column qualifier names. |
batchTimeMs | Long | 1000l | false | HBase table operation timeout in milliseconds. |
batchSize | int | 200 | false | Batch size of updates made to the HBase table. |
Before using the HBase sink connector, you need to create a configuration file through one of the following methods.
JSON
{ "configs": { "hbaseConfigResources": "hbase-site.xml", "zookeeperQuorum": "localhost", "zookeeperClientPort": "2181", "zookeeperZnodeParent": "/hbase", "tableName": "pulsar_hbase", "rowKeyName": "rowKey", "familyName": "info", "qualifierNames": [ 'name', 'address', 'age'] } }
YAML
configs: hbaseConfigResources: "hbase-site.xml" zookeeperQuorum: "localhost" zookeeperClientPort: "2181" zookeeperZnodeParent: "/hbase" tableName: "pulsar_hbase" rowKeyName: "rowKey" familyName: "info" qualifierNames: [ 'name', 'address', 'age']