Publish changes of HBase tables to Kafka .
HBaseEndpoint is a custom replication end point that receives all mutations( Put / Delete). Based on the white list topics specified in the hbase-site.xml, the events are filtered and mirrored to Kafka using the Kafka producer api.
Have the below properties set in hbase-site.xml and add it to the HBase region server classpath.
Each kafka producer property should be prefixed with kafka.
| name | data type | required | description |
|---|---|---|---|
| kafka.bootstrap.servers | string | yes | Kafka broker servers. |
| kafka.producer.type | string | no | Can be either sync or async. Default sync |
Add hbase-cdc-kafka.jar and hbase-site.xml with the required properties to all the HBase Region servers classpath and restart them.
At HBase shell, run the following commands.
hbase> create 'test', {NAME => 'd', REPLICATION_SCOPE => '1'}
hbase> add_peer 'kafka-repl', ENDPOINT_CLASSNAME 'io.svectors.hbase.cdc.HbaseEndpoint'
hbase> put 'test', 'r1', 'd', 'value'