HBase Source () reads data from an Apache HBase table.

Apache HBase is a column-family based NoSQL database that runs on top of the Apache Hadoop ecosystem . HBase is typically used for:

• large-scale data storage
• real-time read/write
• semi-structured data storage
• big data analytics

Unlike relational databases, HBase uses the concept of:

• Row Key
• Column Family
• Column Qualifier

It allows querying specific column families and qualifiers, and optionally mapping the HBase Row Key into an output field.

Parameters of HBase Source

• Table Name
  Name of the HBase table to be queried
• Row ID To Field
  Field name used to store the HBase Row Key in the output record
  If specified, the row key value will be included as a field in the result
• Column Family
  Column Family name(s) to be queried
  Multiple column families are separated by #
• Column Qualifier
  Column Qualifier name(s) to be queried
  Multiple column qualifiers are separated by a comma (,)

Example (Conceptual)

• Column Family

  cf1#cf2
  

• Column Qualifier

  name,age,address
  

• This configuration queries:

  cf1:name, cf1:age, cf1:address
  
  cf2:name, cf2:age, cf2:address
  

HBase Data Structure Example

For example configuration:

    Table Name = telecom_events
    Row ID From = MSISDN
    Column Family = telecom
    Column Qualifier = lac,ci,event_date,direction

So the table structure in HBase:

    RowKey: 62812345678
       telecom:lac = 1126
       telecom:ci = 42313
       telecom:event_date = 2025-03-06
       telecom:direction = ggsn

Supported Engines

Map Reduce	Spark 1.x RDD	Spark 2.x RDD	Spark 2.x Dataset	Apache Beam 2.29.0 Batch	Apache Beam 2.29.0 Streaming	Apache Flink 1.12.0 Batch	Apache Flink 1.12.0 Streaming	Apache Tez 0.9.1	PySpark