Execute DDL HiveQL Sink () is used to run HiveQL commands of the DDL (Data Definition Language) type on the Apache Hive system via a JDBC connection.

DDL is used to create, modify, or delete database structures , such as:

Parameters of Execute DDL HiveQL Sink

In the HGrid247 pipeline , this component is typically used to prepare the Hive database structure before data is inserted using another sink component such as Hive Sink .
  1. Driver Class Name
    HiveQL JDBC driver class name
    This parameter specifies the JDBC driver class used to connect the application with Hive .
    Example:
        Driver Class Name : org.apache.hive.jdbc.HiveDriver
    
    This driver is used by Java applications or data pipeline frameworks to open connections to Hive servers .
  2. URL
    Hive JDBC connection address
    This parameter specifies the HiveQL JDBC connection address .
    General format:
        jdbc:hive2://hostname:port/database
    
    Example:
        URL : jdbc:hive2://192.168.1.50:10000/default
    
    Explanation:
    • jdbc:hive2 → Hive connection protocol
    • 192.168.1.50 → Hive server address
    • 10000 → port default HiveServer2
    • default → nama database
  3. Parameters
    Additional parameters in key :value format
    This parameter is used to add additional authentication or configuration information in the form of key :value .
    Example:
        Parameters : username:root,password:pwd
    
    Another example:
        Parameters : username:hive,password:hive123
    
    This parameter is usually used for:
    • user authentication
    • additional connection settings

Supported Engines

Map
Reduce
Spark 1.x
RDD
Spark 2.x
RDD
Spark 2.x
Dataset
Apache Beam
2.29.0 Batch
Apache Beam
2.29.0 Streaming
Apache Flink
1.12.x Batch
Apache Flink
1.12.x Streaming
Apache Tez
0.9.1
PySpark