ORC Source () reads data stored in ORC (Optimized Row Columnar) file format.
This source is supported only when using the MapReduce engine, as it relies on Hive metadata for schema handling.

Parameter of ORC Source are :

• Hive Server Parameter
  (For getting Hive metadata — MapReduce engine only)
  • JDBC Driver Class
    Specifies the Hive JDBC driver class name.
  • URL
    The Hive JDBC connection URL.
  • Hive User
    Hive user name used to connect to the Hive server.
  • Hive Password
    Password for the specified Hive user.
• Input Path
  The path to the ORC file.
  • If omitted, the input path must be supplied as a command-line argument when running the job.
  • For dynamic parameters, FROM_ARGUMENT(arg_name) can be used to pass the input path at runtime.
• Default File System
  The default file system used for the input path, unless the file system is explicitly specified in the path.
• Field(s) Declaration
  Defines the structure of the ORC file to be read, including:
  • Field names
  • Field data types
  If the ORC Schema is empty, this declaration will be used as the ORC schema.
• ORC Schema
  Specifies the structure and metadata that define how data is organized in the ORC file format.
  • If provided, this schema is used directly.
  • If not provided, the schema is inferred from Field(s) Declaration.

Orc Type used in HGrid247-3.5 are :

ORC Type	Hadoop Writable Type
binary	org.apache.hadoop.io.BytesWritable
bigint	org.apache.hadoop.io.LongWritable
boolean	org.apache.hadoop.io.BooleanWritable
char	org.apache.hadoop.io.Text
date	org.apache.hadoop.hive.serde2.io.DateWritable
decimal	org.apache.hadoop.hive.serde2.io.HiveDecimalWritable
double	org.apache.hadoop.io.DoubleWritable
float	org.apache.hadoop.io.FloatWritable
int	org.apache.hadoop.io.IntWritable
smallint	org.apache.hadoop.io.ShortWritable
string	org.apache.hadoop.io.Text
timestamp	org.apache.orc.mapred.OrcTimestamp
tinyint	org.apache.hadoop.io.ByteWritable
varchar	org.apache.hadoop.io.Text

Supported Engines

Map Reduce	Spark 1.x RDD	Spark 2.x RDD	Spark 2.x Dataset	Apache Beam 2.29.0 Batch	Apache Beam 2.29.0 Streaming	Apache Flink 1.12.0 Batch	Apache Flink 1.12.0 Streaming	Apache Tez 0.9.1	PySpark