Flat File Source/HFS Source () is used to read a flat file line by line using a line separator (\n).
Each line in the input file is treated as one record.

The Flat File Source / HFS Source supports the following parameters:

• Hive Server Parameter
  (Used for retrieving Hive metadata; applicable to the MapReduce engine only)
  • JDBC Driver Class
    The Hive JDBC driver class name.
  • URL
    The Hive JDBC connection URL.
  • Hive User
    The Hive user name.
  • Hive Password
    The Hive user password.
• Input Path
  The path to the input file or directory.
  • If omitted, the input path must be supplied as a command-line argument when running the job.
  • For dynamic parameters, FROM_ARGUMENT(arg_name) can be used to pass the input path at runtime.
• Default File System
  The default file system used for the input path, unless the file system is explicitly specified in the input path.

Supported Engines

Map Reduce	Spark 1.x RDD	Spark 2.x RDD	Spark 2.x Dataset	Apache Beam 2.29.0 Batch	Apache Beam 2.29.0 Streaming	Apache Flink 1.12.0 Batch	Apache Flink 1.12.0 Streaming	Apache Tez 0.9.1	PySpark