Row & Column Custom delimiter Source () is used to read files where records (rows) and fields (columns) are separated by user-defined delimiter characters.
Each row is parsed into fields based on the specified delimiters and mapped to the declared structure.

Parameters of Row & Column Custom Delimiter Source are:

• Char Row Delimiter
  Specifies the character used to separate rows (records) in the input file.
• Char Column Delimiter
  Specifies the character used to separate columns (fields) within a row.
• Input Path
  The path to the input file.
  • If omitted, the input path must be supplied as a command-line argument when running the job.
  • For dynamic parameters, FROM_ARGUMENT(arg_name) can be used to pass the input path at runtime.
• Default File System
  The default file system used for the input path, unless the file system is explicitly specified in the path.
• Field(s) Declaration
  Defines the structure of the input data, including:
  • Field names
  • Field data types
  The parsed columns are mapped to these declared fields in order.

Supported Engines

Map Reduce	Spark 1.x RDD	Spark 2.x RDD	Spark 2.x Dataset	Apache Beam 2.29.0 Batch	Apache Beam 2.29.0 Streaming	Apache Flink 1.12.x Batch	Apache Flink 1.12.x Streaming	Apache Tez 0.9.1	PySpark