CustomDelimiterRecordInputFormat is used to read text file formats where records are separated by a custom delimiter instead of the default newline character.
This input format is especially useful when input records span multiple lines or use non-standard separators.
Configuration Names
hgrid247.record.delimiter
- Specifies the record delimiter used to split records in the input file.
- Default value: newline character (\n)
hgrid247.split.size
- Specifies the size of one input split in bytes.
- Default value: the block size of the input file system.
Behavior Notes
- Each split is processed independently while respecting the defined record delimiter.
- Records can span across file blocks when a custom delimiter is used.
- Proper configuration of split size can improve parallelism and performance when processing large files.