ZippedTextInputFormat is used to read ZIP files that contain one or more text files.
Each text file inside the ZIP archive is read line by line.

Configuration

The configuration names consist of the following parameters:

• hgrid247.zip.sourceIncluded
  Indicates whether the source file name inside the ZIP archive should be included in the output.
  • Possible values: true or false
  • Default value: false
• hgrid247.zip.sourceContentDelimiter Indicates the delimiter used between the source file name and the line content when the source file name is included.
  • Default value: #

Behavior

• Reads ZIP archives containing text files
• Extracts and processes each text file line by line
• Optionally prefixes each line with the source file name
• When enabled, the output format becomes:
  <source-file-name>#<line-content>

Typical Use Cases

• Processing compressed text data
• Ingesting multiple text files packaged in a ZIP archive
• Tracking the origin file of each record during ETL processing
• Reducing storage and transfer overhead using compressed inputs