Number of input and output link

Number of input link	:	One
Number of output link	:	One

Transformator Assembly () is used to transform an input record into one or more output records by applying one or more transformation functions.

The following image shows examples of the use of transformation functions in the Transformator assembly.

Each input record consists of multiple fields with defined data types. Transformation functions operate on one or more input fields and produce new output fields or records.

Supported Field Data Types

Each field in a record can have one of the following data types:

• String
• Byte
• Short
• Integer
• Float
• Double
• Long
• Timestamp
• BigDecimal
• BigInteger
• Image
• Object (Comparable Object)

Transformation Behavior

• One or more input fields can be transformed into:
  • One output field
  • Multiple output fields
  • Multiple output records
• Transformations are applied record by record
• Output records are passed downstream to the next assembly or sink
• Transformation functions can be chained, as long as they form a straight-line sequence

Transformation Function Groups

Transformation functions are organized into the following groups based on their purpose:

1. Math
2. String
3. Field
4. Lookup
5. Conversion
6. Security
7. Date
8. Text Similarity
9. Genomic
10. Spatial
11. Special Purpose
12. Transpose
13. Content Based Image Retrieval
14. Image Processing
15. Video Processing

Function Chaining Rules

• A transformation function can be connected to another transformation function
• The connection must form a linear (straight-line) flow

Typical Use Cases

• Data cleansing
• Field enrichment
• Parsing and formatting
• Lookup reference
• Pre-processing before Group By

Supported Engines

Map Reduce	Spark 1.x RDD	Spark 2.x RDD	Spark 2.x Dataset	Apache Beam 2.29.0 Batch	Apache Beam 2.29.0 Streaming	Apache Flink 1.12.0 Batch	Apache Flink 1.12.0 Streaming	Apache Tez 0.9.1	PySpark