Pipe Assembly

Number of input and output link

Number of input link : One
Number of output link : One

Pipe Assembly () is used to pass the data or record stream directly from the previous assembly to the next assembly without performing any transformation or processing.

Key Characteristics

Supported Engines

Map
Reduce
Spark 1.x
RDD
Spark 2.x
RDD
Spark 2.x
Dataset
Apache Beam
2.29.0 Batch
Apache Beam
2.29.0 Streaming
Apache Flink
1.12.0 Batch
Apache Flink
1.12.0 Streaming
Apache Tez
0.9.1
PySpark