HGrid247-3.5 DE User Guide

HGrid247-3.5 Data Engineering (DE) is a platform used to build visual data processing workflows in Big Data environments.
This User Guide explains the installation process, system structure, key features, and how to use the various components within HGrid247.

1. Main Features of HGrid247-3.5 DE

HGrid247 has several key features that support data engineering and big data processing

2. Structure of HGrid247-3.5 DE

This section describes the directory structure and internal components of the HGrid247 system .

3. Installation of HGrid247-3.5 DE

This section describes the process of installing HGrid247-3.5 DE on a user system.

4. Dynamic Parameter Guidance (FROM_ARGUMENT)

HGrid247 provides a dynamic parameter that allows configuration values to be sent when the workflow is run .

5. Plug-ins Guidance

HGrid247 supports a plugin system that allows adding new features without changing the core system.

6. Dynamic Configuration Guidance (FROM_CONFIG)

In addition to runtime parameters, HGrid247 also provides dynamic configuration that will be taken from the system configuration file .

7. Data Processing Guidance

This section explains how to build a data processing pipeline using operators source,assembly and sink

8. Image Processing Guidance

In addition to tabular data, HGrid247 also supports image data processing .

9. Using Sample Project (Workshop)

HGrid247 provides sample projects to help users learn the system.

10. Troubleshooting

This section describes solutions to common problems in using HGrid247 .

11. HGrid247-3.5 Optimization

This section explains how to improve data pipeline performance .
This optimization is very important for large-scale data processing .

12. HGrid247-3.5 Look and Feel (LAF)

HGrid247 uses Java Swing for the user interface.
Look and Feel (LAF) allows the appearance of the application to be customized.

13. Creating and Writing Scripts File in HGrid247-3.5

To make things easier for users, HGrid247 provides an automatic script creation feature that contains workflow submission commands based on the selected processing engine .

The purpose of scripts in HGrid247 is to allow users to run workflows on a cluster from HGrid247.