IntegrationHub ETL dynamically create entity field and mapping
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-13-2025 04:48 AM
Hello,
I have an ETL application and already created entity mapping using IntegrationHub ETL (3.2) guided experience.
But I want to customize the mapping, base on the user input(add new filed to entity and and map to target tables). this should be done via the script dynamically not using the IntegrationHub ETL (3.2) guided experience.
In this approach, custom field mappings are stored in a system property, allowing flexibility in adapting the ETL definition during scheduled imports. While a basic mapping is predefined within the ETL application, users can extend it by adding custom fields without modifying the core configuration.
During the import process, the ETL reads the system property and dynamically incorporates these additional fields, ensuring a seamless and adaptable data transformation process. This method enhances configurability, enabling users to tailor data mappings based on evolving business needs while maintaining the integrity of the standard ETL framework.
Best regards,
Pethum
- Labels:
-
Architect
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-24-2025 03:54 AM
@pethumdesilva wrote:Hello,
I have an ETL application and already created entity mapping using IntegrationHub ETL (3.2) guided experience.
But I want to customize the mapping, base on the user input(add new filed to entity and and map to target tables). this should be done via the fit script dynamically not using the IntegrationHub ETL (3.2) guided experience.
In this approach, custom field mappings are stored in a system property, allowing flexibility in adapting the ETL definition during scheduled imports. While a basic mapping is predefined within the ETL application, users can extend it by adding custom fields without modifying the core configuration.
During the import process, the ETL reads the system property and dynamically incorporates these additional fields, ensuring a seamless and adaptable data transformation process. This method enhances configurability, enabling users to tailor data mappings based on evolving business needs while maintaining the integrity of the standard ETL framework.
Best regards,
Pethum
To dynamically customize your ETL application's entity mappings based on user input, you can implement a script that reads custom field mappings stored in a system property. This approach allows users to add new fields to entities and map them to target tables without modifying the core ETL configuration. During scheduled imports, the ETL process can read the system property and incorporate these additional fields, ensuring a flexible and adaptable data transformation process. This method enhances configurability, enabling users to tailor data mappings based on evolving business needs while maintaining the integrity of the standard ETL framework.
