Scheduled Data Import : Use a specific Transform map
For organizations, the load of users for example , may need to be done daily , you can create a scheduled import to launch data imports automatically .
When creating the scheduled import , a data source needs to be provided :
If I have many data sources with the same staging table , all transform maps related to the staging table can be used , the reason is that Transform maps are linked to the staging tables
It’s difficult to define a specific import logic if in my case I want to apply a specific Transform Map to my scheduled import .
In the definition of the scheduled import, we are not able to define which Transform Map we want to apply .
Now , if we go back to definition of the Transform Map , we can see that , we can execute a Transform script before the load of data , by using an “OnStart” script .
We can use the OnStart script to get the name of the Data Source using the global variable import_set and check if the current Data Source is the good one .
(if you want to see all global variables, open the wiki )
In the example below , we ignore the import if it’s triggered from the Data Source 2 (Related to the scheduled import)
