Previous Step
How to set up an IH-ETL transform map
In this step, input the basic details for your ETL transform map. Below is an example configuration:
1. To start configuring your mapping, click “Import Source Data and Provide Basic Details”.
2. Specify basic information for your ETL transform map.
In IH-ETL V3.2, we have added below two functions
The "Previous Size Override" number will determine how many import set rows to pull into IH-ETL for preview for current mapping. If no value is provided, it will fall back to use the value in system property "sn_int_studio_preview.size", by default the value is 100.
For nested payload, in order to improve loading performance, we by default disabled loading complete schema fields. IH-ETL will only preview schema fields that are within the rows specified in "Preview Size Overrider", and if this value is not provided, it will use the value in "sn_int_studio.preview.size" property. Unless user finds that the required fields are missing in field mapping step, user should not enable this option for best loading performance. Note that for newly created mapping, IH-ETL will always load complete schema.
3. If you have already created a CMDB Application, select it from the drop-down. If you have not, leave it set at “Add new…” and specify the name.
This is the name of your application, not the name of this data source.
4. Select your discovery source
This should be unique to above CMDB application.
5. In the “Name” field, specify the name of this ETL transform map
6. In “Data Source”, select the data source prepared in previous steps
7. After you select the data source, select an import set if available. If not, select “Auto-pull a new import set” and IH-ETL will pull a new import set for you
8. Click “Save” and then “Mark as Complete”
Tips and caveats
- Discovery source is used by IRE reconciliation. This value will be stored in “discovery_source” field for all records inserted or updated by this ETL map
- If there is an existing Import Set, it is automatically selected in “Sample Import Set” dropdown. Alternately, if there is no existing import set, a new import set will be auto pulled after save
- “Test Load 20 Records” type import set is not supported by IH-ETL
- By default, IH-ETL will only pull 100 rows from data source. Use property “sn_int_studio.preview.size” to adjust the number (max number is 10k)
Additional Resources
Next Step
IH-ETL Guided Setup Step 2 - Preview and Prepare Data
