Transform Map not running and copying data to target table at first run

akashdekate · ‎03-15-2019

Hi Everyone,

I am facing issue with Transform Map as it is not copying data to target table at first run.

When reprocessed from Import set(second run), data from source table is getting inserted or updated as expected.

Could you please suggest.

Thanks in advance.

Regards,

Akash Dekate

Shekhar Deshing · ‎03-15-2019

Please check any transform map scripts or anything you added in scripts.
While running any transform scripts please verify first option which you selecting like Onstart,Onbefore.

Try to reload the data again and create the transform maps.Reprocessing sometime will not work you can reload the data again and try.

Rows imported using import sets must not exceed the maximum row size.

A single row in a database may not contain more than 8126 bytes of data. The size of each row is determined by the amount of content in all fields, as well as the character set for text fields. For example, a row with 10 text fields each containing 1000 characters using a French character set takes 15360 bytes.

Attempting to import more data to a single row than the maximum size causes the import to skip that row. Any rows that were skipped for this reason are listed in the import log.

Harshinya1 · ‎03-15-2019

Akash,

Did you test load 20 records and trying to run a transform? in that case - running a transform map on a "test load" doesn't work. If you "Load All Records" and then run the transform map, it should work.

Also, check import log for any errors

Hope this helps

phani24 · ‎08-22-2022

I have the same problem ,i loaded all records and still data not getting loaded to the target table unless I reprocess it .

Prasad43 · ‎05-30-2019

919 views

Number: KB0563963

Importing data using Load All Records or Test Load 20 Records

Objective

The objective of this note is to explain the difference of importing records from data sources using the options Load All Records and Test Load 20 Records.

Procedure

Load All Records and Test Load 20 Records are UI actions located on the related links for a particular data source.

Data sources are located at System Import Sets > Administration > Data Sources.

The usage of these following UI actions is similar, but the use case for each is quite different.

Load All Records

This UI action is used when the data has already being validated and you are ready to transform the data using the Transform option to import the data into the target table. This action sets the internal state of the import to Loaded. Note that the Transform option to run the transformation maps will only process imports with this state.

Test Load 20 Records

This UI action is generally used to validate the records that you want to import without the initial intention of running a transformation map to the target table. This action sets the internal state of the import to Load, therefore the transformation map is skipped.

If needed, the Test 20 Records UI action allows you to ultimately run the Transform option, but a Reprocess action is required.

Reprocess

This UI action changes the internal state of the test import from Load to Loaded. As a result, you can now run the Transform option for the subset of 20 records"test loaded from the import set.

Conclusion

The action Load All Records is used when the data has already being validated and is ready to be transformed into the target table.

Skipping the transformation map is the standard behavior for the action Test Load 20 Records. This action is recommended for validation purposes, however, the transform and import can be forced for the 20 records imported during the test load by using the Reprocess action.