We're reclaiming inactive PDIs to keep them available for active builders. Learn what's changing, who's affected, and how to protect your work. Read More

Transform maps loading more than the excel data

Nisha30
Kilo Sage

Hello Experts,

 

One of our table is empty. Hence we are loading data from excel sheet  via Transform maps (Load Data)

 

Since there are many duplicates in many fields hence NO COALESCE = TRUE in our transform map, since we want to load all data (around 3k)

 

In staging table the data is correct however post transform the records are trippled around 9k.

 

why it is increasing it can simply insert the number of records in the staging .

 

Anyone faced similar issue .

 

Thanks

 

 

4 REPLIES 4

Rakesh_M
Mega Sage

Hi @Nisha30 ,

Here are a few possible reasons that come to mind:

  • In the Transform Map record, under the Field Maps related list, set the Choice action to Ignore.If you have a field that references the same table, it may create new records during the transform.

  • During the transform, make sure there is only one Transform Map in the "Selected Maps Run in Order" bucket.

  • Check whether you have configured any Transform Scripts.

  • Review the Import Set records after the transform to see how the data is being processed.

Could you please share more details about your issue? This will help us better understand the problem and suggest the appropriate solution.

Also, try importing just 1 or 2 records first and observe the behavior. This can help narrow down the root cause.

OlaN
Tera Sage

Hi,

You might have empty rows in your Excel sheet, which gets transformed into empty records.
Is the property "Create new record on empty coalesce fields" checked in your transform map ?
If so, what happens if you uncheck it?

 

Tanushree Maiti
Tera Patron

Hi @Nisha30 

 

  • Check for Multiple Transform Maps: Navigate to System Import Sets > Transform Maps. Filter by your staging table name to check how many Transform Maps are active for that specific Import Set . Refer: KB0747613 When importing data, some staging table records are duplicating or an Import set row is du... 
  • If you have multiple maps, verify which one is the correct mapping and ensure the others are deactivated so they do not process the same staging rows.
  • For the records that should be created, ensure that:

    1. The Choice Action on your field maps is set to "create" if you want new records.
    2. You do not have Business Rules, Inbound Actions, or onBefore/onAfter Transform Scripts that are inserting duplicate or cascading records

     

Please Accept the solution if it assisted you with your question & Mark this response as Helpful.
Regards
Tanushree Maiti
ServiceNow Technical Architect
LinkedIn: https://www.linkedin.com/in/tanushreemaiti

Srikanth_9
Mega Sage

Hi @Nisha30,

 

Did you enable the check box for "Create new record on empty coalesce fields"?

If enabled, it will create new records on empty record inserts.

 

Refer:

Solved: Duplicate records are inserting even coalesce fiel... - ServiceNow Community

Update all records when transform map matched the ... - ServiceNow Community

Solved: what is difference between "Create new record on e... - ServiceNow Community

 

If the provided solution is useful/working, please Accept as Solution and hit the Helpful. 
 
Thanks & Regards,
Srikanth Akula.