Imported records are being duplicated after import
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
5 hours ago
Something really weird is happenning. My colleagues and I have developed a transform map to import data from a specific excel, but when we run it via "Load 20 records" in data source, it generates duplicated records. We have only field mappings, no main script, no transform scripts, field "Run business rules" is off, there is no previous record in the target table... and despite all of this, duplicates are being generated. Does anybody know why can this be happening?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
4 hours ago
Hi @jordimsant
The primary reason for the display catalog error is the availability of the COALESCE field — it must exist.
Please refer to this post, which describes the same problem scenario.
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.
Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]
****************************************************************************************************************
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
4 hours ago
We have already tried using coalesce with one of the fields and it does not work neither. We are really lost with this matter. I would like also to highlight that the table to which we are importing was completely empty before doing this upload
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
4 hours ago
Hi @jordimsant
Coalesce should resolve this issue.
If the problem still persists, it’s best to log a case with Now Support.
Please also check which field you are using for coalescing and ensure it is correctly defined.
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.
Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]
****************************************************************************************************************
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
4 hours ago
Hi,
Since setting coalesce on a single field isn't working and you're getting duplicates even on an empty target table, the most likely cause is an issue with data integrity in your source Excel file. The "Load 20 records" function is treating each row as a new record because it's not finding any matches based on your coalesced field.
How to Fix It
Clean Your Data: The best and most direct solution is to clean the data in your Excel file. Use functions in Excel like TRIM() to remove leading/trailing spaces and LOWER() or UPPER() to standardize the case.
Use a Composite Coalesce Key: If a single field is not guaranteed to be unique, select multiple fields to coalesce on. For example, coalesce on a combination of First Name and Last Name to create a composite key.
Check Coalesce Case-Sensitive Option: On your transform map, open the field mapping for your coalesced field. Check the Coalesce case-sensitive option to see if it's disabled. If your data is not guaranteed to have consistent casing, ensure this option is turned off.
Thanks & Regards,
Muhammad Iftikhar
If my response helped, please mark it as the accepted solution so others can benefit as well.
