How can we insert data into the CMDB from multiple sources while avoiding duplicate entries?

[Atik]

Hello Everyone,

I need assistance with an ITOM requirement involving data integration and management. We have data coming from 10 different sources, including four via FTP, and we want to avoid duplicate CI (Configuration Item) creation in the CMDB (Configuration Management Database) if the same host appears in multiple data sources.

Additionally, we must ensure that if a particular field (e.g., hostname) is missing in one data source but present in another, the available information should be used to update the field.

Can anyone provide guidance or help with this process?

Thank you!

[21121A3359]

@Atik 

Hey

To Avoid Duplicates:

1. Go to Transform Maps and Scroll Down
2. Make coalesce fields as True(it doesn’t allow duplictaes it act as primary key, and when ever duplicates will come then it replace old data with new data.

[Mark Manders]

You will need to provide more information. What are you expecting the CMDB to look like when the same fields are updated from different sources on the same device? How do you want that to be handled? 

What is your coalesce? Do you use serial numbers, device names or something else? It's not the hostname, since you say it can be missing. You must have a way to identify the CI to prevent duplicates and that needs to be unique from all sources, or at least not present in any other source, if you have different ways of identifying per source. 

And then you need to decide which source is the 'truth'. If one source is sending over status is operational and another says status is in use, what do you want to set. How many sources are updating one device? 

[AndersBGS]

Hi @Atik ,

This is here IRE come in to play: https://docs.servicenow.com/bundle/xanadu-servicenow-platform/page/product/configuration-management/...

If my answer has helped with your question, please mark my answer as accepted solution and give a thumb up.

Best regards

Anders 

[Selva Arun]

Hi,

You can enable  MultiSource 360 and create the IRE Rules, more information can be found in the below doc:

https://docs.servicenow.com/bundle/xanadu-servicenow-platform/page/product/configuration-management/...

https://docs.servicenow.com/bundle/xanadu-servicenow-platform/page/product/configuration-management/...

If you believe the solution provided has adequately addressed your query, could you please **mark it as 'Helpful'** and **'Accept it as a Solution'**? This will help other community members who might have the same question find the answer more easily.

Thank you for your consideration.

Selva