Nexthink to ServiceNow Integration – Data Mismatch & Performance Optimization

[Ballela Siva Te]

Hi Team,

We are currently working on an integration where Nexthink sends approximately 5.6 million records to ServiceNow daily. This data first lands in a staging table, and then gets transformed into the Software Installation (cmdb_sam_sw_install) table.

To manage the volume, Nexthink sends the data in four sequential batches, with each batch containing data in multiples of 1,000 records.

However, we are facing two major challenges:

1. Performance Issue:
   The entire data load process is taking around 7–8 hours to complete.

2. Data Mismatch:
   The record count in Nexthink and ServiceNow is not matching, and we suspect some data might be getting missed during the transfer or transformation.

Additionally, please note:

• Nexthink does not support incremental data loads; it sends the entire dataset every day.
• We are using normal transform with 3 different colose fields

---

Our Questions:

• Is there a recommended way to ensure no data is missed during the transfer from Nexthink to ServiceNow?
• Are there any best practices or suggestions to optimize the data load time for such high-volume integrations?

Any guidance or shared experiences would be greatly appreciated!

Thanks,
Siva Teja

[dreinhardt]

Hi @Ballela Siva Te , not everyday 🙂 

And that’s why it’s highly recommended to establish the incremental approach - by SG or copying and existing solution like SCCM. 

and yes multisource will end up in two record per source for the same software install. SAM Pro is able to handle this - seen instances with 120M+ sw install records