The impact of large data imports

Saeka
Kilo Sage

Hello,

 

Please let me know if importing a large amount of data at once will affect the instance.

We would like to import in Excel or CSV and create tens of thousands of records for migration.

1 REPLY 1

HIROSHI SATOH
Mega Sage

Leaving aside whether tens of thousands of items is a large amount of data

 

  1. Performance Impact: Importing a large volume of records at once can strain the system, potentially leading to slow performance, timeouts, or even system crashes, especially if your instance is shared with other users.

  2. Data Load Management: It's recommended to split the data into smaller batches and schedule the imports during off-peak hours. This approach helps manage the load on the instance and reduces the risk of performance issues.

  3. Monitoring: During the import process, monitor the system performance and import logs to identify any potential issues early on. ServiceNow provides tools to monitor performance, which can help in making adjustments as needed.

  4. Post-Import Processing: Large imports may trigger business rules, workflows, or scripts that could further impact performance. Ensure that any such processes are optimized or disabled temporarily if necessary.

  5. Testing: Before performing the full import, it’s advisable to test with a smaller dataset to observe the system's behavior and make any necessary adjustments.