Reduce time to import data with concurrent option

Abdellah TAHRI
Tera Contributor

Reduce time to import data with concurrent option

Data imports can be scheduled in a regular interval, so that the data feeding of ServiceNow tables is done automatically.

You can create scheduled import :

Navigate to All > System Import Sets > Administration > Scheduled Imports.

 

AbdellahTAHRI_0-1715611288444.png

 

When the volume of data to be imported is too large , the data loading may take several hours or even days .

To reduce the time processing , you can split the data import into multiple imports by using the Concurrent Import check option .

AbdellahTAHRI_1-1715611288448.png

 

By experience, consider the following when using the concurrent option :

  • This option can be used if the order of data load is not important
  • Need to consider the Number of nodes on the platform : the number of batches depends on the number of nodes
  • Run the import outside the business hours : set a condition to make sure that imports are executed outside the working hours :

AbdellahTAHRI_2-1715611288452.png

 

  • If you don’t know the number of records that will be processed , use the “Round Robin” partition method , so that the system will sets the partition automatically .
  • Use the “Custom Script” or “Custom Size” when you know in advance the number of records.

 

AbdellahTAHRI_3-1715611288456.png

 

 

0 REPLIES 0