Import millions of records through data source

saba tanveer
Tera Contributor

I have to import more than 1 million records into the table from excel attachment using data source. Is it possible? or if not then what I have to do to make it possible in lesser time period.

7 REPLIES 7

Medi C
Giga Sage

@saba tanveer 

1 million records is too much, where is the data coming from? REST Call? Excel csv ..?


If you found this helpful, please hit the thumbs-up button and mark as correct. That helps others find their solutions.

Thank you for your response.

Data is coming from excel.

Hi @saba tanveer 

Yes, it's 100% possible, but follow these best practices:

  • Avoid uploading all records at once.
  • Ensure that all reference fields or choices are already available in the system.
  • Start by loading 1,000 records for the first two attempts, then evaluate the performance.
  • If there's no impact, you can proceed to load up to 10,000 records. [For instance, importing 10 sets of 100,000 records is faster than importing one set of 1 million records, despite the same total data being imported.]
  • Perform this process only during off-peak hours.

https://www.servicenow.com/community/now-platform-articles/how-to-import-4-million-records-in-3-hour...

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************

Hi @saba tanveer 

 

Is this issue still open?

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************