Join the #BuildWithBuildAgent Challenge! Get recognized, earn exclusive swag, and inspire the ServiceNow Community with what you can build using Build Agent.  Join the Challenge.

Import millions of records through data source

saba tanveer
Tera Contributor

I have to import more than 1 million records into the table from excel attachment using data source. Is it possible? or if not then what I have to do to make it possible in lesser time period.

7 REPLIES 7

Medi C
Giga Sage
Giga Sage

@saba tanveer 

1 million records is too much, where is the data coming from? REST Call? Excel csv ..?


If you found this helpful, please hit the thumbs-up button and mark as correct. That helps others find their solutions.

Thank you for your response.

Data is coming from excel.

Hi @saba tanveer 

Yes, it's 100% possible, but follow these best practices:

  • Avoid uploading all records at once.
  • Ensure that all reference fields or choices are already available in the system.
  • Start by loading 1,000 records for the first two attempts, then evaluate the performance.
  • If there's no impact, you can proceed to load up to 10,000 records. [For instance, importing 10 sets of 100,000 records is faster than importing one set of 1 million records, despite the same total data being imported.]
  • Perform this process only during off-peak hours.

https://www.servicenow.com/community/now-platform-articles/how-to-import-4-million-records-in-3-hour...

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************

Hi @saba tanveer 

 

Is this issue still open?

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************