We've updated the ServiceNow Community Code of Conduct, adding guidelines around AI usage, professionalism, and content violations. Read more

Import millions of records through data source

saba tanveer
Tera Contributor

I have to import more than 1 million records into the table from excel attachment using data source. Is it possible? or if not then what I have to do to make it possible in lesser time period.

7 REPLIES 7

Medi C
Giga Sage

@saba tanveer 

1 million records is too much, where is the data coming from? REST Call? Excel csv ..?


Thanks & Best regards,
Medi

Thank you for your response.

Data is coming from excel.

Hi @saba tanveer 

Yes, it's 100% possible, but follow these best practices:

  • Avoid uploading all records at once.
  • Ensure that all reference fields or choices are already available in the system.
  • Start by loading 1,000 records for the first two attempts, then evaluate the performance.
  • If there's no impact, you can proceed to load up to 10,000 records. [For instance, importing 10 sets of 100,000 records is faster than importing one set of 1 million records, despite the same total data being imported.]
  • Perform this process only during off-peak hours.

https://www.servicenow.com/community/now-platform-articles/how-to-import-4-million-records-in-3-hour...

*************************************************************************************************************
Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/dratulgrover [ Connect for 1-1 Session]

****************************************************************************************************************

Hi @saba tanveer 

 

Is this issue still open?

*************************************************************************************************************
Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/dratulgrover [ Connect for 1-1 Session]

****************************************************************************************************************