Subject: Seeking Suggestions for Bulk Data Import in ServiceNow

irfan12
Tera Contributor

 

Hi Everyone,

We have approximately 10 million records that need to be inserted into a scoped custom table in ServiceNow.

We initially tried using Transform Maps to load the data, but we haven't been successful in processing such a large volume of records.

Additionally, our environment does not have a MID Server, and we cannot use REST APIs to accomplish this requirement.

All the records are currently available in a single CSV file. Splitting the file into multiple smaller files is also not an option due to certain restrictions.

Could you please suggest any alternative approaches or possible solutions to achieve this using ServiceNow's native capabilities?

Any suggestions, recommendations, or insights would be greatly appreciated.

Thanks in advance for your help!

 

Regards,
ServiceNow Developer

1 REPLY 1

Tanushree Maiti
Tera Patron

Hi @irfan12 

 

Without Mid Server , Data Source like a JDBC connection or a REST call can not bring data into a Staging Table until and unless endpoint is public.

 

Only Option I think it is left i.e Splitting CSV file with 20-30 chunks. Could you please explain what is the restriction you have to split it.