How to import and export 100000 records

senon · ‎05-13-2021

Hi expert !!

I will migrate 100000 records from ServiceNow to ServiceNow.

What is the best way to do that?

I know "import set" and "xml import".

but I don't know that these methods are correct to migrate a large number of records.

Let me know if you have any best practices.

Best regards

senon.

Tony Chatfield1 · ‎05-13-2021

Hi, without clear details of your data and the relationships between the 2 instances it is difficult to answer this question concisely .

Is this is a 1 off migration IE the records do not need to be kept in sync?
Are the table fields are the same for both source and target instance?
Is reference data the same for both instances? IE do all users exist in both instances, do both records for user 'X' have the same record sys_id?

If the answer is yes to all above then XML'ing the data would be your quickest and easiest solution,
but you will need to find a way to break the XML export\import down into smaller files as there are OOB Import\Export limitations and as a beginner you would be best to leave these as is.

If the data needs to be sync'd, the tables have field differences, or reference data is not identical in both instances? Then you will need to look at some sort of managed import process, so your data can be properly mapped.
Integration would be best if the data needs to be kept in sync.
Otherwise if non sync'd and you have limited integration experence, then files like excel or csv could be used via a transform map to align the data discrepancies - I would still suggest breaking the import into multiple smaller files.

View solution in original post

Isaac Vicentini · ‎05-13-2021

If this data is in a database, you can use a JDBC connection to connect directly to that database.

https://docs.servicenow.com/bundle/quebec-platform-administration/page/administer/import-sets/reference/r_JDBCTypeDataSource.html

Best regards,

Isaac Vicentini
MVP 2025 ✨

If my answer was helpful, mark it as Helpful or Accept as Solution.

senon · ‎05-13-2021

Maybe, this data isn't in a datbase.

Record data is in a only ServiceNow instance.

regards

senon.

Isaac Vicentini · ‎05-13-2021

In that case, the best options for doing this are the options you mentioned. Consider dividing these files into smaller parts, for that you can use the creation date field.

Don't forget to take reference records into account.

https://docs.servicenow.com/bundle/paris-platform-administration/page/administer/import-sets/concept/c_ImportingFromAnotherSNInstance.html

Best regards,

Isaac Vicentini
MVP 2025 ✨

If my answer was helpful, mark it as Helpful or Accept as Solution.

Tony Chatfield1 · ‎05-13-2021

Hi, without clear details of your data and the relationships between the 2 instances it is difficult to answer this question concisely .

Is this is a 1 off migration IE the records do not need to be kept in sync?
Are the table fields are the same for both source and target instance?
Is reference data the same for both instances? IE do all users exist in both instances, do both records for user 'X' have the same record sys_id?

If the answer is yes to all above then XML'ing the data would be your quickest and easiest solution,
but you will need to find a way to break the XML export\import down into smaller files as there are OOB Import\Export limitations and as a beginner you would be best to leave these as is.

If the data needs to be sync'd, the tables have field differences, or reference data is not identical in both instances? Then you will need to look at some sort of managed import process, so your data can be properly mapped.
Integration would be best if the data needs to be kept in sync.
Otherwise if non sync'd and you have limited integration experence, then files like excel or csv could be used via a transform map to align the data discrepancies - I would still suggest breaking the import into multiple smaller files.