How to import and export 100000 records

senon · ‎05-13-2021

Hi expert !!

I will migrate 100000 records from ServiceNow to ServiceNow.

What is the best way to do that?

I know "import set" and "xml import".

but I don't know that these methods are correct to migrate a large number of records.

Let me know if you have any best practices.

Best regards

senon.

Tony Chatfield1 · ‎05-13-2021

Hi, without clear details of your data and the relationships between the 2 instances it is difficult to answer this question concisely .

Is this is a 1 off migration IE the records do not need to be kept in sync?
Are the table fields are the same for both source and target instance?
Is reference data the same for both instances? IE do all users exist in both instances, do both records for user 'X' have the same record sys_id?

If the answer is yes to all above then XML'ing the data would be your quickest and easiest solution,
but you will need to find a way to break the XML export\import down into smaller files as there are OOB Import\Export limitations and as a beginner you would be best to leave these as is.

If the data needs to be sync'd, the tables have field differences, or reference data is not identical in both instances? Then you will need to look at some sort of managed import process, so your data can be properly mapped.
Integration would be best if the data needs to be kept in sync.
Otherwise if non sync'd and you have limited integration experence, then files like excel or csv could be used via a transform map to align the data discrepancies - I would still suggest breaking the import into multiple smaller files.

View solution in original post

senon · ‎05-13-2021

Hi, Tony

In my situation, I can answer all your questions with a "Yes".

So,I find break down point for import/export and try XML import.

Thank you!!

senon.

Mayu · ‎05-13-2021

Hello All,

I will migrate 100000 records from ServiceNow to ServiceNow.

What is the best way to do that?

I know "import set" and "xml import".

Check the Size of Record

Navigate -->"System Properties"-->export/import.

Format	Format-specific export limit	General export limit	Default export limit
XML	glide.xml.export.limit	glide.ui.export.limit	10,000
CSV	glide.csv.export.limit	glide.ui.export.limit	10,000
EXCEL (XLSX)	glide.xlsx.export.limit	glide.ui.export.limit	10,000
EXCEL (XLS)	glide.excel.export.limit	glide.ui.export.limit	10,000
EXCEL (XLSX)	glide.xlsx.max_cells	N/A	500,000
EXCEL (XLS)	glide.excel.max_cells	N/A	500,000
PDF

Please, remember to mark Correct or Helpful if you find my response useful.