Copying Large Data Tables Across Environments

jmiskey
Kilo Sage

‎03-27-2024 05:55 AM

We have a custom table in our Production environment.  It is in a Scoped Application, extends the Task table, and has quite a number of fields (128, to be exact).  

 

I need to copy the current production data from this table down to our lower environments, so I can test out some scripts that need to be run against it.  There are currently just about 1400 records in this table.  If I export them to an XML file, the size of the file is about 175,000 KB and has about 195,000 rows in it (it took me computer over 10 minutes just to open the size so I could get a row count!).

 

So I tried going to this table in our DEV environment, right-clicking, and selecting Import XML.  After a few minutes, I get the pop-up box saying this is taking longer than expected and asking me if I would like to wait, and I select "Yes".  After a few minutes, I am able to move around again.  However, I do not see all the records I tried to import.  I though maybe it is running in the background, and to wait a while.  However, it has been over a half-hour now, and the new records still are not there.  And I do not know of any good way to check/confirm if it is still running, or if there were any sort of errors.

 

Am I going about this in the best manner?  Optimally, the surest way would probably be to do a clone down from Prod to Dev, but we recently did that, and there are a lot of new projects being worked on in Dev, so we are not really at a point where we can do that right now.  Is there an option to just copy/clone down a table?

 

Just wondering what our options are for getting a fresh copy of our data down to Dev.

 

Thanks

0 Helpfuls
  • 934 Views
7 REPLIES 7

Dr Atul G- LNG
Tera Patron
Tera Patron
In response to jmiskey

‎03-27-2024 06:57 AM

Hi @jmiskey 

 

Is your data in excel sheet, i may be wrong but remove all formatting in sheet and remove all border in excel and then save as , i am sure it will reduce the size of file. 

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************
0 Helpfuls

jmiskey
Kilo Sage
In response to Dr Atul G- LNG

‎03-27-2024 07:02 AM

No, I am exporting as XML from Prod and trying to import an XML to Dev.  No Excel involved at all.

To be clear, I am trying to move the data in my table from one environment to another.

jmiskey
Kilo Sage
In response to jmiskey

‎03-27-2024 07:03 AM

A co-worker is looking into what can be done with the "Remote Instance" spoke.