Problems when importing from CSV file or XLfile

peterdurup
Mega Contributor


I try to import data from a file formatted as either a CSV file or an XL spreadsheet.

Either way I end up in an error:   Connection reset by peer.

This happens if I try to load more than 4000 rows. I have tried the same with app. 700 rows and then it works fine.

My problem is that I need to load more than 3 million rows so chunking it up is not a way to handle it.

Trying to load a CSV it fails because there are now fields in Fuji where I can enter the delimiter code and header row. (I guess)

Does anybody know what is causing this.

System is running on Fuji

1 ACCEPTED SOLUTION

It seemed that it was a limit that prevented me from importing,


I added a new system property: com.glide.processors.XMLProcessors.record_count and set it to 400000, then I tried to upload from my spreadsheet again and succeded in loading 20.000 records.


Thank you


View solution in original post

8 REPLIES 8

tony_barratt
ServiceNow Employee
ServiceNow Employee

Hi Peter,



What file retrieval method are you using?


Data Sources - ServiceNow Wiki


..


3 File Retrieval Methods  

After defining the files that are compatible for importing,



Could you expand a little on this sentence:


"Trying to load a CSV it fails because there are now fields in Fuji where I can enter the delimiter code and header row. (I guess)"



Can you get logs from the server that hosts the file you are fetching?



Best Regards



Tony


I am using a Load data, and I wonder why it is not asking about the delimiter when I try to load from a CSV file, I have seen pictures from previous versions where ther is a field for that. The data is lying on my own PC, but I don't konw which logs I should look for.


Peter,


if you mention csv delimiter, its easier for system to differentiate each columns.


usually it is "|" or "," or ";"



Thanks,


Hi Peter,



I wrongly assumed you were using a data source rather than System Import Sets > Load Data.



My update above can safely be ignored!



Best Regards



Tony