Join the #BuildWithBuildAgent Challenge! Get recognized, earn exclusive swag, and inspire the ServiceNow Community with what you can build using Build Agent.  Join the Challenge.

Problems when importing from CSV file or XLfile

peterdurup
Mega Contributor


I try to import data from a file formatted as either a CSV file or an XL spreadsheet.

Either way I end up in an error:   Connection reset by peer.

This happens if I try to load more than 4000 rows. I have tried the same with app. 700 rows and then it works fine.

My problem is that I need to load more than 3 million rows so chunking it up is not a way to handle it.

Trying to load a CSV it fails because there are now fields in Fuji where I can enter the delimiter code and header row. (I guess)

Does anybody know what is causing this.

System is running on Fuji

1 ACCEPTED SOLUTION

It seemed that it was a limit that prevented me from importing,


I added a new system property: com.glide.processors.XMLProcessors.record_count and set it to 400000, then I tried to upload from my spreadsheet again and succeded in loading 20.000 records.


Thank you


View solution in original post

8 REPLIES 8

tony_barratt
ServiceNow Employee
ServiceNow Employee

Hi Peter,



What file retrieval method are you using?


Data Sources - ServiceNow Wiki


..


3 File Retrieval Methods  

After defining the files that are compatible for importing,



Could you expand a little on this sentence:


"Trying to load a CSV it fails because there are now fields in Fuji where I can enter the delimiter code and header row. (I guess)"



Can you get logs from the server that hosts the file you are fetching?



Best Regards



Tony


I am using a Load data, and I wonder why it is not asking about the delimiter when I try to load from a CSV file, I have seen pictures from previous versions where ther is a field for that. The data is lying on my own PC, but I don't konw which logs I should look for.


Peter,


if you mention csv delimiter, its easier for system to differentiate each columns.


usually it is "|" or "," or ";"



Thanks,


Hi Peter,



I wrongly assumed you were using a data source rather than System Import Sets > Load Data.



My update above can safely be ignored!



Best Regards



Tony