question Re: I want to extract more than 3 million records created for a catalog item in Virtual Agent forum

I want to extract more than 3 million records created for a catalog item

MohammedYaseen — Wed, 21 Feb 2024 07:20:02 GMT

Hi Team,

How to extract more than 3 million records created for a catalog item.

Will extracting cause any slowness in Servicenow

Thanks

Re: I want to extract more than 3 million records created for a catalog item

Community Alums — Wed, 21 Feb 2024 07:28:04 GMT

Hi @MohammedYaseen ,

At the time of Extracting the records like "3 million" ,it's a big number, so the instance will take more time for the export. Also, 3 million cannot be extracted if you haven't set the limit.

To solve the issue, set the limit property for the file type to a higher value.

For example, by default, the limit for CSV export is 10,000 records. If you need to export 15,000 records, you can set (or add if not exists) the 'glide.csv.export.limit' system property to change the limit to 15,000 . Details about other glide.csv, glide.excel and glide.pdf system properties can be found here.

Re: I want to extract more than 3 million records created for a catalog item

shloke04 — Wed, 21 Feb 2024 07:30:18 GMT

Hi @MohammedYaseen ,

I will not recommend increasing the export limit to extract 3 million data from ServiceNow table as it will impact platform performance health. If still you want to go down that route below doc link gives detailed steps on how export limit can be managed:

https://docs.servicenow.com/bundle/washingtondc-platform-administration/page/administer/exporting-data/concept/c_ExportLimits.html

Couple of recommended options I would suggest here:

1. You can break your export into smaller data set and follow the detailed steps mentioned in ServiceNow docs:

https://docs.servicenow.com/bundle/washingtondc-platform-administration/page/administer/exporting-data/task/t_BreakUpALargeExport.html

2. You can make use of the solution mentioned in the article below:

https://davidmac.pro/posts/2021-07-02-sn-bulk-export/

3. Another approach can be similar to what's mentioned in step 1 is to make use of Rest Web Services which does the manual work for you through REST API. Detailed steps are called out in below HI article:

https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB0727636

Re: I want to extract more than 3 million records created for a catalog item

MohammedYaseen — Wed, 21 Feb 2024 12:32:03 GMT

Thanks alot

Re: I want to extract more than 3 million records created for a catalog item

Community Alums — Wed, 21 Feb 2024 13:42:41 GMT

Hi @MohammedYaseen ,

Re: I want to extract more than 3 million records created for a catalog item

shloke04 — Mon, 26 Feb 2024 06:47:34 GMT

Hi @MohammedYaseen - If your query is resolved then do mark the answer as correct and close this thread.