I want to extract more than 3 million records created for a catalog item

[MohammedYaseen]

Hi Team,

How to extract more than 3 million records created for a catalog item.

Will extracting cause any slowness in Servicenow

Thanks

[Community Alums]

Hi @MohammedYaseen ,

At the time of Extracting the records like "3 million" ,it's a big number, so the instance will take more time for the export. Also, 3 million cannot be extracted if you haven't set the limit.

To solve the issue, set the limit property for the file type to a higher value.

For example, by default, the limit for CSV export is 10,000 records. If you need to export 15,000 records, you can set (or add if not exists) the 'glide.csv.export.limit' system property to change the limit to 15,000 . Details about other glide.csv, glide.excel and glide.pdf system properties can be found here.

[Community Alums]

Hi @MohammedYaseen ,

[shloke04 · Accepted solution]

Hi @MohammedYaseen ,

I will not recommend increasing the export limit to extract 3 million data from ServiceNow table as it will impact platform performance health. If still you want to go down that route below doc link gives detailed steps on how export limit can be managed:

https://docs.servicenow.com/bundle/washingtondc-platform-administration/page/administer/exporting-da...

Couple of recommended options I would suggest here:

1. You can break your export into smaller data set and follow the detailed steps mentioned in ServiceNow docs:

https://docs.servicenow.com/bundle/washingtondc-platform-administration/page/administer/exporting-da...

2.  You can make use of the solution mentioned in the article below:

https://davidmac.pro/posts/2021-07-02-sn-bulk-export/

3. Another approach can be similar to what's mentioned in step 1 is to make use of Rest Web Services which does the manual work for you through REST API. Detailed steps are called out in below HI article:

https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB0727636

[MohammedYaseen]

Thanks alot