Breaking up large files due to export limit

Tanisha Hudson
ServiceNow Employee
ServiceNow Employee

I wish to export some data from an instance. The data that I search for returns about 13,000 rows. The .csv threshold limit is only 10,001. How could I extract all the data in chunks? I followed the tutorial, but do not have a solution as this is not working for me.

 

 

This is my output when I filter:

find_real_file.png

 

 

This is the url from that output:

 

https://capman.service-now.com/nav_to.do?uri=%2Fx_snc_instance_int_dc_cmdb_ci_file_system_snap_list.do%3Fsysparm_query%3Dimport_dateONToday@javascript:gs.beginningOfToday()@javascript:gs.endOfToday()%5EnameSTARTSWITHfb%5EORname%3D%2Fdev%2Fmapper%2Fbackupvg-backuplv%5Emount_point!%3D%2Fbackup_rada%26sysparm_first_row%3D1%26sysparm_view%3DXML

 

This returns 13,169 rows.

According to the documentation, I can do this:

 

https://<instance name>.service-now.com/syslog_list.do?XML&sysparm_orderby=sys_id&sysparm_record_count=10000

 

This is what I have done, I have included

 

 

https://capman.service-now.com/nav_to.do?uri=%2Fx_snc_instance_int_dc_cmdb_ci_file_system_snap_list.do%3Fsysparm_query%3Dimport_dateONToday@javascript:gs.beginningOfToday()@javascript:gs.endOfToday()%5EnameSTARTSWITHfb%5EORname%3D%2Fdev%2Fmapper%2Fbackupvg-backuplv%5Emount_point!%3D%2Fbackup_rada%26sysparm_first_row%3D1%26sysparm_view%3DXML&sysparm_orderby=sys_id&sysparm_record_count=10000 

 

I have added: &sysparm_orderby=sys_id&sysparm_record_count=10000 to the end of my url, and hit enter. The  output remains the same.

 

Any suggestion is appreciated

 

 

 

6 REPLIES 6

Mario Quinones1
Mega Guru

Easy option for your case, increase the CSV export limit system property:

 

glide.csv.export.limit

Please mark helpful or correct if this works for you

Hi Mario,

Thank you.

Where would I add this?

 

https://capman.service-now.com/nav_to.do?uri=%2Fx_snc_instance_int_dc_cmdb_ci_file_system_snap_list.do%3Fsysparm_query%3Dimport_dateONToday@javascript:gs.beginningOfToday()@javascript:gs.endOfToday()%5EnameSTARTSWITHfb%5EORname%3D%2Fdev%2Fmapper%2Fbackupvg-backuplv%5Emount_point!%3D%2Fbackup_rada%26sysparm_first_row%3D1%26sysparm_view%3DXML&glide.csv.export.limit

glide.csv.export.limit

Hi,

That is a system property.

 

Check this if you dont want to increase the limit:

https://community.servicenow.com/community?id=community_question&sys_id=9dd44fe9dbd8dbc01dcaf3231f96...

 

8.2 Breaking Up Large Exports

If the number of records to be exported exceeds the actual export limit, you may want to break the export into smaller increments that do not place a significant performance load on the platform.

 

  1. Filter the list to display the records you want to export.
  2. Write down the number of records returned.
  3. If the record number is higher than the defined threshold, issue a sysparm query for the first 10,000 records using the following syntax:
    https://<instance name>.service-now.com/syslog_list.do?XML&sysparm_order_by=sys_id&sysparm_record_count=10000
    This exports the first 10,000 records in order, sorted by the sys_id number.
  4. Find the next record in order, such as 10,001.
  5. Right-click the row and copy the sys_id of the next record you want to export.
  6. Access the next series of records with a greater than or equal to query run against the sys_id of record 10,001.
    The following example shows a query that uses a sys_id of b4aedb520a0a0b1001af10e278657d27. Use the syntax shown in this query to export the next set of records.
    https://<instance name>.service-now.com/syslog_list.do?XML&sysparm_query=sys_id%3E%3Db4aedb520a0a0b1001af10e278657d27&sysparm_order_by=sys_id&sysparm_record_count=10000
    Note: URL queries use typical percent encoding. In this example, the greater than sign (>) is encoded as %3E and the equal sign (=) is encoded as %3D.
  7. Continue issuing this query, using the starting sys_id for the next set of records until you have exported all the necessary records.

 

Please mark as helpful or correct if this works for you

SNUG AM
Giga Guru

From Navigation : System Properties  - >  Import Export

Update the limits to export records default is 10,000.- 15,000

 

find_real_file.png