Sending data from Servicenow to MID server in chunks

[Reedsy]

We need to send all table data from SN to Mid server for the past 7 years.We are making use of export sets to achieve this and works as expected.But those 7 years data when sent at once is taking time and causes performance issues.Is there any way to achieve this instead of creating multiple export set  for every year or manually changing the filter condition for the year?

All we need is to data from SN to mid server one year by another for all tables.

[shloke04]

Hi @Reedsy 

Solution for the same scenario has been provided by ServiceNow in their official HI article published as below:

To solve the issue, try one or more from the following list:

• Add more filters to decrease the number of records in the results
• Avoid using fields that have no index for filtering and sorting
• Export to a different format. Try a more compact format, such as CSV
• Break up the export. See Break Up a Large Export

Posting the link as well for this:

https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB0538303

Hope this helps. Please mark the answer as correct/helpful based on impact.

Regards,
Shloke

[Reedsy]

Hi @shloke04 

Thank you for the response.

yes we are filtering using created between XXX and YYY.We use Csv only.But the issue is in a export set we can link only one export defintion to it.Imagine if we are sending incident table records for 7 years,having the difficulty in pushing all of them at once. Do we need to create export set for every year for this table or do we have any other workaround for sending 7 years data one by one without any manual action or by avoidance of creating multiple export set or via a post script which can update the filter condition to next year?

[shloke04]

Hi @Reedsy 

Couple of things to note here:

1) What you have stated is correct, there is no OOB functionality or script functionality available through which you can do a pagination or filter records and send everything in a single export set.

Solution:

What you need to do here is create multiple export set and then in Export set definition please make sure to apply a filter based on Created or Updated so that only for a certain period of time the records are sent.

Hope this helps. Please mark the answer as correct/helpful based on impact.

Regards,
Shloke

[Reedsy]

Thank you @shloke04 

We thought of avoiding multiple creation of export sets.But thank you for clarifying that there is no OOB.