Data Archiving Performance Impact

rlatorre · ‎09-05-2017

We are activating the Archive plugin. The initial archive will be a few million records. At OOB settings, it would take 6 months or more to catch up. OOB settings are:

Number of records (Batch Size) to archive when archiver runs: 100
Max number of batches (Max Iterations) to process when archiver runs: 10
The schedule jobs runs every hour.

We'd like to increase volume and / or frequency and want to know what type of impact that will have on the application. Are there recommendations from ServiceNow? I have not been able to find any in documentation.

shruti_tyagi · ‎09-05-2017

Hi Robert,

By default an archive rule follows these processing rules:

Archives 100 records for each batch job
Sleeps 1 second between batch jobs
Runs 10 batch jobs in an archive run (every hour)

If you change the interval of job from 1 hour to some lower value, job may sometimes not finished in 1 hour and hence it will not run but if archive threads will pick up to run on other node it can cause problems. Check this kb article:

https://hi.service-now.com/kb_view.do?sys_kb_id=116b858e0ffd424098f7982be1050efe

You still have option to run 10 batch jobs every hour and 100 records per batch job (1000 records). And performance of job depends on several factors like size of table, indexes, performant queries and instance config. So before moving forward I would recommend to clone one subprod from prod and check the performance if archive job.

I hope this makes sense.

Thanks

Shruti

If the reply was informational, please like, mark as helpful or mark as correct!

View solution in original post

rlatorre · ‎11-05-2018

This is the message I receive now:

You do not have sufficient privileges to access this knowledge item

manish123 · ‎10-30-2018

Hi All,

We have configuration item field in Incident table and Archive Rule has been implemented on CMDB_CI table. So, whenever we open an Incident form for logging incident. The loading of the form takes long time and to improve the performance, SN suggested to write the logic on configuration item field, which restrict the system to reach the value from cmdb_ci table only not from ar_cmdb_ci table.

Can anyone please let me know whether this is possible or not? If so then any type of guidance / help will be much appreciated.

shivanipatel · ‎09-22-2017

Robert,

This link provides many resources about data archiving. Perhaps it will help with your question: Archive data

Best,

Shivani Patel

If you feel that your question was answered, we would greatly appreciate if you could mark the appropriate thread as "Correct Answer". This allows other customers to learn from your thread and improves the ServiceNow Community experience.

manish123 · ‎10-30-2018

Hi Shivani,

We have configuration item field in Incident table and Archive Rule has been implemented on CMDB_CI table. So, whenever we open an Incident form for logging incident. The loading of the form takes long time and to improve the performance, SN suggested to write the logic on configuration item field, which restrict the system to reach the value from cmdb_ci table only not from ar_cmdb_ci table.

Can anyone please let me know whether this is possible or not? If so then any type of guidance / help will be much appreciated.

Kshitij Sheth · ‎10-02-2019

where is the interval I can see for archival? I can't see something called 1 hour