Archiving large volumes of records

[Dan Metcalfe1]

We have an extremely large incident table, and have activated archiving of inactive incidents that have been closed for more than 14 months.

However, when we left the ‘max number of batches (Max Iterations) to process when archiver runs’ at the default value of 10, Batch Size = 100, we found that multiple batches were attempting to archive the same incident record. This resulted in a much lower number of records actually being archived, so have had to drop the Max Iterations to 1 to prevent this. Now the number of records being archived (with certain related records) is higher than the number of incidents being created each month, but not by much. At the current rate, it will take a considerable length of time to catch up.

Has anyone else had this issue and found a way to address it? Does anyone have any strategies to speed up the archiving process?

[art_anderson2]

Good afternoon,

Notice the solution mentioned above is nearly 5 years old. We are on Washington and going to Xanadu shortly. I looked at our instances Component Status record (i.e. sys_status).  In our system this record (glide.db.archiver) was last updated 2021-02-06, which coincided with our upgrade to "Paris" guessing that the archiver was changed with that family release.  You might check with SN Engineer to confirm my suspicion.

I would consider that this script above may not produce the results you are looking for.  By the way, I am looking for the same thing, I have over 100M records to archive from one take and doing 1000 at a time I fear will truly never complete.

Thanks,

Art

[dhimple_b]

HI Could you please let me me where to apply this script?

[dhimple_b]

Hi Will this script cause any performance issue?

[mfhaciahmetoglu]

Hi, 

I also have a similar problem.

I changed the iteration to 1 one. But the execution stopped after 20 batches. And I still have 70k records to archive.

Any ideas how to tackle this without needing to run the text manually many times?

Thanks.

Best,

Firat