Data Archive Question

[d-aizawa]

Thank you to everyone in the community for your help.

In my project, there is a request to archive log (syslog, sysevent, syslog_transaction) tables,
so I am looking into it.

However, there is a restriction that rotation tables cannot be archived,
so we are planning to create one table A
and insert the records of the above log table into that table once a day before archiving.


I have the following questions regarding data archiving.
・I think the archive will be in XML format, but how much will the storage capacity be reduced?
(If you don't archive, tens of thousands of records will accumulate in table A every day, so
Is it more effective than that?)

・Is there an upper limit on the number of records that can be archived?
・If you have any other concerns or precautions, please let us know.

[Mark Roethof]

Hi there,

First question would be, what do people really mean with archive? Is that really the same as ServiceNow archiving functionality? Most cases I come across, no they don't mean the same. So don't simply go for archiving in ServiceNow.

What is it that the customer is really after? Functionally? What are they really wanting to do with this? Or is it something legally? Etc.. What is the real requirement? Don't immediately translate "archiving" into ServiceNow archiving. 

Also understand what ServiceNow archiving is for. It's not intended for what you are mentioning. For me as a consultant that would be a 100% no go, never going to happen, never going to implement, would be a huge consultancy mistake (despite of tables on rotation nog able to use the ServiceNow archiving functionality).

To you question how much storage capacity will be reduced? Zero, nothing. For your examples, it would most likely even increase. Since log tables out-of-the-box are rotated on 7 days * 8 rotations? Archiving most likely keeps this way longer (and always do archiving + destroy rule. No destroy rule? No archiving!

The size depends on the customer ofcourse. Though for one of my recent customers, all the logs were about 1 TB. Imagine if you start archiving this in some kind of form for a way longer period.