Live Archive with RaptorDB Professional V2
Summarize
Summary of Live Archive with RaptorDB Professional V2
Live Archive with RaptorDB Professional V2 enables ServiceNow customers to move records and attachments from the primary database to scalable object storage. This process frees up primary storage, enhances query performance on active data, and retains archived data accessibility for compliance and reporting. The capability is exclusive to RaptorDB Professional and requires only plugin installation without additional object storage configuration or downtime during upgrade.
Show less
Key Features
- Data Migration: Moves archived records and attachments to compressed columnar format object storage, freeing primary database space.
- Accessibility: Archived data remains searchable and accessible in the same manner as live data, integrated with ServiceNow AI Platform.
- Security: Applies the same ACLs, role-based access, and row-level security to archived data as live records; data is encrypted at rest and in transit.
- S3 Facade Architecture: Utilizes an S3 facade communication layer to ensure authentication, routing, and resilience with automatic endpoints per datacenter to ensure availability.
- Archive Rules: Leverages existing archive rules framework, supporting time-based or field-based conditions, without requiring rule changes during migration.
- Monitoring: Enables tracking of object storage volume and archive table sizes in the Data Management Console with daily refreshed statistics.
- Space Reclamation: Reclaims primary database space as data migrates, improving instance responsiveness and query performance over time.
Benefits for ServiceNow Customers
- Improves system performance by reducing primary database size and query load.
- Supports compliance and audit needs by retaining closed records in accessible storage.
- Offers scalable, cost-effective storage for large data archives without impacting live system operations.
- Maintains seamless security and access control consistent with live data policies.
- Ensures continuous availability of archived data even during datacenter outages via S3 facade redundancy.
Next Steps
To implement Live Archive, upgrade to RaptorDB Professional V2 and install the Live Archive plugin. For detailed installation instructions, see the Live Archive installation guide or contact your ServiceNow account representative for upgrade assistance.
Live Archive (formerly Data Archiving) moves records and attachments to object storage, freeing up space in the primary database while keeping data accessible for compliance and reporting. This capability improves query performance and provides scalable storage for large archives.
When you upgrade to RaptorDB Professional V2 and install Live Archive, you can migrate archived records and attachments from the primary instance to a dedicated object storage. The archived data remains accessible in the same way as regular tables. This capability is exclusive to RaptorDB Professional.
Object storage doesn't require additional configuration beyond plugin installation.
During the migration to object storage, data management processes that interact with archive tables are temporarily paused. However, no downtime is required for the upgrade itself. For more information about upgrading to RaptorDB Professional, contact your account representative.
Key benefits
- Moves data to object storage in a compressed columnar format, freeing up primary storage.
- Improves query performance on active data by reducing the primary database size.
- Reuses existing archive rules without requiring changes.
- Retains closed records for compliance and audit purposes.
- Provides scalable storage capacity for larger archives without impacting primary database performance.
- Keeps archived data accessible and searchable to users on the ServiceNow AI Platform so historical data can be queried and reported on as needed.
- Applies the same security controls, ACLs, and role-based access to archived records as to live records.
- Enables you to monitor live and archive table volumes in the Data Management Console.
Live Archive architecture
Live Archive extends the existing archive rules framework. When records match the archive rule conditions, they move from primary tables to archive tables.
- S3 facade
- To keep archived data accessible even if a datacenter is unavailable, Live Archive uses an S3 facade, which is a communication layer between RaptorDB Professional and object storage. It handles authentication, routing, and resilience.
- Live Archive automatically creates two S3 facade endpoints, one per datacenter in your instance's datacenter pair. If one datacenter is unavailable, the other endpoint keeps the archived records remain accessible. The S3
facade is verified during Live Archive installation.
Figure 1. Archiving with S3 facade - Archive rules
-
Use archive rules to define which records should be archived. Time-based conditions are common. For example, to archive incidents closed more than two years ago. However, any field-based condition is supported.
- Monitoring storage
- Track object storage volume in the Data Management Console. Storage stats refresh once daily and reflect compressed sizes.
- Primary database space reclamation
-
As records move to object storage, RaptorDB reclaims space in the primary database.
The primary database might not shrink immediately in absolute size, especially when new records continue to be created, but archiving slows primary database growth and reduces the volume of data processed on every query. The performance and operational benefits of archiving appear in faster query times and instance responsiveness.
- Security
- Live Archive maintains all ServiceNow AI Platform security controls. ACLs, role-based access, and row-level security apply to archived records the same way as live records. Users without access to live records cannot access the corresponding archived records.
To install Live Archive after upgrading to RaptorDB Professional V2, see Install Live Archive.