Record removal process in Service Graph Connector for GCP

  • Release version: Xanadu
  • Updated October 12, 2025
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Record Removal Process in Service Graph Connector for GCP

    The Service Graph Connector for GCP manages record removal through soft and hard deletion methods, ensuring that data no longer needed is handled appropriately. This process automatically updates the Install Status of related Configuration Management Database (CMDB) Configuration Items (CIs) to reflect their retired or deleted status after data pulls.

    Show full answer Show less

    Key Features

    • Soft Deletion: Marks records as retired instead of permanently deleting them, allowing for potential restoration. This is implemented from version 1.11.0, where the Install Status and Operational Status of CIs are updated if they are not discovered in the latest data pull.
    • Hard Deletion: Permanently removes records from the system, making them unrecoverable. This method is used for the SG-GCP Software Inventory data source.
    • Integration Process: The Source [sysobjectsource] table is utilized to track and manage CIs, including modifications to source native keys (SNKs) to identify connections.
    • Connection Properties: The Use Record Removal and lookbacktimeindays properties control the behavior of the record removal process, with defaults set during upgrades.
    • Data Sources: Soft deletion applies to various GCP resources, including folders, projects, networks, and Kubernetes components.

    Key Outcomes

    By utilizing the record removal process, ServiceNow customers will be able to maintain an organized and accurate CMDB by ensuring that outdated or unrecognized records are marked appropriately. This contributes to better data management and reporting, ultimately enhancing the efficiency of resource tracking and maintenance within the Service Graph Connector for GCP.

    The Service Graph Connector for GCP uses soft deletion and hard deletion to manage the removal of records.

    Record removal is the process of handling data that is no longer needed. For any discovered resources that are deleted later after pulling data, the Service Graph Connector for GCP automatically updates the Install Status field of the associated CMDB CI classes to indicate any retired or deleted records.

    Soft deletion

    Soft deletion involves marking the install status of a record as retired rather than permanently deleting it from the system. The record remains in the database, making it possible to reference or restore it later.

    Integration Commons Record Removal is implemented from Service Graph Connector for GCP version 1.11.0 to mark the Install Status and Operational Status of configuration items (CIs) as retired if they aren't discovered during the latest pull​. This implementation verifies the Last Scan attribute of the CIs in the Source [sys_object_source] table to identify CIs that aren't discovered during the latest pull​. Additionally, the source native keys (SNKs) for all CIs are modified to include the connection alias ID to identify the connection that discovered specific CIs.

    Soft deletion for the Service Graph Connector for GCP 1.11.0 version relies on the Source [sys_object_source] table and the Use Record Removal and lookback_time_in_days connection properties. Soft deletion for the Service Graph Connector for GCP 1.10 version and earlier relied on the SG-GCP Extension Attributes [sn_gcp_integ_extension_attributes] table.

    After upgrading to version 1.11.0, the value of the Use Record Removal connection property is set to true when the import is run for the first time. Consequently, the latest SNKs for the CIs are included in the Source [sys_object_source] table. Record removal is implemented from the subsequent run.

    After upgrading to version 1.11.0, the value of the lookback_time_in_days connection property is set to null by default. During the initial run after the upgrade, the Source [sys_object_source] table is queried for all records that the connection discovered. By default, the value is set to 15 after the initial run. Two weeks after the initial run, the Source [sys_object_source] table is queried for all records that weren't discovered in the past 15 days. All records that weren't discovered in the past 15 days are marked as retired.

    Soft deletion is enabled for the following data sources in Service Graph Connector for GCP:
    • SG-GCP Folder
    • SG-GCP Project
    • SG-GCP Network
    • SG-GCP Subnet
    • SG-GCP Storage Volume
    • SG-GCP Storage Volume Snapshot
    • SG-GCP Security Group
    • SG-GCP VM Instance
    • SG-GCP Load Balancer Pool
    • SG-GCP Load Balancer Pool Member
    • SG-GCP Load Balancer Health Service
    • SG-GCP Load Balancer
    • SG-GCP Load Balancer Service
    • SG-GCP Cloud Database
    • SG-GCP Cloud Function
    • SG-GCP Cloud Object Storage
    • SG-GCP Kubernetes Cluster
    • SG-GCP Kubernetes Node
    • SG-GCP Kubernetes Pod
    • SG-GCP Kubernetes Service
    • SG-GCP Kubernetes Namespace
    • SG-GCP Kubernetes Deployment
    • SG-GCP Kubernetes Replicaset
    • SG-GCP Kubernetes Cluster Roles
    • SG-GCP Kubernetes Cluster Role Binding
    • SG-GCP Kubernetes Node Pool

    From Service Graph Connector for GCP version 1.10.0, the SG-GCP Generic Resource data source uses the post-script method for soft deletion, which relies on the Source [sys_object_source] table. For more information about the post-script method, see Post-script method.

    Hard deletion

    Hard deletion involves permanently deleting a record from the system. The record is removed from the CMDB and can't be referenced or restored later. The SG-GCP Software Inventory data source uses the hard deletion method for the deletion of records.