Data mapping for Service Graph Connector for GCP
Data from the GCP data sources is mapped and transformed into the ServiceNow CMDB Configuration Item (CI) class definitions using the Robust Transform Engine (RTE). Data is inserted into the ServiceNow CMDB using the Identification and Reconciliation Engine (IRE).
Data mapping for GCP
When you complete setting up the connection, you can configure the integration to periodically pull data from the GCP application.
The following table lists the data sources, the staging tables, the target tables as the CMDB CI classes, and the resource types imported for a GCP project.
| Data source | Staging table | CMDB CI classes | Resource types |
|---|---|---|---|
| SG-GCP Organization | SG-GCP Organization [sn_gcp_integ_sg_gcp_organization] | Cloud Organizations | Organization |
| SG-GCP Folder | SG-GCP Folder [sn_gcp_integ_sg_gcp_folder] | Google Organization Folder | Folder |
| SG-GCP Project | SG-GCP Project [sn_gcp_integ_sg_gcp_project] | Google Organization Project | Project |
| SG-GCP Network | SG-GCP Network [sn_gcp_integ_sg_gcp_network] | Cloud Network | Network |
| SG-GCP Machine Image | SG-GCP Machine Image [sn_gcp_integ_sg_gcp_machine_image] | Image | MachineImage |
| SG-GCP Subnet | SG-GCP Subnet [sn_gcp_integ_sg_gcp_subnet] | Cloud Subnet | Subnetwork |
| SG-GCP Storage Volume | SG-GCP Storage Volume [sn_gcp_integ_sg_gcp_storage_volume] | Storage Volume | Disk |
| SG-GCP Storage Volume Snapshot | SG-GCP Storage Volume Snapshot [sn_gcp_integ_sg_gcp_storage_vol_snapshot] | Storage Volume Snapshot | Snapshot |
| SG-GCP Security Group | SG-GCP Security Group [sn_gcp_integ_sg_gcp_security_group] | Compute Security Group | Firewall |
| SG-GCP Software Inventory | SG-GCP Software Inventory [sn_gcp_integ_sg_gcp_software_inventory] |
When the Software Asset Management (SAM) application isn't installed: When the SAM application is installed: Software Installation |
Instance |
| SG-GCP VM Instance | SG-GCP VM Instance [sn_gcp_integ_sg_gcp_vm_instance] | Virtual Machine Instance | Instance |
| SG-GCP Execute Patch Job | SG-GCP Execute Patch Job [sn_gcp_integ_sg_gcp_execute_patch_job] | Not applicable | Not applicable |
| SG-GCP Hardware Type | SG-GCP Hardware Type [sn_gcp_integ_sg_gcp_hardware_type] | Hardware Type | MachineType |
| SG-GCP VM Hw Consolidation | SG-GCP VM Hw Consolidation [sn_gcp_integ_sg_gcp_vm_hw_consolidation] | Virtual Machine Instance | None |
| SG-GCP Load Balancer Pool | SG-GCP Load Balancer Pool [sn_gcp_integ_sg_gcp_load_balancer_pool] | Load Balancer Pool | TargetPool |
| SG-GCP Load Balancer Pool Member | SG-GCP Load Balancer Pool Member [sn_gcp_integ_sg_gcp_load_balancer_pool_member] | Load Balancer Pool Member | TargetPool |
| SG-GCP Load Balancer Health Service | SG-GCP Load Balancer Health Service[sn_gcp_integ_sg_gcp_load_balancer_health_service] | Cloud Load Balancer Health Service | HealthCheck |
| SG-GCP Load Balancer | SG-GCP Load Balancer [sn_gcp_integ_sg_gcp_load_balancer] | Cloud Load Balancer | BackendService |
| SG-GCP Load Balancer Service | SG-GCP Load Balancer Service [sn_gcp_integ_sg_gcp_load_balancer_service] | Load Balancer Service | ForwardingRule |
| SG-GCP Cloud Database | SG-GCP Cloud Database [sn_gcp_integ_sg_gcp_cloud_database] | Cloud DataBase | Instance |
| SG-GCP Cloud Function | SG-GCP Cloud Function [sn_gcp_integ_sg_gcp_cloud_function] | Cloud Function | Function |
| SG-GCP Cloud Object Storage | SG-GCP Cloud Object Storage [sn_gcp_integ_sg_gcp_cloud_object_storage] | Cloud Object Storage | Buckets |
| SG-GCP Kubernetes Cluster | SG-GCP Kubernetes Cluster [sn_gcp_integ_sg_gcp_kubernetes_cluster] | Kubernetes Cluster | Cluster |
| SG-GCP Kubernetes Node | SG-GCP Kubernetes Node [sn_gcp_integ_sg_gcp_kubernetes_node] | Kubernetes Node | Node |
| SG-GCP Kubernetes Pod | SG-GCP Kubernetes Pod [sn_gcp_integ_sg_gcp_kubernetes_pod] | Kubernetes Pod | Pod |
| SG-GCP Kubernetes Service | SG-GCP Kubernetes Service [sn_gcp_integ_sg_gcp_kubernetes_service] | Kubernetes Service | Service |
| SG-GCP Kubernetes Namespace | SG-GCP Kubernetes Namespace [sn_gcp_integ_sg_gcp_kubernetes_namespace] | Kubernetes Namespace | Namespace |
| SG-GCP Kubernetes Deployment | SG-GCP Kubernetes Deployment [sn_gcp_integ_sg_gcp_kubernetes_deployment] | Kubernetes Deployment | Deployment |
| SG-GCP Kubernetes Replicaset | SG-GCP Kubernetes Replicaset [sn_gcp_integ_sg_gcp_kubernetes_replicaset] | Kubernetes ReplicaSet | ReplicaSet |
| SG-GCP Kubernetes Cluster Roles | SG-GCP Kubernetes Cluster Roles [sn_gcp_integ_sg_gcp_kubernetes_cluster_role] | Kubernetes Cluster Role | ClusterRole |
| SG-GCP Kubernetes Cluster Role Binding | SG-GCP Kubernetes Cluster Role Binding [sn_gcp_integ_sg_gcp_kubernetes_cluster_role_binding] | Kubernetes Cluster Role Binding | ClusterRoleBinding |
| SG-GCP Kubernetes Node Pool | SG-GCP Kubernetes Node Pool [sn_gcp_integ_sg_gcp_kubernetes_node_pool] | Kubernetes Node Pool | NodePool |
| SG-GCP Generic Resource | SG-GCP Generic Resource [sn_gcp_integ_sg_gcp_generic_resource] 주: The SG-GCP Generic Resource data source only works with a service account that has organization-level access. |
Cloud Resource | Resource |
| SG-GCP Annotation | SG-GCP Annotation [sn_gcp_integ_sg_gcp_annotation] | Key Value | Annotation |
| SG-GCP Get Patch Job | SG-GCP Get Patch Job [sn_gcp_integ_sg_gcp_get_patch_job] | Not applicable | Not applicable |
| SG-GCP Generic Resource Annotation | SG-GCP Generic Resource Annotation [sn_gcp_integ_sg_gcp_generic_resource_annotation] | Key Value | Annotation |
For more information on where data is saved when pulling data from a GCP project, see CMDB classes targeted in Service Graph Connector for GCP.
You can use the IntegrationHub ETL app to view the data maps. See IntegrationHub ETL for more information.
Additional information about GCP data sources:
- The SG-GCP Annotation data source populates all labels and tags associated with GCP supported resources to the Key Value table.
- The SG-GCP Generic Resource Annotation data source populates the tags and labels for Generic resources to the Key Value table from Service Graph Connector for GCP version 1.10.0.
- The basic information about a GCP resource is stored in the SG-GCP Extension Attributes [sn_gcp_integ_extension_attributes] table.
- After all the data sources are executed, the Server [cmdb_ci_server] class is updated with the class entry, and then based on the Windows or Linux class, the records are created in the Windows Server [cmdb_ci_win_server] and Linux Server [cmdb_ci_linux_server] classes, respectively.
-
The SG-GCP Generic Resource data source imports data for resources that are categorized as Generic in the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table.
- For any discovered resources that are deleted after pulling data, the Service Graph Connector for GCP automatically updates the Install Status field of the associated CMDB CI classes to indicate any retired or deleted records. For more information, see Life cycle management of records in Service Graph Connector for GCP and Record removal process in Service Graph Connector for GCP.
- When the sn_itom_pattern.use a single hardware type for cloud data centers system property is set to
true, hardware type data is added to the Cloud Hardware Type [cmdb_ci_cloud_hardware_type] table, instead of being added to the Hardware Type [cmdb_ci_compute_template] table from Service Graph Connector for GCP version 1.9.0. For more information, see the Service Graph Connector For GCP - Migrating to a new hardware type model [KB1899584] article in the Now Support Knowledge Base. - When the sn_cmdb_ci_class.use_single_cloud_os_image system property is set to
true, image type data is added to the Cloud Image [cmdb_ci_cloud_os_image] table, instead of being added to the Image [cmdb_ci_os_template] table from Service Graph Connector for GCP version 1.9.0. For more information, see the Service Graph Connector For GCP - Migrating to a new Cloud OS Image model [KB1983751] article in the Now Support Knowledge Base. - The list API calls return only the information that is required to make batch calls and not the entire resource response from Service Graph Connector for GCP version 1.9.0.
- Parallel data loading is enabled for the SG-GCP Annotation, SG-GCP Generic Resource, and SG-GCP Generic Resource Annotation data sources.
- You can configure the AppScript Folder IDs connection property to exclude AppScript folder information from imports starting from Service Graph Connector for GCP version 1.10.0. For more information, see Service Graph Connector for GCP properties.
- The SG-GCP Software Inventory scheduled import runs before the SG-GCP VM Instance scheduled import from Service Graph Connector for GCP version 1.10.0. The SG-GCP Software Inventory scheduled job populates the operating system information for the Server records, which determines the script that needs to be run for deep discovery (Shell script for Linux VMs or PowerShell script for Windows VMs).
- The SG-GCP Get Patch Job scheduled import supports deep discovery by running commands on VMs from Service Graph Connector for GCP version 1.10.0. For information about deep discovery for the Service Graph Connector for GCP, see the Enabling deep discovery for Service Graph Connector for GCP article in the Now Support Knowledge Base.