Data mapping for Service Graph Connector for Microsoft Azure
Data from the Azure data sources is mapped and transformed into the ServiceNow CMDB Configuration Item (CI) class definitions using the Robust Transform Engine (RTE). Data is inserted into the ServiceNow® CMDB using the Identification and Reconciliation Engine (IRE).
Data mapping for Azure
When you complete setting up the connection, you can configure the integration to periodically pull data from Azure. The data is loaded into staging tables and then inserted into the target tables.
| Data source | Staging table | Target tables |
|---|---|---|
| SG-Azure Subscriptions | SG Azure Subscriptions [sn_sg_azure_integ_subscriptions] | |
| SG-Azure Datacenter Updation | SG-Azure Datacenter Updation [sn_sg_azure_integ_datacenter_updation] | |
| SG-Azure Resource Group | SG-Azure Resource Group [sn_sg_azure_integ_resource_groups] | |
| SG-Azure Availability Zone | SG-Azure Availability Sets [sn_sg_azure_integ_availability_sets] | |
| SG-Azure Storage Volume | SG-Azure Storage Volume [sn_sg_azure_integ_storage_volume] | |
| SG-Azure Load Balancers | SG-Azure Load Balancers [sn_sg_azure_integ_load_balancers] | |
| SG-Azure Network | SG-Azure Network [sn_sg_azure_integ_network] | |
| SG-Azure Public IP Address | SG-Azure Public IP Address [sn_sg_azure_integ_public_ip_address] | |
| SG-Azure Security Group | SG-Azure Security Group [sn_sg_azure_integ_security_group] | |
| SG-Azure Storage Accounts | SG-Azure Storage Accounts [sn_sg_azure_integ_storage_accounts] | |
| SG-Azure Virtual Machines | SG-Azure Virtual Machine [sn_sg_azure_integ_virtual_machine] | |
| SG-Azure Network Interface | SG-Azure Network Interface [sn_sg_azure_integ_network_interface] | |
| SG-Azure SQL | SG-Azure SQL [sn_sg_azure_integ_sql] | |
| SG-Azure Functions | SG-Azure Functions [sn_sg_azure_integ_functions] | |
| SG-Azure Generic Resources | SG-Azure Generic Resources [sn_sg_azure_integ_generic_resources] 注: The SG-Azure Generic Resources data source imports data for resources that are categorized as Generic in the Service Graph Resource Inclusion Whitelist
[sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table. |
|
| SG-Azure Scale Sets | SG-Azure Scale Sets [sn_sg_azure_integ_scale_sets] | |
| SG-Azure Scale Sets VMs | SG-Azure Scale Sets VMs [sn_sg_azure_integ_scale_sets_vms] | |
| SG-Azure Software | SG-Azure Software [sn_sg_azure_integ_software] 注: The SG-Azure Software data source imports the software data from the ConfigurationData table in the Log Analytics workspace of Azure. The SG-Azure Software import is set to inactive by default. |
When the Software Asset Management (SAM) application isn't installed: When the SAM application is installed: |
| SG-Azure Software Remove | SG-Azure Software Remove [sn_sg_azure_integ_software_remove] The SG-Azure Software Remove import is set to inactive by default. |
When the SAM application isn't installed: When the SAM application is installed: |
| SG-Azure TCP | SG-Azure TCP [sn_sg_azure_integ_tcp] 注: The SG-Azure TCP data source imports the TCP and processes data from the VMConnection and VMProcess tables in the Log Analytics workspace of Azure. To populate the tables, you must first enable the VM insights feature in the Azure portal. For more information, see Enabling VM insights for collecting Azure data. |
TCP Connection Running Process |
| SG-Azure Hardware Template Updation | Hardware templates [sn_sg_azure_integ_hardware_templates] | |
| SG-Azure HW Consolidation | SG-Azure HW Consolidation [sn_sg_azure_integ_hw_consolidation] | |
| SG-Azure Run Command | SG-Azure Run Command [sn_sg_azure_integ_run_command] |
No data created |
| SG-Azure Get Run Command | SG-Azure Get Run Command [sn_sg_azure_integ_get_run_command] |
TCP Connection Running Process |
| SG-Azure Kubernetes Cluster | SG-Azure Kubernetes Cluster [sn_sg_azure_integ_kubernetes_cluster] |
For more information on where data is saved when pulling data from Azure, see CMDB classes targeted in Service Graph Connector for Microsoft Azure and Supported Microsoft Azure resource types.
You can use the IntegrationHub ETL app to view the data maps. See IntegrationHub ETL for more information.
- The Service Graph Connector for Microsoft Azure utilizes the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table to differentiate between generic resources and other supported
resource types.When the sg_azure_generic_resource_type_dynamic_create system property is set to true, the connector populates the following generic resources in the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table.
- Microsoft.Compute/availabilitySets
- Microsoft.Compute/disks
- Microsoft.Compute/locations
- Microsoft.Compute/virtualMachines
- Microsoft.DBforPostgreSQL/servers
- Microsoft.Network/loadBalancers
- Microsoft.Network/networkInterfaces
- Microsoft.Network/networkSecurityGroups
- Microsoft.Network/publicIPAddresses
- Microsoft.Network/virtualNetworks
- Microsoft.ResourceGraph/resources
- Microsoft.Sql/servers
- Microsoft.Storage/storageAccounts
- Microsoft.Web/sites
Alternatively, you can manually add resources to the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table.
Any resource that is not populated in the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table is populated in the Cloud Inventory Resource Inclusion Lists [sa_cloud_inventory_resource_whitelist_list] table.
- The SG-Azure Hardware Template Updation and SG-Azure HW Consolidation import schedules replace the SG-Azure Hardware Template import schedule from the Service Graph Connector for Microsoft Azure 1.12.0 version. The SG-Azure Hardware Template Updation and SG-Azure HW Consolidation data sources fetch only the data of the hardware templates that are used for VMs in Azure, instead of fetching all hardware templates.
- The SG-Azure SQL data source populates the microsoft.dbformysql/flexibleservers and microsoft.dbforpostgresql/flexibleservers resource types in the Cloud
Database [cmdb_ci_cloud_database] table instead of the Cloud Resource [cmdb_ci_cmp_resource] table from the Service Graph Connector for Microsoft Azure 1.14.0 version.
After upgrading to version 1.14.0, run a full data load to migrate all active flexible servers from the Cloud Resource [cmdb_ci_cmp_resource] table to the Cloud Database [cmdb_ci_cloud_database] table.
- All data sources except SG-Azure Scale Sets VMs are migrated from Azure Resource Manager (ARM) APIs to Resource Graph APIs for a full data load from the Service Graph Connector for Microsoft Azure 1.14.0 version. Microsoft Azure doesn't support uniform orchestration-type Scale Set VMs on Resource Graph APIs.
- The import set rows for the SG-Azure Run Command scheduled import job [sn_sg_azure_integ_run_command] remain in Pending state even after the import set is processed.
Related content
CMDB classes targeted in Service Graph Connector for Microsoft Azure