GCP BigQuery pattern-based discovery

  • Release version: Zurich
  • Updated January 5, 2025
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of GCP BigQuery pattern-based discovery

    The GCP BigQuery pattern-based discovery in ServiceNow enables automated identification and mapping of BigQuery datasets and tables within your Google Cloud Platform (GCP) environment. This discovery populates the Configuration Management Database (CMDB) with relevant data, facilitating better cloud resource management and visibility.

    Show full answer Show less

    To perform this discovery effectively, ensure you meet GCP discovery prerequisites and have the latest Discovery and Service Mapping Patterns application installed from the ServiceNow Store.

    Key Features

    • Resource Identification: Discovers GCP BigQuery datasets, tables, availability zones, datacenters, and cloud service accounts.
    • CMDB Population: Automatically populates multiple CMDB tables including Cloud Service Account, Availability Zone, Google Datacenter, Cloud Database, Cloud Public Database, Database, and Key Value (for tags).
    • CI Relationships: Establishes relationships between configuration items (CIs) such as hosting, containment, usage, and replication, supporting comprehensive service mapping.
    • Tag Collection: Captures GCP tags associated with BigQuery datasets and stores them in the Key Value table for enhanced asset metadata and governance.

    Key Outcomes

    • Comprehensive Asset Visibility: Gain detailed insight into BigQuery datasets and tables, their hosting datacenters, availability zones, and associated service accounts.
    • Enhanced CMDB Accuracy: Up-to-date and accurate CMDB entries with operational and install status information, enabling improved change and incident management.
    • Improved Cloud Governance: Tag discovery supports governance and compliance initiatives by maintaining metadata on datasets.
    • Service Mapping Enablement: CI relationships allow for precise service mapping and dependency tracking within your GCP environment.

    Discovery and Service Mapping Patterns finds GCP BigQuery datasets and tables on your cloud environment. Discovering some of these resources may require updating to the latest version of the Discovery and Service Mapping Patterns application from the ServiceNow Store.

    Pattern-based discovery and mapping requirements

    Verify the GCP discovery prerequisites section in Google Cloud Platform (GCP) Cloud discovery using Patterns.

    Data collected by Discovery during horizontal discovery

    Discovery populates the data in the CMDB when running the Google Cloud Platform (GCP) - BigQuery DB pattern.

    Table 1. Cloud Service Account [cmdb_ci_cloud_service_account]
    Field Description
    Account Id [account_id] Name of the project used for the discovery.
    Object ID [object_id] Name of the project used for the discovery.
    Datacenter Type [datacenter_type] Datacenter type: Google Datacenter [cmdb_ci_google_datacenter].
    Table 2. Availability Zone [cmdb_ci_availability_zone]
    Field Description
    Name [name] Name of the availability zone.
    Description [short_description] Description of the availability zone.
    State [state] State of the Availability Zone. Possible values are Available or Terminated.
    Table 3. Google Datacenter [cmdb_ci_google_datacenter]
    Field Description
    Name [name] Datacenter or region name.
    Region [region] Datacenter or region name.
    Object ID [object_id] Unique identifier allocated by GCP for this resource.
    Description [short_description] Datacenter or region description.
    Table 4. Cloud DataBase [cmdb_ci_cloud_database]
    Field Description
    Name [name] Name of the BigQuery dataset.
    Object ID [object_id] The fully qualified unique identifier of the dataset in the format projectId:datasetId.
    Install Status [install_status] Install status of the resource. Default value is Installed.
    Operational status [operational_status] Operational status of the resource. Default value is Operational.
    State [state] State of the dataset.
    Fully qualified domain name [fqdn] Fully qualified domain name (FQDN) for accessing the dataset.
    Table 5. Cloud Public DataBase [cmdb_ci_cloud_public_database]
    Field Description
    Name [name] Name of the public BigQuery dataset.
    Object ID [object_id] The fully qualified unique identifier of the dataset in the format projectId:datasetId.
    Vendor [vendor] Cloud vendor. Value is set to GCP.
    Install Status [install_status] Install status of the resource. Default value is Installed.
    Operational status [operational_status] Operational status of the resource. Default value is Operational.
    State [state] State of the public dataset.
    Fully qualified domain name [fqdn] FQDN for accessing the public dataset.
    Table 6. Database [cmdb_ci_database]
    Field Description
    Name [name] Name of the BigQuery table.
    Type [type] Database type. Value is set to bigquery.
    Install Status [install_status] Install status of the resource. Default value is Installed.

    CI relationships

    The Google Cloud Platform (GCP) - BigQuery DB pattern creates these relationships to support GCP BigQuery discovery.

    CI Relationship CI
    Google Datacenter [cmdb_ci_google_datacenter] Hosted on::Hosts Cloud Service Account [cmdb_ci_cloud_service_account]
    Google Datacenter [cmdb_ci_google_datacenter] Contains::Contained by Availability Zone [cmdb_ci_availability_zone]
    Cloud DataBase [cmdb_ci_cloud_database] Hosted on::Hosts Cloud Service Account [cmdb_ci_cloud_service_account]
    Cloud Service Account [cmdb_ci_cloud_service_account] Uses::Used by Cloud Public DataBase [cmdb_ci_cloud_public_database]
    Cloud DataBase [cmdb_ci_cloud_database] Hosted on::Hosts Google Datacenter [cmdb_ci_google_datacenter]
    Cloud DataBase [cmdb_ci_cloud_database] Replicates to::Replicated by Google Datacenter [cmdb_ci_google_datacenter]
    Cloud Public DataBase [cmdb_ci_cloud_public_database] Replicates to::Replicated by Google Datacenter [cmdb_ci_google_datacenter]
    Cloud DataBase [cmdb_ci_cloud_database] Contains::Contained by Database [cmdb_ci_database]
    Key Value [cmdb_key_value] References Cloud DataBase [cmdb_ci_cloud_database]

    GCP Tag discovery

    The Google Cloud Platform (GCP) - BigQuery DB pattern collects tags and populates them in the Key Value [cmdb_key_value] table.

    Table 7. Key Value [cmdb_key_value]
    Field Description
    Key [key] Tag name.
    Value [value] Tag value.
    Configuration item [configuration_item] References the Cloud DataBase [cmdb_ci_cloud_database] table.