Components and process of Identification and Reconciliation

  • Release version: Washingtondc
  • Updated February 1, 2024
  • 3 minutes to read
  • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Components and Process of Identification and Reconciliation

    The Identification and Reconciliation (IRE) functionality in the Configuration Management Database (CMDB) ensures accurate management of Configuration Items (CIs). It utilizes an Identification and Reconciliation engine, rules, and tasks to uniquely identify and reconcile CIs, preventing duplicates and maintaining data integrity.

    Show full answer Show less

    Key Features

    • Identification Process: Determines if a CI is new or already exists in the CMDB using identification rules or unique IDs from data sources.
    • Reconciliation Process: Updates CI attributes by allowing only designated authoritative data sources to modify the CMDB in real-time, without a staging area for verification.
    • De-duplication Tasks: Groups duplicate CIs encountered during the process, allowing users to review and manage them effectively.
    • Reclassification Tasks: Facilitates the classification of CIs if automatic reclassification is disabled, generating tasks for manual review.
    • APIs: Centralized APIs support various data sources like Discovery and Import Sets and enforce identification and reconciliation before data is stored in the CMDB.

    Key Outcomes

    By implementing the IRE functionality, ServiceNow customers can expect to:

    • Enhance data integrity in the CMDB by preventing duplicate CIs and ensuring only validated data is entered.
    • Streamline the process of managing CIs through automated identification and reconciliation tasks.
    • Utilize APIs effectively to integrate various data sources while maintaining consistency and accuracy in the CMDB.

    The CMDB Identification and Reconciliation functionality is supported by the Identification and Reconciliation engine (IRE), rules, and tasks. Identification rules, reconciliation rules, IRE data source rules, de-duplication tasks, and reclassification tasks determine how IRE identifies and reconciles CI.

    Concepts and Components of Identification and Reconciliation

    Identification
    Process of uniquely identifying CIs, to determine if a CI already exists in the CMDB or if it is a newly discovered CI that must be added to the CMDB. Identification processes rely on identification rules, or on unique IDs for CIs that data sources can provide.
    Reconciliation

    Process of reconciling CIs and CI attributes by allowing only designated authoritative data sources to write to the CMDB at the CI table and attribute level. The CMDB is updated in real time as records are being processed. There is no staging area to verify the reconciliation activities before they are committed. Reconciliation processes rely on reconciliation rules and IRE data source rules.

    Reconciliation is required only for update operations, when the identification process identifies a CI in the CMDB that matches an incoming CI in the payload. When IRE inserts a new CI, reconciliation is not applied.

    De-duplication tasks
    If the instance encounters duplicate CIs during the Identification and Reconciliation process, it groups each set of duplicate CIs into a de-duplication task. Review the information in these tasks to see how it was determined that these CIs are duplicates.
    Reclassification tasks
    During the CI identification process, a matched CI might need to be upgraded, downgraded, or switched to another CI class. If automatic reclassification is disabled, then the system generates a reclassification task. Review the information in these tasks, and decide whether a manual reclassification of the CI is appropriate.
    APIs

    The Identification and Reconciliation APIs are a centralized set of APIs that can be used with different sources of data such as Discovery, Monitoring, or Import Sets. You can use it to enforce Identification and Reconciliation before data is stored in the CMDB. Data sources do not directly write to the CMDB. Instead, they call APIs first to ensure that the data being written does not introduce inconsistencies.

    Identification engine APIs are accessible in scoped apps. The Configuration Management For Scoped Apps (CMDB) plugin (com.snc.cmdb.scoped) allows a scoped app in scripts to use the prefix 'sn_cmdb.IdentificationEngine.<method>' to access identification engine APIs. The Configuration Management For Scoped Apps (CMDB) plugin is activated in base systems.

    • createOrUpdateCI(): A scriptable API that creates or updates a CI based on identification and reconciliation rules.
    • identifyCI(): Similar to the createOrUpdateCI API, but does not commit the result to the database. Use this API with a given payload to find out if the identification engine will perform insert or update operations, without committing the operation.
    • CreateOrUpdateCIEnhanced()​: A scriptable API that provides the functionality of enhanced IRE features such as partial payload, partial commit, incomplete payload, and deduplication of payload items. You can select the enhanced features to use. However, if you enable partial payloads, then deduplication of payload items and partial commit are automatically enabled.
    • identifyCIEnhanced: Similar to the createOrUpdateCIEnahnced API, but does not commit the result to the database. Use this API with a given payload to find out if the identification engine will perform insert or update operations, without committing the operation.
    • CMDBTransformUtil: An API to be used exclusively with Import Sets to apply Identification and Reconciliation processes to data imported by Import Sets.

    Predefined identification are included for many of the tables in the base system. You can customize these rules for your organization. When a new table is created in the CMDB, it derives identification and reconciliation rules from its parent table if these rules exist. To apply identification and reconciliation rules to a new table, create the rules either at the child level or at its parent level.

    Process flow of Identification and Reconciliation

    Figure 1. IRE
    Data Flow from various data sources into the CMDB.

    Identification and Reconciliation Engine (IRE)

    Identification and Reconciliation engine (IRE) is a rule-based engine, operating as an underlying key component in Identification and Reconciliation. IRE provides a centralized framework to perform identification and reconciliation processes across different data sources. IRE uses identification rules, reconciliation rules, and IRE data source rules when processing incoming data before inserting or updating data in the CMDB. IRE processes help maintain data integrity in the CMDB.
    • IRE prevents duplicate CIs by uniquely identifying CIs.​
    • IRE reconciles CI attributes by allowing only authoritative data sources to write to CMDB.