Elimination of duplicate citations from UCF Shared list download
Summarize
Summary of Elimination of duplicate citations from UCF Shared list download
This feature addresses the issue of duplicate citations that occur when downloading Unified Compliance Framework (UCF) content from a Shared list. Duplicate citations arise when multiple citations tied to the same Authority Document (AD) are downloaded, each linked to one or more control objectives but having different Source IDs. This duplication can complicate citation management and analysis.
Show less
Key Features
- Deduplication Process: You can retain one citation as active and mark all duplicates as inactive. Control objectives linked to duplicates are reassigned to the active citation.
- Parent–Child Relationship Maintenance: If duplicate citations are part of a parent–child hierarchy, the Source IDs of child citations are updated to associate with the active parent citation, preserving relationships.
- On-Demand Job for Deduplication: An on-demand scheduled job named "UCF citation deduplication issue fix" is available to automatically eliminate duplicates and correct parent–child links without re-importing UCF content.
- Identification Criteria: Citations are considered duplicates only if they share the same Reference ID, Authority document, and Description.
How to Use
- During Import: Deduplication occurs when importing UCF content from a Shared list, ensuring duplicates are automatically handled.
- Post-Import Fix: If you prefer not to re-import, run the on-demand deduplication job via All > System Definition > Scheduled jobs by selecting and executing the UCF citation deduplication fix job.
- Verification: After deduplication, you can view citations grouped by Reference in All > Policy and Compliance > Citations. Active citations are marked true, duplicates false, and control objectives and child citations are properly grouped under the active citation.
Benefits for ServiceNow Customers
- Improves citation data accuracy by eliminating redundant records linked to the same authority document.
- Ensures control objectives remain correctly associated with a single active citation, simplifying compliance tracking.
- Maintains hierarchical citation relationships, which is critical for comprehensive compliance reporting.
- Provides flexibility to apply deduplication either during import or after, minimizing manual cleanup.
You can eliminate duplicate citations associated with the authority documents when you receive citations from UCF content as part of the same Shared list.
You can retain one citation as active and mark the duplicate citations as inactive. Move the control objectives of the duplicate citations to the active citation. If the duplicate citation is part of a parent–child hierarchy, then its Source ID is updated with the Source ID of the active citation.
Duplication of UCF citations
Duplication occurs when you download UCF content that has multiple citations tied to the same Authority Document (AD). However, each of these citations is linked to a control objective or can be linked to multiple control objectives. In such cases, when you download UCF there would be as many citations linked to control objectives. The citations have different Source ID and different control objectives linked to them. Nevertheless, such citations are linked to the same AD.
Duplication is identified when the downloaded citations tied to an authority document have similar Reference, Authority document, and Description details but a different Source ID. Such citations that belong to the same authority document but downloaded multiple times are termed as duplicate citations.
Deduplication of UCF citations
You can retain one citation as active and mark the rest of the duplicate citations as inactive. The relationship of this inactive citation with that of the control objective is removed from the m2m table. In its stead, the record of the active citation is added to the control objective in the m2m table.
Similarly, the child citations of the duplicate citations, if any, can be grouped with the child citations of the active parent citation in the Citations related list of the active citation. For example, if the citation with Source ID 0123 is being retained, then the parent of the duplicate citation's child citation must be updated as 0123. Or, the child citation's parent Source ID as 0123 must be updated, so that the citation's parent–child relationship is retained.
Fix provided to eliminate duplicate citations
- Import data from the UCF Shared list. To download a UCF shared list, see Download a UCF shared list.
- Run the UCF citation deduplication issue fix on-demand job if you don’t want to import UCF again. This job eliminates the duplicate citations and fixes the parent–child relationship by appending the child citations of the inactive parent citation to the active parent.
- To run the on-demand job, navigate to .
- Select UCF citation deduplication issue fix and click Execute Now.
- Navigate to
- Select Group By and right-click the List controls icon.
- Select Reference in the list.
You can view citations with unique Reference ID, unique Description, and each citation belongs to a different AO. In the Active column, the active citation is true, and the duplicate citations are marked as false. Select and open one of the citation record, all control objectives are grouped in the Control objectives related list, and its child citations in the Citations related list.
Note:Citations are considered as duplicate only when their Reference ID, Authority document, Description are the same. Even if one of these conditions isn’t fulfilled, then they’re considered as two different citations and not as duplicate.