Performance enhancements for Indicator nightly job
Summarize
Summary of Performance Enhancements for Indicator Nightly Job
The latest release introduces significant performance enhancements for the Indicator nightly job, focusing on parallel processing capabilities to improve data handling efficiency. This includes the addition of two custom queues: the Indicator Data Queue for processing indicators and the Supporting Data Queue for managing control, risk, and issue updates.
Show less
Key Features
- Optimized Processing Architecture: A three-step process has been implemented for effective indicator processing, utilizing custom queues for improved efficiency.
- Batch Processing: Indicators are first queued in the Batch Indicator Data Queue, processed, and then moved to the Indicator Supporting Data Queue for further updates and data collection.
- Supporting Data Collection Job: This job collects and manages supporting data, significantly reducing execution time and enhancing overall performance.
- Data Model Changes: New fields in the Indicator template, such as Sample collection type (Count or Percentage) and Due date duration, facilitate better management of indicator tasks.
Key Outcomes
These enhancements allow ServiceNow customers to process a larger number of indicators more quickly and efficiently. As a result, users can expect improved data handling, faster execution times, and enhanced management of indicator tasks, ultimately leading to better decision-making and resource allocation within governance, risk, and compliance activities.
To support parallel processing capabilities, two additional custom queues such as the Indicator Data Queue for processing indicators, and the Supporting Data Queue for handling events related to control, risk, and issue updates and to collect the supporting data, have been introduced.
New architecture for effective processing of indicators
The execution of indicators has been optimized by implementing a three-step process, utilizing two custom queues for efficient processing.
In the initial step, a set of indicators requiring processing is queued up in the Batch Indicator Data Queue. The Batch Indicator Data Processor then runs the indicators, sets the status, and creates the indicator results or tasks. The indicators are then moved to another custom queue for supporting data collection and updating dependent objects like controls, risks, and issues.
In the second step, the Indicator Supporting Data Processor picks up the indicator records from the Indicator Supporting Data Queue and updates the control or risk status, also creating or updating issues based on the configuration. Then the indicator is pushed to the Indicator Statistics Table for support data collection.
Finally, the Supporting Data Collection Job picks up the indicator records from the Supporting Data Statistics Table, starts collecting supporting data for the indicators, and leverages both the default queue and additional custom queues for efficient processing.
This architecture supports execution of a large number of indicators in significant time. The Supporting Data Collection Job introduced to collect supporting data improves the data handling process considerably. Moreover, the time taken to execute the data is considerably less.
Data model changes
The Sample collection type field added in the Indicator template form, has options either Count or Percentage. The default value is Count. If you select Percentage, you can provide the percentage value to collect the supporting data.
The Due date duration (days) field is added for manual indicator in the Indicator template and Indicator forms to capture the indicator task due date. Based on this due date, reminder emails are sent to the indicator task owners.
A new field introduced in the indicator supporting data table, which is of type JSON, helps in efficient data management.
- For more information related to the table changes, see Tables installed with Governance, Risk, and Compliance.
- For more information on the additional system properties, see Governance, Risk, and Compliance properties.
- For Indicator form changes, see Create a GRC indicator.
- For the Indicator template form changes in Compliance Workspace, see Create a GRC indicator template using the Compliance Workspace.
- For the Indicator template form changes in the classic UI, see Create a GRC indicator template.