Release Quality dashboard
Summarize
Summary of Release Quality dashboard
The Release Quality dashboard in ServiceNow provides actionable insights into the quality of a product release by consolidating software quality scan summaries and test summaries. It is specifically available for product releases and helps you assess potential bugs, vulnerabilities, and the effectiveness of testing efforts.
Show less
This dashboard is accessible via the Digital Product Release Workspace and appears only for ongoing releases. It brings together data from pipeline executions, task executions, and associated test and software quality summaries, enabling you to monitor release health efficiently.
Configuration and Access
- You need to configure pipelines through external tools integration before metrics can be displayed on the dashboard.
- To access the dashboard, navigate to Workspaces > Digital Product Release Workspace, select a release, and then select the Quality tab on the release record.
Key Features
Data Filters
- Build: Displays pipeline executions (builds) related to the release within a 30-day window, showing recent activity relevant to the release.
- Artifact: Shows artifact versions created in the last 30 days. If "Use latest version" is selected, semantic versions are listed.
- Package: Displays artifact versions associated with the latest package or release candidate package, if applicable.
Note: Artifact and Package options appear only if the release includes artifacts and packages.
Quality Summary Section
This section summarizes software quality scan results from pipeline task executions using the Software Quality Scan Summary data. It includes:
- Vulnerabilities: Total security vulnerabilities, normalized via system properties.
- Overall Coverage: Percentage of code covered by tests; if multiple scan results exist, only total lines and coverage lines are shown.
- Bug Count: Total bugs and average reliability and maintainability ratings.
- Code Smells: Total number of code smells, technical debts, and duplications identified.
Test Summary Section
This section provides a comprehensive overview of test executions related to pipeline task executions, including:
- Unit Tests: Number of unit tests run with details on passed, failed, skipped, and blocked tests.
- Functional Tests: Number of functional tests run with results breakdown.
- Performance Tests: Number of performance tests run with results breakdown.
Practical Benefits for ServiceNow Customers
- Enables monitoring of release quality by consolidating key metrics from code scans and test executions.
- Helps identify security vulnerabilities, bugs, and code quality issues early in the release lifecycle.
- Supports informed decision-making about release readiness based on comprehensive and up-to-date pipeline and test data.
- Facilitates improved collaboration between development and release teams by providing a centralized quality overview.
The Release Quality dashboard provides insights into the quality of a release based on the software quality scan summaries and test summaries.
The software quality scan summaries give an overview of the code, highlighting any potential bugs or vulnerabilities that might impact the release. The test summaries provide a comprehensive view of the testing process, including the number of tests executed, passed, and failed.
Configuration required for tracking release quality
The data displayed on the Quality tab is pulled from the pipeline execution, task execution, and their associated test summaries and software quality summaries. You must configure pipelines through the external tools configuration before you can see the metrics from various data sources on the Release Quality dashboard.
For more information, see Integrate external tools from Digital Product Release Workspace.
Access the Release Quality dashboard
To open the Release Quality dashboard, navigate to . Select the releases icon (
) and then select a release from the Releases list. Select the Quality tab on the release record.
Data in Quality metrics
- Build: This option shows all pipelines for the product associated with the release from the sn_devops_pipeline table.
The Build summary list includes build numbers that represent pipeline executions from the sn_devops_pipeline_execution_list table.
For an active release, Build summary shows all the pipeline executions of the selected pipeline within the past 30 days. For a completed release, Build summary shows pipeline executions up to 30 days before the actual end date of the release.
- Artifact: This option shows all the artifacts data from the sn_devops_artifact table.
The Artifact version list shows all the artifact versions generated within the past 30 days for the artifact. If the artifact's Use latest version option is selected, the semantic versions are listed. For more information on the artifact version, see Manage artifacts in a release.
- Package: This option shows all the artifact versions associated with the latest package. The artifact version data comes from the sn_devops_m2m_artifact_version_package table and the package data comes from the sn_devops_package table. However, if a package is marked as a release candidate, that package is used even if it's not the latest.
- Quality summary section
- The Quality summary section shows you a summary of the scans that are run on the pipelines. The source of data on these widgets is the Software Quality Scan Summary related to Task Execution. This section contains the following metrics:
Table 1. Quality summary section widgets Widget Description Vulnerabilities Total number of security vulnerabilities for the selected build. This data comes from the Vulnerabilities category in the Software Quality Scan Details.
Use the VulnerabilitiesTypeMapping system property to normalize each type of vulnerability, mapping the custom values with the standard values. For more information, see Digital Product Release properties.
Overall coverage Percentage of code covered by your test cases. This data comes from the Coverage (%) category in the Software Quality Scan Details.
If there are multiple software quality summary results, then the percentage isn’t available.
Total number of lines of code and lines covered for all software quality summary results is shown on this widget.
Bug count Total number of bugs and average ratings of reliability and maintainability data for all the software quality summary results. This data comes from the Bugs category in the Software Quality Scan Details.
Code smells Total number of code smells and total number of technical debts and duplications for all the software quality summary results. This data comes from the Code Smells category in the Software Quality Scan Details.
- Test summary section
- The Test summary section shows you a summary of the test run results. The source of data on these widgets is the Test Summary related to Task Execution. The section contains the following metrics:
Table 2. Test summary section widgets Widget Description Unit tests Total number of unit tests run across all task executions in a pipeline execution, including number of tests passed, failed, skipped, and blocked. Functional tests Total number of functional tests run across all task executions in a pipeline execution, including number of tests passed, failed, skipped, and blocked. Performance tests Total number of performance tests run across all task executions in a pipeline execution, including number of tests passed, failed, skipped, and blocked.