DevOps Insights Standard dashboard - Classic
Summarize
Summary of DevOps Insights Standard dashboard - Classic IT Service Management
The DevOps Insights Standard dashboard, part of the ServiceNow Performance Analytics, allows users to analyze their DevOps environment. However, it is important to note that this dashboard is deprecated for new users, who should now utilize the Insights dashboard from the DevOps Workspace. For effective data collection, ensure that the Daily Data Collection job is active, and consider running it during low-usage times.
Show less
Key Features
- Change Acceleration: Track total changes submitted, average time to close, change approval rates, and compare DevOps statistics against non-DevOps changes.
- Accelerate Metrics: Monitor deployment frequency, lead time, mean time to resolve (MTTR), and change failure rates to assess DevOps performance.
- Operational Stability: Evaluate service availability and resolve times, which require the Service Portfolio Management Foundation plugin for complete functionality.
- Development Insights: Analyze commit frequency, average commits per pipeline, and overall developer activity to optimize the development process.
- Deployment Metrics: Review deployment frequency, success rates, and lead times to enhance deployment efficiency and effectiveness.
- System Health: Assess task execution success rates and the number of API calls to ensure system reliability and performance.
Key Outcomes
Using the DevOps Insights dashboard enables users to gain actionable insights into their DevOps processes, highlighting areas for improvement and optimization. Tracking metrics such as change success rates and deployment frequencies helps organizations streamline their workflows and enhance operational stability, ultimately leading to faster and more reliable software delivery.
Use the DevOps Insights application with ServiceNow Performance Analytics to gain insight into your DevOps environment.
- [DevOps] Daily Data Collection (Daily) (active by default)Note:This is a scheduled job (to be run regularly) to collect daily DevOps data. For optimal performance, set this job to run during periods of low usage.
- [DevOps] Historical Data Collection (On Demand) (inactive by
default)For new DevOps Insights installations, if you have already been using the DevOps app and you Installed DevOps Insights at a later date, run the Historical Data Collection job to collect historical Insights data.Note:This is a one-time job to collect historical DevOps data, and not meant to be on a schedule. It might take awhile, so plan on running this job during a period of low usage.
Reports in the dashboard tabs get updated when the dashboard is refreshed.
Change Acceleration
| Report | Source list | Description |
|---|---|---|
| Total Changes Submitted - Yearly | Change Request | Total DevOps changes submitted yearly. |
| Avg Time to Close - Last 30 days | Change Request | Average time to close DevOps changes in the last 30 days. Note: This widget uses average aggregation and does not support multi-element
selection. |
| Change Approval Rate - Last 30 days | Change Request | DevOps average change success rate for change requests in the last 30 days: ([[DevOps Change Success]] / [[DevOps Change]]) * 100 Note: This widget uses average aggregation and does not support multi-element
selection. |
| Non-DevOps Change Approval Rate - Last 30 days | Change Request | Non- DevOps change approval rate for change requests in the last 30 days: ([[Non-DevOps Change Approval]] / [[Non-DevOps Change]]) * 100 Note: Filter is not applicable to this widget. |
| Change Request Volume | Change Request | Volume of change requests created for DevOps in the last 7 days. Compare the number of change requests created after your transition to DevOps so you can see the advantage of running DevOps in your environment. |
| Pending Changes per Pipeline | Step Execution | Number of change requests that have not been closed for each pipeline. See the blockages in each pipeline that are keeping the change request from being completed so you can investigate the cause. |
| Average Time to Close Changes | Change Request | Average time to close DevOps changes by app. Compare DevOps change request statistics with non- DevOps change requests to see that DevOps change requests are getting resolved faster. |
| Changes Awaiting Approval | Change Request | Number of DevOps changes awaiting approval by date range. Compare DevOps change request statistics with non- DevOps change requests to see that DevOps change requests are getting resolved faster. |
| Non-DevOps Changes Awaiting Approval | Change Request | Number of Non-DevOps changes awaiting approval by date range. Compare DevOps change request statistics with non- DevOps change requests to see that DevOps change requests are getting resolved faster. |
Accelerate Metrics
The Accelerate Metrics tab shows deployment frequency, lead time, MTTR, and change failure rate info.
| Report | Source list | Description |
|---|---|---|
| Deployment Frequency - Monthly | Step Execution | Number of successful production deployments in a month. Applies to steps of type Prod Deploy that are in completed state. |
| Average Lead Time | Pipeline Execution | Average of: ([Time the code is successfully pushed to production] - [Earliest commit time]) Applies to steps of type Prod Deploy that are in completed state. Note: This widget uses average aggregation and does not support multi-element
selection. |
| Mean Time to Resolve - Last 30 days | Database view joined by Incident, Change Request, Step Execution, Step, Pipeline, and App lists. | Average resolve time for an incident caused by a DevOps change in the last 30 days. Note: This widget uses average aggregation and does not support multi-element
selection. |
| Change Failure Rate - Monthly | Change Request | Average change failure rate in a month. Note: This widget uses formula and does not support multi-element selection. |
| Deployment Frequency | Step Execution | Number of successful production deployments in the last 30 days. Applies to steps of type Prod Deploy that are in completed state. |
| Change Failure Rate | Change Request | Average change failure rate in the last 30 days. |
| Mean Time to Resolve Trend | Database view joined by Incident, Change Request, Step Execution, Step, Pipeline, and App lists. | Daily average resolve time for an incident caused by a DevOps change. |
| Lead Time | Pipeline Execution | ([Time the code is successfully pushed to production] - [Earliest commit time]) Applies to steps of type Prod Deploy that are in completed state. Note: This widget uses average aggregation and does not support multi-element
selection. |
Operational Stability
- Service availability
Average service availability and daily service availability.
- Mean time to resolve (MTTR)
Mean time to resolve and daily mean time to resolve.
| Report | Source list | Description |
|---|---|---|
| Mean Time to Resolve - Last 30 days | Database view joined by Incident, Change Request, Step Execution, Step, Pipeline, and App lists. | Average resolve time for an incident caused by a DevOps change in the last 30 days. Note: This widget uses average aggregation and does not support multi-element
selection. |
| Incidents - Monthly | Incident | Number of incidents in a month (based on pipeline steps of type Prod Deploy) linked to business service in CMDB. This report provides an indication of environment stability. |
| Average Service Availability - Last 30 days | Database view joined by Service Availability, Service Offering, Business Service, Step, Pipeline, and App lists. | Average service availability in the last 30 days (based on pipeline steps of type Prod Deploy) linked to application service in CMDB. This report provides an indication of environment stability. |
| Outages - Monthly | Outage | Number of outages in a month (based on pipeline steps of type Prod Deploy) linked to the associated business service in CMDB. This report provides an indication of environment stability. |
| Mean Time to Resolve Trend | Database view joined by Incident, Change Request, Step Execution, Step, Pipeline, and App lists. | Daily average resolve time for an incident caused by a DevOps change. |
| Service Availability Trend | Database view joined by Service Availability, Service Offering, Business Service, Step, Pipeline, and App lists. | Daily average service availability (based on pipeline steps of type Prod Deploy) linked to application service in CMDB. This report provides an indication of environment stability. |
| Incidents Trend | Incident | Daily number of incidents (based on pipeline steps of type Prod Deploy) linked to business service in CMDB. This report provides an indication of environment stability. |
| Outage Trend | Outage | Daily number of outages (based on pipeline steps of type Prod Deploy) linked to business service in CMDB. This report provides an indication of environment stability. |
Development
| Report | Source list | Description |
|---|---|---|
| Commit Frequency | Commit | Number of commits measured daily. Smaller more frequent commits are preferred over larger less frequent ones. |
| Average Branches per Repository | Branches, Repository | Average branches per repository on a given day. Note: This widget uses formula and does not support multi-element selection. |
| Average Commits per Pipeline Execution | Commit, Pipeline Execution | Average commits per pipeline on in the last 30 days: [[Total number of commits]] / [[Number of pipeline executions]] Note: This widget uses average aggregation and does not support multi-element
selection. A low number is preferable, which indicates a concentrated effort, versus switching from task to task without completion. |
| Commits without Work Item | Commit | Commits made that are not tied to a work item, grouped by committer, in the last 30 days. This report is useful for investigating and resolving why a commit is not tied to a work item, because all commits should be tied to a work item. |
| Work Items | Work Item | Number of work items that are complete or working in progress in the last 30 days. Note: Filter is not applicable to this widget. |
Commit Insights
| Report | Source list | Description |
|---|---|---|
| Active Committers | Commit | Committers that submitted commits in the last 30 days. Shows how many active committers there are. Note: This widget uses count distinct aggregation and does not support multi-element
selection. |
| Average Commits per Committer | Commit | Total number of commits in the last 30 days / Active committers. Shows how often committers are committing. A higher value is more favorable. Note: This widget uses formula and does not support multi-element selection. |
| Average Files Added per Commit | Commit, Commit Details | Total number of files added in the last 30 days / Total number of commits in the last 30 days. Shows how few files are committed at a time. A lower value is more favorable. Note: This widget uses formula and does not support multi-element selection. |
| % Commits Reverted | Commit | Commits reverted in the last 30 days / Total number of commits in the last 30 days. Shows how many commits have been reverted. A lower value is more favorable. Note: This widget uses formula and does not support multi-element selection. |
| Top Committers | Commit | Committers with the highest number of commits in the last 30 days. Provides visibility into the users that commit the most. |
| Top Reverters | Commit | Committers with the highest number of reverts in the last 30 days. Provides visibility into the users that revert commits the most. |
| Commits Added per App | Commit, Commit Details | Number of commits added per app in the last 30 days. Provides visibility into the development activity for each app. Note: Filter is not applicable to this widget. |
Deployments
| Report | Source list | Description |
|---|---|---|
| Deployment Frequency - Monthly | Step Execution | Number of successful production deployments in a month. Applies to steps of type Prod Deploy that are in completed state. |
| Failed Deployments | Step Execution | Number of failed production deployments in the last 30 days. Applies to steps of type Prod Deploy that are in failed or user-canceled state. |
| Deployment Success Rate | Step Execution | Deployments success rate over the last 30 days. Deployment Success Rate = (Number of Successful Deployments in the last 30 days / Total Number of Deployments in the last 30 days) * 100 Applies to steps of type Prod Deploy in completed state. Note: This widget uses formula and does not support multi-element selection. |
| Average Lead Time | Pipeline Execution | Average of: ([Time the code is successfully pushed to production] - [Earliest commit time]) Applies to steps of type Prod Deploy that are in completed state. Note: This widget uses average aggregation and does not support multi-element
selection. |
| Successful Production Deployments | Step Execution | Frequency of successful production deployments over time broken down by app. More frequent production deployments are preferred. |
| Failed Production Deployments | Step Execution | Frequency of failed production deployments over time broken down by app. |
| Commit-to-Deploy Lead Time | Pipeline Execution | Duration from the earliest commit time to production deployment (for a successful pipeline execution). Minimizing the time it takes from committing code to successfully running it in production is preferable. When the lead time is high, you can investigate the pipeline to identify the slowest steps. For example, a manual change approval process could increase lead time. |
System Health
| Report | Source list | Description |
|---|---|---|
| Task Execution Success Rate | Task Executions | Success rate for tasks run by the execution tools over time: [[Task Execution Success]] / [[Task Execution]] * 100 Note: This widget does not support multi-element selection. |
| Number of Task Executions | Task Executions | Default number of tasks executions in the last 30 days. |
| Number of API calls | Event | Default number of API calls in the last 30 days. Note: Filter is not applicable to this widget. |