--- sourceDocument: Australia Enable AI sourceDocumentLink: https://www.servicenow.com/docs/r/australia/intelligent-experiences Release : - australia ft:locale : - en-US ft:publication_title : - Australia Enable AI ft:clusterId : - platai bundleId : - platai workflow : - Platform --- # Reference # Reference for Autonomous Workforce {#ariaid-title1} Release version: Australia Updated October 13, 2026 ![](https://www.servicenow.com/docs/portal-asset/ico-clock) 4 minutes to read Reference for Autonomous Workforce provides additional information about the roles and performance metrics associated with AI specialists. ## AI Specialist Manager role {#ariaid-title2} The AI Specialist Manager role enables editing, testing, and monitoring AI specialists in AI Agent Studio and Service Operations Workspace. ### Contains Roles {#aiw-manager-role__section-feature-role-contains-roles} List of roles contained within the role. * sn_aia.viewer * skill_manager {#aiw-manager-role__ul_jbs_1dk_xhc} ## AI specialist performance metrics {#ariaid-title3} Performance metrics in AI Agent Studio track how an AI specialist routes, resolves, and communicates on incidents. Use them to find where an AI specialist needs tuning. You can filter all performance metrics by date and assignment group. ### Overview metrics {#aiw-performance-metrics__aiw-perf-overview} {#aiw-performance-metrics__ai-specialist-perf-metrics-overall__entry__3} | Group | Metric | Description | |-|-|-| | At a glance | Durable auto-resolve rate (%) | Percentage of incidents that the AI specialist resolved without reassigning to a human agent and that weren't reopened. | | At a glance | Coverage rate (%) | Percentage of assigned incidents that the AI specialist attempted to resolve. | | Routing journey | 1. Closed incidents in eligible assignment group(s) | All closed incidents in the assignment groups that the AI specialist belongs to. | | Routing journey | 2. Closed incidents assigned to AI specialist | Incidents assigned to the AI specialist for triage through assignment rules or AWA. | | Routing journey | 3. Closed incidents attempted by AI specialist | Incidents where the AI specialist was confident enough to propose a solution or take autonomous action. | | Incident outcomes | All incident outcomes | Percentage and count of each outcome of the AI specialist's attempts: resolved, reassigned to a human agent, reopened, generated a new ticket, or in progress. | | Incident outcomes | Incident outcomes over time | Trend of the AI specialist's incident outcomes. | | Resolution details | Mean time to resolution | Average time between an incident being assigned to the AI specialist and the generation of a response that was later accepted. | | Resolution details | Mean time to first response | Average time between an incident being assigned to the AI specialist and the generation of its first response. | | Reassignment reasons | Reasons for reassignment | Percentage and count of incidents reassigned to a human agent, broken down by cause. | | Reassignment reasons | Reasons for reassignment over time | Trend of reassignments to a human agent, broken down by cause. | | Follow-ups | Follow up rate (%) | Percentage of attempted incidents where the AI specialist needed to ask the requester for more information. | | Follow-ups | Count of incidents that required a follow up | Number of incidents that required at least one additional message from the AI specialist. | [Table 1. Overview metricsMetrics that show how an AI specialist is performing overall.] {#aiw-performance-metrics__ai-specialist-perf-metrics-overall} ### Quality metrics {#aiw-performance-metrics__aiw-perf-quality} {#aiw-performance-metrics__ai-specialist-perf-metrics-quality__entry__2} | Metric | Description | |-|-| | Assessments for closed incidents | Quality assessments generated for completed AI specialist tasks. | | Quality score trend | Trend of quality scores based on assessments. | | All opportunities | Coaching opportunities identified for the AI specialist. | [Table 2. Quality metricsMetrics that show the quality of an AI specialist's work across categories of tasks and identify coaching opportunities.] {#aiw-performance-metrics__ai-specialist-perf-metrics-quality} ### Detailed view metrics {#aiw-performance-metrics__aiw-perf-detailed} {#aiw-performance-metrics__ai-specialist-perf-metrics-detailed__entry__3} | Group | Metric | Description | |-|-|-| | AI-handled incidents by service | Incident outcomes (%) by service | Percentage of each outcome of the AI specialist's attempts (resolved, reassigned, new, and reopened), broken down by service. | | AI-handled incidents by service | Incident outcomes by service | Count of each AI specialist outcome, broken down by service. Selecting a number in the Count field opens the ZTSD Task Execution list filtered by that service and outcome. | | AI-handled incidents by service | Reassignment reasons for unresolved incidents by service | Percentage and count of incidents reassigned to a human agent, broken down by cause and service. | | AI-handled incidents by service | Average exchanges for resolved incidents by service | Average number of AI specialist responses before a final outcome, for each service. | | Proposed solution similarity by service | Average proposed solution similarity by service | Average AI judge score comparing the AI specialist's proposed solutions with the final resolutions, for each service. | [Table 3. Detailed view metricsMetrics that identify the services or categories that require the most attention.] {#aiw-performance-metrics__ai-specialist-perf-metrics-detailed} ### Value and feedback metrics {#aiw-performance-metrics__aiw-perf-value} {#aiw-performance-metrics__ai-specialist-perf-metrics-value__entry__2} | Metric | Description | |-|-| | Aggregated sentiment analysis | Overall tone, from negative to positive, of user messages in incidents handled by the AI specialist. | | Adoption coverage | Number of relevant assignment groups that have used the AI specialist to handle incidents. | | Direct user feedback | Chart of the feedback that requesters gave on incidents the AI specialist resolved. | [Table 4. Value and feedback metricsMetrics that show adoption trends, customer sentiment, and feedback to identify ways to improve the AI specialist experience.] {#aiw-performance-metrics__ai-specialist-perf-metrics-value} ### KB article metrics {#aiw-performance-metrics__aiw-perf-kb} {#aiw-performance-metrics__ai-specialist-perf-metrics-kb__entry__3} | Group | Metric | Description | |-|-|-| | KB article usage summary | KB articles used | Number of distinct KB articles the AI specialist referenced during the selected period. | | KB article usage summary | Total records | Number of records, such as incidents, problems, and interactions, resolved using at least one retrieved KB article. | | KB article usage summary | Shown in citations | KB articles that the AI specialist included in a response to the user. A higher count suggests that the AI specialist is surfacing relevant content. | | KB article usage summary | Retrieved only | KB articles that the AI specialist retrieved but didn't include in a response. A high count can indicate retrieval quality issues. | | KB article usage summary | Unused articles | KB articles that weren't retrieved or cited during the selected period. Review these to find outdated or hard-to-discover content. | | KB article list | All used articles | List of KB articles the AI specialist used, with usage frequency (how often each article was cited after retrieval) and reopen rate (percentage of incidents resolved using the article that were later reopened). | | KB article list | Unused articles | List of KB articles with no references during the selected period. | [Table 5. KB article metricsMetrics that show which articles are retrieved, cited in responses, or left unused, so you can see which content drives successful resolutions and where gaps exist.] {#aiw-performance-metrics__ai-specialist-perf-metrics-kb}