Legacy - Exploring the Conversational Analytics Dashboard
Summarize
Summary of Legacy - Exploring the Conversational Analytics Dashboard
The Conversational Analytics dashboard enables ServiceNow customers to analyze Virtual Agent (VA) interactions with users, providing deep insights into conversation data. These insights help refine VA topics and improve issue resolution rates. The dashboard tracks metrics such as user transfers to live agents, engagement rates, and conversation completion. It retains interaction records for 90 days and conversation metrics for two years.
Show less
Important: This legacy dashboard is scheduled for future deprecation and will no longer be available for installation. A new Conversational Analytics dashboard is available within the Platform Analytics experience, compliant with Government Community Cloud (GCC) and FedRAMP authorized. Customers using the legacy dashboard are advised to plan migration of analytics data to the new dashboard.
Key Features
- Worst Performing Topics: Identify VA topics with the lowest performance over selected time periods to prioritize improvements.
- Conversation Details: Access metadata about each VA interaction, including user identity, chat duration, and conversation node exit points.
- User Insights: View historical VA chat data per user to understand individual usage and interaction patterns.
- Dashboard Tabs: The dashboard is organized into several tabs providing various data views:
- Overview: Summary of all analytics data.
- Usage: Data on conversation language, duration, and types.
- Conversations: Detailed conversation data with advanced filters and links to individual conversations.
- Users: Analytics on user conversation frequency, duration, and language, with links to user details.
- Topics: Metrics on VA topics, including live agent transfers and conversation length.
- NLU Prediction: Accuracy of intent recognition with links to NLU Workbench where applicable.
- Custom Events: Visualization of user-defined chat events.
- Funnels: Metrics tracking conversation flow efficiency.
- Issue Auto-Resolution: Data on issues resolved automatically by VA.
- Data Range and Time Zones: The dashboard displays data in UTC for consistency, with data available for up to 3 months and accepting conversation data up to 30 days old to accommodate technical delays.
- Interactive Visualizations and Scorecards: Many dashboard elements show current values and trends, with interactive charts that allow drilling down into specific data points or navigating between related tabs.
Using the Dashboard
Customers can select date ranges to filter data, use advanced filters on conversations and users, and explore detailed analytics through interactive visual elements. A tutorial is available to help users become familiar with the dashboard features and how to leverage them to improve VA performance and user experience.
Next Steps
- Plan migration to the new Platform Analytics Conversational Analytics dashboard to ensure continued support and compliance.
- Use the legacy dashboard tutorial to maximize insights while it remains available.
- Leverage detailed conversation and user data to optimize Virtual Agent topic design and increase resolution rates.
Use Conversational Analytics dashboard to improve Virtual Agent (VA) interactions with users. The dashboard provides deep insights into conversational data, and helps you refine topics and increase the percentage of issues resolved by VA.
Conversational Analytics dashboard is being prepared for future deprecation. It will be supported until deprecation but will no longer be available for installation. A new Conversational Analytics dashboard in Platform Analytics experience, which meets the compliance requirements of Government Community Cloud (GCC), and thus FedRAMP authorized, is available. See Conversational Analytics dashboard in Platform Analytics experience.
For details on the deprecation process, see the Deprecation Process [KB0867184] article in the Now Support Knowledge Base.
If you are an existing user of this dashboard and want to migrate analytics data to the new dashboard, see Migrate data to Conversational Analytics dashboard in Platform Analytics experience [KB1651556].
Virtual Agent Analytics
- What percentage of users transfer from VA to a live agent
- How to increase engagement rate and reduce user drop-offs
- Whether the user reached the last node in a topic
- Most and least-used topics
- Conversation details using advanced filters
- How to optimize conversation design
Key Features
- Worst performing topics
See the worst-performing VA topics over a given time period.
- Conversation details
Discover metadata about each VA interaction, including the user, the chat duration, and which node a user stopped at in a topic.
- User insights
Get a history of a user's chats.
Overview of using dashboard sections
The following sections provide a high-level overview of how to use each section of the dashboard from the top down.
- Date range of data displayed
The Start and End dates at the top of the dashboard specify the data range of the data summarized on each page.
All data is continually pushed from Virtual Agent to the dashboard in real time, and retained for up to 3 months. The analytics dashboard can also accept conversation data up to 30 days old, to support scenarios involving temporary technical issues.
All dates and times on the dashboard are UTC. Even though the conversation table lists conversation dates and times in different time zones, Virtual Agent (VA) converts them to UTC when displaying them on the dashboard. Additionally, if you select a preset date range, such as last week, the dates might be slightly different from what you expect.
For information about setting the date range, see Set the date range of the data.
Certain data visualizations might not have data available for the start date and end date selected in the Start and End fields. In this case, the widget shows a start date and end date for the visualization based on the data availability within the selected date range.
- Getting detailed data
The Overview tab provides summaries of the data displayed on the other tabs. You can get to more detailed data in several ways:
- Select a tab, for example, Usage.
- Select the arrowhead in one of the cards.
- Select a visualization.
- Dashboard tabs
Table 1. Dashboard tabs Tab Description Overview Landing page for the dashboard that shows summary information for all the other tabs. Usage Describes VA conversation usage, for example, the language of the conversations, their durations, and the types of conversations. Conversations Summary information for a user's conversations. Advanced filtering enables you to filter by conversation nodes or topics, and get details about the conversation duration, the channel the conversation occurred in, and the number of messages exchanged. You can link to details about each conversation on this tab. Users Lists the users who have had VA conversations. Advanced filtering provides analytics about usage frequency, by conversation, the duration of the conversation for each user, the user's first and last conversation, and the language used. You can link to user details from this tab, including their conversations. Topics Shows metrics about topics used by VA in conversations. Metrics include how many VA conversations moved to a live agent, average length of conversations per topic, and topic blocks used. NLU Prediction Shows the number of times the NLU prediction model accurately understood the intent of the user's conversation or auto-selected a topic. The chart links to the NLU Workbench if your instance includes NLU. Custom Events Displays the number of custom chat events that you create using the Events page. If you don't create custom events, the tab content is empty. Funnels Provides metrics for conversation flows. Issue Auto-Resolution Displays information about the number of user issues intercepted by the auto-resolution service and resolved by the Virtual Agent. - Trends and scores
Many tabs use scorecards that show the current value for a data point, for example, the number of conversations currently online.
Scorecards also show data trends, such as the increase or decrease of the data values over the date range specified on the dashboard. Hovering over the title of a scorecard displays a description of the scorecard.
Certain trend visualizations on the dashboard such as the trends in intent and topic matching do not support viewing monthly, weekly, and daily data.
- Visualizing data
Many tabs show visualizations of the recorded VA data.
The cards have a common setup.
In each visualization, you can select:- Subtabs to visualize different datasets in the visualization.
- Arrowhead icon
, which takes you to the corresponding tab that provides more detailed information.
For example, select the arrowhead in the Active Users scorecard to go to the Users tab, which shows a list of users currently using VA chat.
- Select displayed data, such as a bar in a bar chart, to display detailed information about that data.
Tutorial
Now that you are familiar with the user interface, you can try the tutorial. It shows how the parts of the dashboard work together to provide insights for improving VA.