Exploring the Conversational Analytics Dashboard

Use Conversational Analytics dashboard to improve Virtual Agent (VA) interactions with users. The dashboard provides deep insights into conversational data, and helps you refine topics and increase the percentage of issues resolved by VA.

Virtual Agent Analytics

Virtual Agent keeps records of interactions with users for up to 90 days. The metrics extracted from the conversations are retained for a period of two years. The Conversational Analytics dashboard provides insights into those interactions so you can see how well Virtual Agent understood and resolved user issues. Dashboard metrics, for example, reveal:

• What percentage of users transfer from VA to a live agent
• How to increase engagement rate and reduce user drop-offs
• Whether the user reached the last node in a topic
• Most and least-used topics
• Conversation details using advanced filters
• How to optimize conversation design

Key Features

Worst performing topics

See the worst-performing VA topics over a given time period.

Conversation details

Discover metadata about each VA interaction, including the user, the chat duration, and which node a user stopped at in a topic.

User insights

Get a history of a user's chats.

Overview

The following sections provide a high-level overview of how to use each section of the dashboard from the top down.

Date range of data displayed

The Start and End dates at the top of the dashboard specify the data range of the data summarized on each page.

All data is continually pushed from Virtual Agent to the dashboard in real time, and retained for up to 3 months. The analytics dashboard can also accept conversation data up to 30 days old, to support scenarios involving temporary technical issues.

All dates and times on the dashboard are UTC. Even though the conversation table lists conversation dates and times in different time zones, Virtual Agent (VA) converts them to UTC when displaying them on the dashboard. Additionally, if you select a preset date range, such as last week, the dates might be slightly different from what you expect.

For information about setting the date range, see Set the date range of the data.

Certain data visualizations might not have data available for the start date and end date selected in the Start and End fields. In this case, the widget shows a start date and end date for the visualization based on the data availability within the selected date range.

Getting detailed data

The Overview tab provides summaries of the data displayed on the other tabs. You can get to more detailed data in several ways:

• Click a tab, for example, Usage.
• Click the arrowhead in one of the cards.

  

• Click a visualization.

  

Dashboard tabs

Table 1. Dashboard tabs

Tab	Description
Overview	Landing page for the dashboard that shows summary information for all the other tabs.
Usage	Describes VA conversation usage, for example, the language of the conversations, their durations, and the types of conversations.
Conversations	Summary information for a user's conversations. Advanced filtering enables you to filter by conversation nodes or topics, and get details about the conversation duration, the channel the conversation occurred in, and the number of messages exchanged. You can link to details about each conversation on this tab.
Users	Lists the users who have had VA conversations. Advanced filtering provides analytics about usage frequency, by conversation, the duration of the conversation for each user, the user's first and last conversation, and the language used. You can link to user details from this tab, including their conversations.
Topics	Shows metrics about topics used by VA in conversations. Metrics include how many VA conversations moved to a live agent, average length of conversations per topic, and topic blocks used.
NLU Prediction	Shows the number of times the NLU prediction model accurately understood the intent of the user's conversation or auto-selected a topic. The chart links to the NLU Workbench if your instance includes NLU.
Custom Events	Displays the number of custom chat events that you create using the Events page. If you don't create custom events, the tab content is empty.
Funnels	Provides metrics for conversation flows.
Issue Auto-Resolution	Displays information about the number of user issues intercepted by the auto-resolution service and resolved by the Virtual Agent.

Trends and scores

Many tabs use scorecards that show the current value for a data point, for example, the number of conversations currently online.

Scorecards also show data trends, such as the increase or decrease of the data values over the date range specified on the dashboard. Hovering over the title of a scorecard displays a description of the scorecard.

Certain trend visualizations on the dashboard such as the trends in intent and topic matching do not support viewing monthly, weekly, and daily data.

Visualizing data

Many tabs show visualizations of the recorded VA data.

The cards have a common setup.

In each visualization, you can select:

• Subtabs to visualize different datasets in the visualization.
• Arrowhead icon (), which takes you to the corresponding tab that provides more detailed information.

  For example, select the arrowhead in the Active Users scorecard to go to the Users tab, which shows a list of users currently using VA chat.

  

• Click displayed data, such as a bar in a bar chart, to display detailed information about that data.

Tutorial

Now that you are familiar with the user interface, you can try the tutorial. It shows how the parts of the dashboard work together to provide insights for improving VA.

• Trying out the dashboard
  Use this tutorial to get familiar with the Conversational Analytics Dashboard.