We've updated the ServiceNow Community Code of Conduct, adding guidelines around AI usage, professionalism, and content violations. Read more

Assistant Analytics Overview tab: Measuring ROI and Adoption of Conversational Interfaces

Sharon_Barnes
ServiceNow Employee
a week ago

Assistant Analytics Overview: Your Guide to Measuring ROI and Adoption of Conversational Interfaces

Articles Hub

Want to see all of our other articles and blogs related to Assistant Analytics?

You can copy the link above and share it!

We Value Your Feedback!

Have any suggestions or topics you'd like to see in the future? Let us know!

Overview

If you’re running AI assistants in production, you need more than usage numbers — you need actionable insight. Scaling adoption, improving experience, and managing cost responsibly — that’s the real work.

 

The Overview dashboard gives you five high-leverage metrics that help you understand:

  • Where adoption is growing
  • Where engagement needs attention
  • Which assistants need tuning
  • What’s driving user satisfaction

Let’s break them down.

 
Requirements:

Family Release: Zurich Patch 6

Release: Now Assist for Platform 10.0.3
Roles Required: virtual_agent_admin
 

00:00: This video demonstrates how to use the overview dashboard to track AI, assisted option engagement and cost efficiency.

00:07: It highlights five key signals that provide insights into user behavior and investment effectiveness.

00:17: Now that you've got now assist running the question becomes. Is it actually working?

00:22: And that is exactly what this overview dashboard answers.

00:26: In one view, you get five signals that tell you everything you need to know about adoption engagement and cost.

00:34: Starting with cumulative, AI assisted actions.

00:37: This is your proof of value.

00:40: Is AI becoming part of how your people actually work, or are they ignoring it?

00:45: A rising curve. Here means your assistance are sticking

00:48: Next average distinct users not just how much it's being used, but who's using it?

00:55: If this number plateaus, it's a signal to examine discoverability or onboarding, not the AI itself.

01:01: Assist Usage Volume shows where your AI credits are allocated by assistant and channel, helping you stay efficient as you grow.

01:09: High usage is acceptable if it reflects value.

01:13: Then there's Conversation CSAT.

01:15: It's not a traditional survey; instead, it's inferred from actual conversation behavior, such as confusion signals, escalations, and resolution rates.

01:26: This provides behavioral feedback on a large scale.

01:29: And finally, Total Assist Usage is your macro view for capacity planning and forecasting.

01:35: This is what tells your leadership team you're scaling responsibly.

01:39: The true strength lies in how these five metrics come together.

01:43: Increasing users, engaging actions managing costs effectively, I'll see D3 and maintaining High csat.

01:54: That's the pattern that shows your AI investment is truly paying off.

01:58: Learn to interpret, five essential metrics, that reveal AI assist usage Trends, user engagement cost distribution and customer satisfaction for informed capacity planning and scaling.

 


Cumulative AI-Assisted Actions

Are your assistants becoming part of real workflows? This metric tracks the total number of AI-assisted actions completed over time. It's your clearest signal of adoption momentum.

Why It Matters

  1. Shows whether usage is compounding over time
  2. Helps validate that assistants are delivering practical value to users
  3. Identifies growth trends across different assistants and channels
If the curve trends upward steadily, your assistants are becoming embedded in user behavior.
Indicator: Daily Conversation Consumers
This helps you see where adoption is strongest — and where distribution or awareness may need improvement.

Average Distinct Users

How many unique people are engaging? This metric tracks the average number of distinct users interacting with your assistants. It's your reach indicator.

Why It Matters

  1. Measures actual audience penetration across your user base
  2. Reveals engagement growth trends over specified time periods
  3. Surfaces early signs of discoverability or UX issues

What to Do When Users Plateau

If distinct users plateau, you may need to:
  1. Improve assistant visibility in your product or interface
  2. Refine onboarding flows to encourage initial engagement
  3. Adjust targeting strategies to reach new user segments
Indicator: Daily Conversation Consumers
These dimensions help you pinpoint where adoption can be expanded.

Assist Usage Volume

Where is your AI investment going? This shows assist consumption (AI credits) by assistant and channel. It's essential for balancing innovation with efficiency.

Why It Matters

  1. Identifies high-impact assistants delivering the most value
  2. Surfaces resource-heavy features that may need optimization
  3. Enables optimization without sacrificing user experience
High usage isn't bad — it just needs to correlate with engagement and satisfaction.
Indicator: Conversation Assist Usage Volume
This helps you tune prompts, reduce unnecessary calls, and align cost with value delivered.

Overall Average Conversation CSAT

Are conversations actually working for users? This inferred CSAT score analyzes conversation signals like confusion, frustration, escalation, effort, and empathy. It gives you behavioral feedback at scale.

Why It Matters

Adoption growth is sustainable only when experiences are positive. A strong CSAT trend indicates:
  1. Clear responses that users can understand and act on
  2. Efficient resolution of user needs and questions
  3. Low friction throughout the conversation experience
Indicator: Average Period Inferred CSAT (Session)

Total Assist Usage

Are you scaling responsibly? This is your macro-level view of overall AI consumption.

What It Supports

  1. Budget forecasting for AI infrastructure costs
  2. Capacity planning to ensure system reliability
  3. Strategic scaling decisions aligned with business goals
When adoption grows alongside controlled usage trends, you know optimization efforts are working.
Indicator: Conversation Assist Usage Volume

Putting It All Together

These metrics aren't isolated — they reinforce each other. Healthy growth typically looks like increasing AI-assisted actions, growing distinct users, efficient assist usage, stable or improving CSAT, and predictable total consumption.

What You Can Do

When you monitor these metrics together, you can:
  1. Expand adoption intelligently based on data-driven insights
  2. Optimize conversation flows to reduce friction and improve outcomes
  3. Improve assistant discoverability across channels and touchpoints
  4. Tune generative usage to balance quality and cost
  5. Increase user satisfaction through targeted improvements

Conclusion

 

The Overview page of the dashboard isn't just reporting — it's your optimization toolkit. If you want to increase adoption, improve user experience, and scale AI assistants responsibly, these five metrics give you the signals you need to make informed decisions. The goal isn't just usage. It's sustainable, high-quality growth. By monitoring cumulative actions, distinct users, assist usage volume, conversation CSAT, and total consumption together, you can build AI assistants that deliver real value while maintaining efficiency and user satisfaction at scale.

Check out the Assistant Analytics Hub for more resources

0 Helpfuls
  • 179 Views