VA Reporting: Counting NLU Attempts Rather than NLU Predictions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-11-2025 09:45 AM
Hi all,
Wondered if you might be able to help me please...
I have created a dashboard for reporting on the success of our NLU Model.
I am using the 'Open NLU Predict Intent Feedback' table.
The Virtual Agent Insight Dashboard uses this table to show Correct Predictions, Skipped Predictions, and then calculate the Incorrect Predictions.
This is ok but I want more precision to my reporting.
I want to report on exactly how many NLU Challenges have taken place today, how many skipped, and how many were incorrect.
We've added in a user confirmation (after a topic is auto-selected) for judging the Incorrect predictions.
But for the number of challenges, the only thing I can think of would be to count how many entries in this table with the same time and date. As a few entries in this table could show one challenge of the NLU. Each entry showing the different predictions for the one challenge.
Success could also be judged on the user confirmation as well, whether it be auto-selected or selected from a list of many.
Any help would be much appreciated.
Many thanks,
Michael Greveson
VA Admin