Why Agentic Evaluation Tool Choice accuracy is poor
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
3 weeks ago
While running automated testing for the Agentic Workflow to assess the quality of a Change Request, the result is shown as “Do Not Deploy.”
For the metrics:
- Tool Calling Correctness is rated as Excellent with a score of 100%
- Tool Choice Accuracy is rated as Poor with a score of 0%
Please let me know why the Tool Choice Accuracy is showing as 0%. Is there any configuration change required from my end?
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
3 weeks ago
Refer it:
A Field Guide to Evaluating, Analyzing, and Debugging AI Agents on ServiceNow
Please Accept the solution if it assisted you with your question & Mark this response as Helpful.
Regards
Tanushree Maiti
ServiceNow Technical Architect
LinkedIn: https://www.linkedin.com/in/tanushreemaiti
Regards
Tanushree Maiti
ServiceNow Technical Architect
LinkedIn: https://www.linkedin.com/in/tanushreemaiti