Why Agentic Evaluation Tool Choice accuracy is poor

HarikaI54566144
Giga Contributor

While running automated testing for the Agentic Workflow to assess the quality of a Change Request, the result is shown as “Do Not Deploy.”

For the metrics:

  • Tool Calling Correctness is rated as Excellent with a score of 100%
  • Tool Choice Accuracy is rated as Poor with a score of 0%
Please let me know why the Tool Choice Accuracy is showing as 0%. Is there any configuration change required from my end?
1 REPLY 1

Tanushree Maiti
Giga Patron

Hi @HarikaI54566144 

 

Refer it:

Agentic Evaluations FAQ

A Field Guide to Evaluating, Analyzing, and Debugging AI Agents on ServiceNow

 

Please mark this response as Helpful & Accept it as solution if it assisted you with your question.
Regards
Tanushree Maiti
ServiceNow Technical Architect
Linkedin: