Use PDIs? Take our 5-minute survey to help shape the PDI roadmap.

Why Agentic Evaluation Tool Choice accuracy is poor

HarikaI54566144
Tera Contributor

While running automated testing for the Agentic Workflow to assess the quality of a Change Request, the result is shown as “Do Not Deploy.”

For the metrics:

  • Tool Calling Correctness is rated as Excellent with a score of 100%
  • Tool Choice Accuracy is rated as Poor with a score of 0%
Please let me know why the Tool Choice Accuracy is showing as 0%. Is there any configuration change required from my end?
1 REPLY 1

Tanushree Maiti
Tera Patron

Hi @HarikaI54566144 

 

Refer it:

Agentic Evaluations FAQ

A Field Guide to Evaluating, Analyzing, and Debugging AI Agents on ServiceNow

 

Please Accept the solution if it assisted you with your question & Mark this response as Helpful.
Regards
Tanushree Maiti
ServiceNow Technical Architect
LinkedIn: https://www.linkedin.com/in/tanushreemaiti