correctness faithfulness metrics for now assist skill kit

Vedavalli
Mega Sage

Hi

In now assist skill kit we can test our custom skills with the data base generated by now assist data kit so there is evaluation where we can choose the prompt and evaluation metrics like faithfulness, correctness metrics and after running it it's showing me the error in simulator where can I find those errors(in which table are those stored).
Screenshot 2026-01-05 124238.png

1 REPLY 1

UmesH77
Giga Guru

Hey Buddy @Vedavalli ,

ServiceNow documentation for Now Assist Skill Kit (NASK) covers how to test custom skills and run evaluations (faithfulness, correctness) against a dataset, but it does not create or expose a special error table just for Skill Kit evaluation errors in the UI.

 

ServiceNow always records runtime errors in the standard system logging tables:

  • syslog — General application logs where error messages, exceptions, or runtime failures are recorded.

I  have also tried it for the evalutions for the custome  skill kit it logs the information in sys_log table. Screenshot 2026-01-13 111927.png

 

Here you can see log of now assist skill kit.

 

 

And also doing the evalutions for custome skill that run perfectly.

If you tell me which skill kit evolutions you tried , I will help you with that.

 

Screenshot 2026-01-13 111252.png

If my res[ponse is helpful , please mark it as helpful🙏 and accept as a solution.👍

 

Regards,

UmesH

Technical Consultant.