correctness faithfulness metrics for now assist skill kit
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
4 weeks ago
Hi
In now assist skill kit we can test our custom skills with the data base generated by now assist data kit so there is evaluation where we can choose the prompt and evaluation metrics like faithfulness, correctness metrics and after running it it's showing me the error in simulator where can I find those errors(in which table are those stored).
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
3 weeks ago
Hey Buddy @Vedavalli ,
ServiceNow documentation for Now Assist Skill Kit (NASK) covers how to test custom skills and run evaluations (faithfulness, correctness) against a dataset, but it does not create or expose a special error table just for Skill Kit evaluation errors in the UI.
ServiceNow always records runtime errors in the standard system logging tables:
syslog — General application logs where error messages, exceptions, or runtime failures are recorded.
I have also tried it for the evalutions for the custome skill kit it logs the information in sys_log table.
Here you can see log of now assist skill kit.
And also doing the evalutions for custome skill that run perfectly.
If you tell me which skill kit evolutions you tried , I will help you with that.
If my res[ponse is helpful , please mark it as helpful🙏 and accept as a solution.👍
Regards,
UmesH
Technical Consultant.
