Now Assist Data Kit

[User687957]

Dear all,

I am learning the setup and use of the Data Set and Data Set collection from the Data Set kit.
Based on my progress in this course, I have no difficulty to follow it but I need to understand in practice how to you use this feature at you end customer.

What I understand is that from the dataset collection you have configured, this is essentially use to validate your custom skill kit in order to be sure that it behaves the way you want and that the model is performing what is expected. Once you have validate your data set against your skill and model, I have teh feeling that the dataset i not more needed .

Could you please confirm or not that I understand it correctly and if you have any other use case to explain on the way you use those dataset I would be happy to hear.

Thanks for sharing

regards

[Tanushree Maiti]

Hi @User687957 

Your understanding is partly right, but not completely.

You are correct that the Now Assist Data Kit dataset is primarily used to validate and evaluate custom skills to ensure they perform as expected.

Need correction on " I have teh feeling that the dataset i not more needed"

The dataset is not just a temporary artifact that you discard after validation.

It remains useful after initial validation for re-evaluation if

• Update prompts
• Change skill logic
• Switch models

Refer this article: https://www.servicenow.com/community/now-assist-forum/what-is-ground-truth-in-now-assist-data-kit/td...