Now Assist Skill kit throwing error

[dhivyal94299399]

Hi Everyone, I'm trying to customize Incident summarization but the issue is even without making any changes once I cloned the skill, when I tried to test it its responding with error
Also the issue happens only in Sandbox instance, its working fine in dev instance. 

[Tanushree Maiti]

Hi @dhivyal94299399 

Increase the Response Max Tokens field value in the generative AI configuration. The default value is 750. You can increase it by 250 and test the summarization. Repeat the process until the summarization completes successfully.

Refer KB :

 KB1700568 Incident Summarization gives an error 

KB1706478 Now Assist Incident Summarization Fails with error "There was an error summarizing your in... 

[dhivyal94299399]

Hi @Tanushree Maiti ,

I went through the KB article but the record is read only. I'm unable to increase the Response Max Tokens

Regards.

[yashkamde]

Hello @dhivyal94299399 ,

I think most probable cause would be Plugins sn_uxc_gen_ai, sn_generative_ai got corrupted.

For this :

1. Go to the Plugins module
2. Search for plugins sn_uxc_gen_ai and sn_generative_ai, one by one
3. Open the plugin and click on Repair

Also check if this is useful by increasing the token count :

Cause could be : The issue is caused by the parsing of truncated responses from the model due to the token limit being exceeded from 100+ affected CI records. When the response from the model is received, it is incomplete, causing the error.

To resolve you will need to increase the Response Max Tokens field value in the generative AI configuration. The default value is 750. You can increase it by 250 and test the summarization. Repeat the process until the summarization completes successfully.

instance_name.service-now.com/nav_to.do?uri=sys_generative_ai_config.do?sys_id=2b84f5af93098a5090877...

Monitor the performance of the summary after increasing the max tokens, as the more tokens the model generates, the slower the response will be.

Adjust the Response Max Tokens field value to balance the amount of tokens needed for generating a response from the summarization tool and the performance impact of raising the token value.

If my response helped mark as helpful and accept the solution.

[dhivyal94299399]

Hi @yashkamde 

I too believe Response Max token is the issue here but the record is read only. I'm unable to increase the Response Max Tokens. 
Can you assist me  here as to how to increase it

Regards.