Join the #BuildWithBuildAgent Challenge! Get recognized, earn exclusive swag, and inspire the ServiceNow Community with what you can build using Build Agent.  Join the Challenge.

Inconsistency with GenAI responses

deepaktomar
Tera Contributor


Hi,
I have created a custom Now Assist Skill kit (NASK) for summarization. I am experiencing an issue with GenAI responses where the output is inconsistent. Sometimes, the  AI generates a full response as expected while other times, the response appears truncated or incomplete.

Issue Details:

  • The same prompt occasionally results in different response lengths.
  • No clear pattern - sometimes the full response appears, and other times it cut off.
  • No explicit token and word limit is set in our configuration.
  • The issue occurs in both short and long responses.


Any insights or suggestions would be greatly appreciated.


Regards
Deepak Tomar

 

 

6 REPLIES 6

Dr Atul G- LNG
Tera Patron
Tera Patron

Hi @deepaktomar 

 

I'm not 100% sure, but try repairing the Skill Set plugin. Sometimes, plugin updates can cause changes. I can't guarantee it will solve the issue, but it's worth a try. If it doesn't work, please log a case with Now Support

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************

deepaktomar
Tera Contributor

Thanks AG , Now Assist Skill Kit (NASK) plugin is up to date on the instance and I am not seeing any further update.

Regards
Deepak Tomar

Hi @deepaktomar 

 

Did you try to repair that? If yes and still not working log a Now Support case.

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************

deepaktomar
Tera Contributor

Hi @Dr Atul G- LNG ,

To validate if the problem was specific to our current instance, I created custom skill on another instance and tested it there. However the same issue persists on the new instance as well. 

Thanks 
Deepak Tomar