Inconsistency with GenAI responses

deepaktomar
Tera Contributor

‎03-10-2025 04:15 AM


Hi,
I have created a custom Now Assist Skill kit (NASK) for summarization. I am experiencing an issue with GenAI responses where the output is inconsistent. Sometimes, the  AI generates a full response as expected while other times, the response appears truncated or incomplete.

Issue Details:

  • The same prompt occasionally results in different response lengths.
  • No clear pattern - sometimes the full response appears, and other times it cut off.
  • No explicit token and word limit is set in our configuration.
  • The issue occurs in both short and long responses.


Any insights or suggestions would be greatly appreciated.


Regards
Deepak Tomar

 

 

0 Helpfuls
  • 641 Views
6 REPLIES 6

Dr Atul G- LNG
Tera Patron
Tera Patron
In response to deepaktomar

‎03-10-2025 05:45 AM

Then log a now Support case mate . 

*************************************************************************************************************
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.

Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]

****************************************************************************************************************
0 Helpfuls

dhananjay21
Giga Guru

‎07-15-2025 05:22 AM

@deepaktomar  Did you manage to resolve the issue ?  I'm also facing similar issue where the model_output is getting truncated.

0 Helpfuls