Yes, there is some certain limit of word count for Now Assist. As we are also using in our environment. This is out of the box, you can not alter this.
Please mark my solution as accepted and give thumbs up, if it helps you.
There are few limitations on Now LLM which i am aware of like below.
The default token limit for incident summarization using the Now LLM provider is 8,000 tokens. If your incident work notes exceed this limit, you may encounter errors such as "Summarize with Now Assist failed. Try again." This issue is resolved in GAIC v2.1 (September 2024 release), so upgrading to the latest plugin and store update is recommended for Washington and Xanadu versions .
For the out-of-the-box Security Incident Summarization skill, the limit is approximately 16,000 input tokens. If your incident exceeds this, the system truncates older activities, potentially losing context. You can enable recursive summarization to handle larger incidents, which divides the input into smaller segments and combines summaries, but this increases latency and is disabled by default. To enable recursive summarization, contact ServiceNow Support .
If you encounter errors due to a large number of impacted services or CIs, consider increasing the Response Max Tokens field in the generative AI configuration. The default is 750, and you can incrementally increase it by 250 until summarization succeeds, keeping in mind that higher values may slow down response times.
