Token response limit in now assist skill kit

kaustubhdub
Giga Guru

I've been working with the Now Assist Skill Kit, but I've run into an issue with the response length limit set by the LLM. There's a significant difference between the request and response token counts, and I haven't been able to adjust the token limit. Has anyone else encountered this or found a workaround?

 

Regards,

Kaustubh Dubey

1 REPLY 1

mukesh_adh
Tera Contributor

I think you cannot modify the Request Tokens, but you should be able to set Response Max Tokens, if you go the table sys_generative_ai_config and find the prompt in use.