How to increase max_token for Generative AI Controller (OpenAI)?

Satanik Dutta G
Tera Contributor

‎04-01-2024 11:56 AM

Hello Experts,

 

How can we increase the max_token size for openAI 3.5 turbo in Generative AI Controller ?

I've found a table : sys_generative_ai_model_config and set the max tokens to 4096. Still while generating content from flow designer, its only generating around 2100 characters.

 

Kindly help.

Thanks, Satanik

0 Helpfuls
  • 1,073 Views
1 REPLY 1

Victor Chen
ServiceNow Employee
ServiceNow Employee

‎04-06-2024 11:18 PM

Hi, it currently is not possible. We are looking to expand your abilities to adjust Now Assist prompts and settings on our roadmap (Safe Harbor applies.)