Default model provider list coming empty in now assist admin

divyashah
Tera Expert

Hi Community,

I'm in the process of setting up Now Assist in my instance non-prod instance and I've run into an issue with configuring the model providers.

What I'm trying to do:

I am navigating to Now Assist > Settings > Manage model providers to select a default LLM provider for the instance.

The Issue I'm facing:

  1. On the Manage model providers page, I see a message stating: "Model provider policy is not set up. Please visit AI Control Tower to turn on policy and set it up for your organization." (See attached screenshot 1).

  2. When I proceed by clicking Edit model provider, the "Default model provider" dropdown list is empty and shows "No results found". (See attached screenshot 2).

What I've Tried:

  • I have navigated to the AI Control Tower as suggested, but I'm not certain which specific policy needs to be configured or activated to make the providers visible.

  • I have confirmed that I have the admin role.

My Questions:

  1. What are the specific steps within AI Control Tower required to activate the model provider policy and approve LLMs (like the ServiceNow models, Azure OpenAI, etc.) for use?

  2. Is there a specific property or plugin, beyond the core Now Assist plugins, that I might be missing?

  3. Are there any specific user roles needed (beyond admin) to correctly configure the AI Control Tower policies for this purpose?

  4. Could this be a limitation if I am on a Personal Developer Instance (PDI)?

Any guidance, documentation links, or steps to resolve this would be greatly appreciated. Thank you in advance for your help!

divyashah_0-1756380338066.png

 

divyashah_1-1756380438934.png

 

1 ACCEPTED SOLUTION

rpriyadarshy
Mega Guru

Hi Divya

 

Please go thru this Article if you have not gone  thru-

https://www.servicenow.com/community/now-assist-articles/introducing-model-provider-flexibility-opti...

 

Refer Section --Getting Started is Simple ---> Which talks about all Pre-Requisites and Patch Details.

 

Regards

RP

View solution in original post

3 REPLIES 3

rpriyadarshy
Mega Guru

Hi Divya

 

Please go thru this Article if you have not gone  thru-

https://www.servicenow.com/community/now-assist-articles/introducing-model-provider-flexibility-opti...

 

Refer Section --Getting Started is Simple ---> Which talks about all Pre-Requisites and Patch Details.

 

Regards

RP

Hi @rpriyadarshy ,

Thank you, that article was exactly what I needed. It led me to repair the AI plugins, and everything is working now.

I really appreciate your help.

Good to See it helped:   -)

 

Regards

RP