Default model provider list coming empty in now assist admin

[divyashah]

Hi Community,

I'm in the process of setting up Now Assist in my instance non-prod instance and I've run into an issue with configuring the model providers.

What I'm trying to do:

I am navigating to Now Assist > Settings > Manage model providers to select a default LLM provider for the instance.

The Issue I'm facing:

1. On the Manage model providers page, I see a message stating: "Model provider policy is not set up. Please visit AI Control Tower to turn on policy and set it up for your organization." (See attached screenshot 1).

2. When I proceed by clicking Edit model provider, the "Default model provider" dropdown list is empty and shows "No results found". (See attached screenshot 2).

What I've Tried:

• I have navigated to the AI Control Tower as suggested, but I'm not certain which specific policy needs to be configured or activated to make the providers visible.

• I have confirmed that I have the admin role.

My Questions:

1. What are the specific steps within AI Control Tower required to activate the model provider policy and approve LLMs (like the ServiceNow models, Azure OpenAI, etc.) for use?

2. Is there a specific property or plugin, beyond the core Now Assist plugins, that I might be missing?

3. Are there any specific user roles needed (beyond admin) to correctly configure the AI Control Tower policies for this purpose?

4. Could this be a limitation if I am on a Personal Developer Instance (PDI)?

Any guidance, documentation links, or steps to resolve this would be greatly appreciated. Thank you in advance for your help!

[divyashah]

Hi @Adwitiya Mishra ,

You can repair the AI plugins and you can also refer the article which was mentioned by @rpriyadarshy 

The Link : Here

Regards 

Divya Shah

[Robin Hearne1]

The plugin which should create the 'Generative AI Provider' records (sys_gen_ai_provider) is 'Generative AI Controller' (sn_generative_ai).  

Make sure that you've accepted the terms for this plugin in the ServiceNow Store (https://store.servicenow.com/store/app/c0292f6e1be06a50a85b16db234bcb19)

There should be a Scheduled Job present in the instance named 'Refresh Provider Routing Data from Mimir DishV2 Service Endpoint' (/nav_to.do?uri=sysauto_script.do?sys_id=547acb22ff1f6210a3aeffffffffff94).  If the AI Providers are still not present after installing/repairing the plugin then try running this job and check again after a few minutes.