Is it possible to add a custom/third-party LLM provider?

[divyashah]

Hello Community,

I'm currently configuring Now Assist in our instance and I'm on the Manage LLMs page (Now Assist > Manage LLMs).

As you can see in the attached screenshot, the "Provider" dropdown for features like Code Assist lists "Now LLM Service" and "Azure OpenAI".

My question is: Is it possible to add a new, custom, or third-party LLM provider to this list?

For example, we would be interested in integrating with other providers like Google Gemini, Anthropic Claude, or perhaps even a self-hosted open-source model.

I've looked through the documentation but haven't found a clear path for registering a new provider in this specific menu. Is this something that can be configured, or are we limited to the out-of-the-box options provided by ServiceNow?

Any guidance or links to relevant documentation would be greatly appreciated.

Thanks in advance!
#genai #nowassist #community

[Ankur Bawiskar · Accepted solution]

@divyashah 

seems possible, check this link

Using external LLMs with Now Assist 

If my response helped please mark it correct and close the thread so that it benefits future readers.

[divyashah]

Hi @Ankur Bawiskar ,

Thank you! That link helped me a lot.