- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-15-2024 09:41 AM
Couple of questions on GenAI on the Platform
- Does NowAssist, require GenAI Controller to connect LLMs (NowLLM, OpenAI, Azure)
- Is there a roadmap for GenAI Controller to connect to third party LLMs, eg on-prem finetuned Llama?
Solved! Go to Solution.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-25-2024 09:57 PM
Now Assist uses the Controller behind the scenes, but it only connects to Now LLM. Now Assist does not connect to any third party LLM. As for your other question, we are looking to allow connections to other LLMs with the Controller besides what's supported now (safe harbor), but this would be for customer-built use cases, not for Now Assist.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2024 11:02 PM
Yes it can, with only OpenAI, Azure OpenAI, or Google Vertex, at this time. See documentation here: https://docs.servicenow.com/bundle/washingtondc-intelligent-experiences/page/administer/generative-a...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-15-2024 10:07 PM
Hi @Yuriks ,
Now assist is a OOTB feature and uses only NowLLM as provider. Gen AI controller is an option to build custom usecases therefore we need third party LLM provider to run genAI controller.
Yes, Gen AI controller configurations are documented by servicenow, you can access those from docs.
Thanks and Regards,
Rahul
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-16-2024 06:02 AM
Thanks @Rahul Talreja
Is that correct:
NowAssist works with NowLLM directly with no GenAi controller
And with GAIC it can use OpenAI and, potentially any other LLM
Is there any documentation on what foundational model is NowLLM is based on and what data used for training?

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-25-2024 09:57 PM
Now Assist uses the Controller behind the scenes, but it only connects to Now LLM. Now Assist does not connect to any third party LLM. As for your other question, we are looking to allow connections to other LLMs with the Controller besides what's supported now (safe harbor), but this would be for customer-built use cases, not for Now Assist.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2024 10:05 AM
Hi Victor, thank you for your response. I have one specific question,
Can Gen AI controller of washington release access 3rd party LLMs ( i mean non SN LLMs)? We have a use case to interact with non servicenow LLMS? Is there any documentation of how this can be acheived?