- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-15-2024 09:41 AM
Couple of questions on GenAI on the Platform
- Does NowAssist, require GenAI Controller to connect LLMs (NowLLM, OpenAI, Azure)
- Is there a roadmap for GenAI Controller to connect to third party LLMs, eg on-prem finetuned Llama?
Solved! Go to Solution.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-25-2024 09:57 PM
Now Assist uses the Controller behind the scenes, but it only connects to Now LLM. Now Assist does not connect to any third party LLM. As for your other question, we are looking to allow connections to other LLMs with the Controller besides what's supported now (safe harbor), but this would be for customer-built use cases, not for Now Assist.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2024 11:02 PM
Yes it can, with only OpenAI, Azure OpenAI, or Google Vertex, at this time. See documentation here: https://docs.servicenow.com/bundle/washingtondc-intelligent-experiences/page/administer/generative-a...

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2024 10:24 AM - edited 04-03-2024 10:25 AM
Yes, the controller can access base 3rd party LLMs that have not been fine tuned. Please see the documentation on how to configure. SAFEHARBOR - we will support fine tuned 3rd party LLMS later in the year.
- Microsoft Azure OpenAI
- OpenAI
- Google MakerSuite
- Google Vertex AI
- Aleph Alpha API

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2024 11:02 PM
Yes it can, with only OpenAI, Azure OpenAI, or Google Vertex, at this time. See documentation here: https://docs.servicenow.com/bundle/washingtondc-intelligent-experiences/page/administer/generative-a...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-26-2024 07:32 AM
@Victor Chen , thank you. Is controller similar to LangChain framework?