BYOLLM for generative AI
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
2 hours ago
Hi,
I'm trying to implement my company's own LLM into ServiceNow. I've created all the credentials and so on, following the BYOLLM guide from here:
https://www.servicenow.com/community/servicenow-otto-articles/using-external-llms-with-now-assist-in...
The steps from the following docs is where I'm currently stuck at, to create a NEW Generative AI Configuration record:
https://www.servicenow.com/docs/r/intelligent-experiences/generative-ai-controller/configure-a-gener...
I got all the prerequisites done.
But when I try to create the record, all fields are grayed out (read only), Model is the only selectable field, but it has nothing else but -- None -- in its drop-down list.
Anyone who have tried using their own LLMs who knows what I may be missing?
This is not in a PDI, I have all the stuff installed in the instance I'm doing it in.
