Interested in a ServiceNow event built for developers? Registration for now[dev]26 is officially open!

BYOLLM for generative AI

JStockel
Tera Expert

Hi,
I'm trying to implement my company's own LLM into ServiceNow. I've created all the credentials and so on, following the BYOLLM guide from here: 
https://www.servicenow.com/community/servicenow-otto-articles/using-external-llms-with-now-assist-in... 
The steps from the following docs is where I'm currently stuck at, to create a NEW Generative AI Configuration record:
https://www.servicenow.com/docs/r/intelligent-experiences/generative-ai-controller/configure-a-gener...
I got all the prerequisites done.
But when I try to create the record, all fields are grayed out (read only), Model is the only selectable field, but it has nothing else but -- None -- in its drop-down list. 

Anyone who have tried using their own LLMs who knows what I may be missing?

This is not in a PDI, I have all the stuff installed in the instance I'm doing it in.

0 REPLIES 0