Create a model
You can create a custom large language model (LLM) using ServiceNow models or models from different providers.
Before you begin
Role required: sn_skill_builder.sb_model_admin
Procedure
- Navigate to All > Now Assist Skill Kit > Providers and Models.
- Select Add model.
-
On the form, fill in the fields.
Table 1. Add a model form Field Description Model name A name for the model Max tokens Max response + max request tokens Supported languages The languages that are supported Provider The provider of the LLM API The API you are using from the provider - Select Continue.
-
Enter credential details
Table 2. Add credentials form options Model Steps Custom LLM provider - Select Create.
- Connection name
- Connection URL
- Credential type
- API key
- Select Select from database and select from the dropdown menu.
- IBM Watson
- Now LLM Service
- Open AI
- Perplexity
Add the connection URL and API key. - Select Create.
- Select Continue.
-
If you created a custom LLM provider, add transformer information.
Table 3. Transformer information form Option Steps Existing Select a transformer template: - Default
- Hugging face
- Google Gemini
- Claude
Create Add transformer request and response information for your model. Note:If you didn't select a custom LLM provider, request and response transformers are set by the system. - Select Continue.
- Optional: Select Test connection.
- Select Continue.
- Review and select Finish.