Define GenAI provider with Generative AI controller
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎01-31-2025 07:56 AM
We all know the generative AI embedded in the ServiceNow platform part of the Now Assist package .
The platform allows you to create your own generative AI workflows if you want, without any complexity .
With Generative AI Controller, you can integrate with most of AI providers in the market , such OpenAI , Microsoft Azure OpenAI or Google Vertex AI.
Note that you can use Generative AI Controller for only the following capabilities:
Generate Content, Generic Prompt , Sentiment Analysis or Summarize .
Before you start:
- You need Now Assist SKU ( ITSM , CSM or Creator …)
This means that, GenAI controller is installed with Now Assist
Go to plugins and search for generative ai controller , the application must be installed :
- GenAI spoke installed on your platform
If you want to use the OpenAI as genAI provider you need to have the OpenAI spoke active
Go plugins and search for OpenAI Generative AI spoke
- Subscription for the Generative AI provider (API Key)
How to integrate with GenAI provider ?
First you need to have the API key from your GenAi provider :
Example for OpenAI :
Select API keys :
And Create New Secret key
Provide a name
And click on Create secret key
Now , in your ServiceNow platform , go to Connections & Credentials > Connections & Credential Aliases
Select you GenAI provider from the list :
Note that OOTB you don’t have a default connection for all GenAI providers
Example for OpenAI
In the related links click on “Create New Connection & Credential “
Add your Api Key
And click on Create
We are done with the credentials .
Go to System properties (sys_properties.list)
And look for com.sn.generative.ai.provider sys property
In value field
Add openai (as OpenAI is the GenAI provider) and click Save
Now you need to extend the GenAI capability
Go to sys_one_extend_capability.list
If you want to extend the Summarize capability to you GenAI provider
Open Summarize
Go to OneExtend Definition configs tab
And set the Default field to true for the language model that you want to use
- 1,469 Views