Define GenAI provider with Generative AI controller

Abdellah TAHRI
Tera Contributor

We all know the generative AI embedded in the ServiceNow platform part of the Now Assist package .

The platform allows you to create your own generative AI workflows if you want, without any complexity .

With Generative AI Controller, you can integrate with most of AI providers in the market , such OpenAI , Microsoft Azure OpenAI or Google Vertex AI.

Note that you can use Generative AI Controller for only the following capabilities:

Generate Content, Generic Prompt , Sentiment Analysis or Summarize .

 

Before you start:

  • You need Now Assist SKU ( ITSM , CSM or Creator …)

 This means that, GenAI controller is installed with Now Assist

Go to plugins and search for generative ai controller , the application must be installed :

AbdellahTAHRI_23-1738338959708.png

 

  • GenAI spoke installed on your platform

If you want to use the OpenAI as genAI provider you need to have the OpenAI spoke active

Go plugins and search for OpenAI Generative AI spoke

  • Subscription for the Generative AI provider (API Key)

 

How to integrate with GenAI provider ?

First you need to have the API key from your GenAi provider :

Example for OpenAI :

Select API keys :

AbdellahTAHRI_24-1738338959710.png

 

And Create New Secret key

Provide a name

AbdellahTAHRI_25-1738338959712.png

 

And click on Create secret key

Now , in your ServiceNow platform , go to Connections & Credentials > Connections & Credential Aliases

AbdellahTAHRI_26-1738338959718.png

 

 

Select you GenAI provider from the list :

AbdellahTAHRI_27-1738338959720.png

 

Note that OOTB you don’t have a default connection for all GenAI providers

Example for OpenAI

In the related links click on “Create New Connection & Credential “

Add your Api Key

AbdellahTAHRI_28-1738338959720.png

 

And click on Create

We are done with the credentials .

Go to System properties (sys_properties.list)

And look for com.sn.generative.ai.provider sys property

AbdellahTAHRI_29-1738338959721.png

 

In value field

AbdellahTAHRI_30-1738338959721.png

 

Add openai (as OpenAI is the GenAI provider) and click Save

Now you need to extend the GenAI capability

Go to  sys_one_extend_capability.list

If you want to extend the Summarize capability to you GenAI provider

Open Summarize

AbdellahTAHRI_31-1738338959722.png

 

Go to OneExtend Definition configs tab

AbdellahTAHRI_32-1738338959723.png

 

And set the Default field to true for the language model that you want to use

0 REPLIES 0