Now Assist Skill Kit vs Gen AI Controller

[Khushboo8]

Both the Now Assist Skill Kit (NASK) and the Gen AI Controller in ServiceNow allow integration with third-party LLMs. NASK enables you to build generative AI skills using either the built-in Now LLM or an external LLM by specifying a provider. Meanwhile, the Gen AI Controller allows you to connect to third-party LLMs using Connections & Credentials and use general-purpose capabilities like summarization and prompting.

What is the difference between these two approaches, given that both can connect to external LLMs?

[rpriyadarshy]

GEN AI Controller Only Provides Connection with external LLM where you have your own Separate Subscription too (Azure AI , AWS AI)  as a part of BYOLLM.

In Gen AI Controller you have fix no of capability  (sys_one_extend_capability)which can be used using Various LLMs. 

Generative AI Controller comes with four capabilities by default. You can only configure a provider for the capabilities.

NASK is a complete Development Framework for Custom skill development where Utilizing the LLM is just one of the Steps as a part of Custom Skill Development. Some of the Custom Skills like 

Regards

RP

[Khushboo8]

Can we create generic prompt capability in a  skill created using NASK? Similar to what we have in Gen AI controller?

[ersureshbe]

Hello,

The ServiceNow NASK and Gen AI OOB feature operates based on NOW LLM and has been validated. When discussing the GenAI controller, it is essential to enable the integration through the Integration Hub flow designer.

This aspect is not validated and is contingent upon the specific requirements of the developer and the business. External LLMs such as Hugging Face, Azure, Gemini, and ChatGPT will be chosen by the business based on their feasibility in terms of cost and user-friendliness.