Can we call NOW LLM via Gen Ai Controller for custom use cases while building via flow designer?

[TDalal]

Hi,

We are building some Gen AI use cases and we want to use NOW LLM for that instead of a third party LLM. I can see in flow designer we have an action called "Now LLM" under Gen AI Controller, Can we use that for same purpose?

How do we use it? Please help.

Regards

[Rahul Priyadars]

As per Service Now Architecture- Of LLM ...Service Now LLM is not exposed for Consumption. 

Its used by Service Now GEN AI features as of now . Not Sure About Future but as per my knowledge Its not exposed yet. You need to consume external LLM - Open AI, Azure Open AI , G-Vertex.

Follow the Legends in Below Diagram.

Regards

RP

[Eliza]

Hi all!

To clarify, we do not allow our NowLLMs to be used for custom use cases today. Your options are to leverage a spoke that connects to an external LLM (list provided here) or use our generic LLM connector if the LLM you wish to leverage isn't supported with a spoke.

Once connected, you can then build custom workflows leveraging generative AI in Flow Designer/Virtual Agent Designer/within scripts.

An example build can be found here.

[Rahul Priyadars]

Just to Add -- in XANADU custom Skills can be Developed Using Service Now LLM . 

Now Assist Skill Kit, or NASK, was released in the Xanadu release. This feature allows you to build and deploy custom skills that leverage generative AI directly within your instance. These skills can serve to enable use cases that the current suite of Out of the Box (OOTB) Now Assist skills such as task summarization and code generation cannot today.

Details here- https://www.servicenow.com/community/now-assist-articles/now-assist-skill-kit-nask-faq/ta-p/3007953

Regards

RP