Generative AI controller setup using ServiceNow LLM

Anonymous_guy
Tera Expert

‎11-19-2024 01:47 AM

Hi ServiceNow enthusiasts,

I would like to explore the generative AI capabilities like the summarization, generic prompt, etc. using the flow designer. The constraint is that I have to to use a cost-effective method for establishing a connection with a LLM. I was under an assumption that we could make use of ServiceNow LLM to make this work, but it didn't work for me. All of the implementation documentations used open AI, and the challenging part is, as you all know, open AI is no longer free. I believe somebody who has already played around gen AI could help me.

 

Any help would be much appreciated, 

0 Helpfuls
  • 1,575 Views
1 REPLY 1

Rahul Priyadars
Tera Sage

‎11-19-2024 06:41 PM

Hi Abhijith

 

You Can use Service Now LLM using NASK kit which is available in XANADU release.

 

Even if you use Service Now LLM there is still a Cost which is measured in TERMS of ASSISTS. Even during development work when you do testing and each call to Service Now LLM will consume an Assist depending on SKILL Usage .

an Snippet of SKILL USAGE and Assist Consumption  Table-

 

RahulPriyadars_0-1732070309100.png

Now Assist Usage monitoring -https://www.servicenow.com/docs/bundle/vancouver-platform-administration/page/administer/subscriptio...

 

Details on NASK is below- 

 

https://www.servicenow.com/community/now-assist-articles/now-assist-skill-kit-nask-faq/ta-p/3007953

 

Custom Gen AI Development using Service Now LLM & NASK

https://www.servicenow.com/community/now-assist-articles/now-assist-skill-kit-knowledge-article-coac...

 

Hope This helps

Regards

RP