Can we call NOW LLM via Gen Ai Controller for custom use cases while building via flow designer?

[TDalal]

Hi,

We are building some Gen AI use cases and we want to use NOW LLM for that instead of a third party LLM. I can see in flow designer we have an action called "Now LLM" under Gen AI Controller, Can we use that for same purpose?

How do we use it? Please help.

Regards

[Filipe Cruz]

Hi @IanCox Can you elaborate on action 1? I cannot see anything relevant on that documentation section.
I cannot see the NowLLM action in Flow Designer. What am I missing there?

[TDalal]

Hi Ian,

Thanks a lot for the confirmation.

I have also gone through the "Now LLM Service updates" page and not able to find a relevant section which elaborates how to establish an API connection with Now LLM. Maybe I am missing something.

Need your help there.

Also, in the flow designer Now LLM action there are 4 mandatory attributes, 

1. use case: Can we directly give capability names like "Summarize" or "QnA"?

2. additional_configurations: Not sure what to provide in this field

3. inputs: We will put directly a ticket field or variable here

4. Requested outputs: Should be a flow variable name?

Regards

[IanCox]

One of the things we did was, after raising a case with support, to enable AI to run.

1. Go to sys_properties.list
2. Search by name: com.sn.generative.ai.provider
3. Set to "openai" (as that is the one used on the instance by default)
4. Do cache.do
5. Clear all the browser cache
6. Logout / Login
7. Try to reproduce the issue and let us know the results

if you need help drop me a line and I will get the team to help you 1:1 Ian.cox@work4flow.com

[TDalal]

Hi Ian,

Thank you for the reply.

But if we follow the steps,  we will be using "openai" for the use cases, not the "now LLM".

We have used other actions under "gen ai controller" with third party LLMs like "openai".

But we were not sure about the action "Now LLM".

Can we connect to Now LLM for completing some new use cases, or other 3rd party LLMs are the only way to build new Gen ai use cases using gen ai controller?

Regards

[Ankita Sarkar]

Hi,

Have you tested the Now LLM action? I am trying to use Now LLM but unable to understand the values we need to put in these fields and no documentation is provided.