Can I use Different LLM model other than servicenow LLM in now assist QA for search GEN AI

[Prathamesh Cha1]

Hi Team,

I have enabled GEN AI and I am trying to get actionable steps for users query in ESC and global serach and I am getting the actionable steps as well but I want to change the LLM module which is working behind this.

other than servicenow I want to use other LLM modules can anyone help me in this.

currently this is working based on below image, I got this from one of the document.

Thanks,

Regards

[Shamus Mulhall]

This is not currently a configurable property of the Now Assist in AI Search Q&A Genius Results.

[Prathamesh Cha1]

Hi @Shamus Mulhall ,

I just want to change LLM model, can't I do that? because in somewhere in docs I read Gen AI controller allows us to use other LLM model as well.

as of now we can ignore genius results part.

Thanks

[Victor Chen]

You can use your own LLM model for custom GenAI workflows you build on our platform. Not with AI Search at this time.

[Rahul Priyadars]

HI Prathmesh

Just a thought.. You cannot just infuse a model here as in Background QnA Uses RAG which also needs an EMBEDDING MODEL and VECTOR DATABASE. 

I think you can create the whole feature from SCRACTH using 3 rd Party LLM , EMBEDDING MODEL and VECTOR DB where you KB will act as the data source which is consumed by Outside Solution which you have to Build.

Regards

RP