Is it still the case that external LLMs cannot be used with Now Assist Search?
From my understanding, some Now Assist Skills in HRSD allow the choice between Now LLM and external LLMs, either for all skills or only specific ones. Is that correct? (Skills include: Now Assist for Search, Virtual Agent, Chat Summarization, Case Summarization, Resolution Notes Generation, Knowledge Article Generation, LLM-Based Proactive Prompts, LLM Topics, and Third-Party LLM Integration). Please confirm which LLM can we use for each of this skills?
Now, consider a scenario where a client wants to use their own secured, personalized version of ChatGPT LLM (XYZ) along with IBM Watsonx (Granite LLM). Would it be possible to configure ServiceNow Virtual Agent as the primary interface while relying entirely on these external LLMs, without using Now LLM at all?
Alternatively, if you recommend using all three models - i.e Now LLM cannot be bypassed and we have to use it (Now LLM, Granite LLM, and the secured ChatGPT LLM), how would the processing flow work? For example, would the Virtual Agent first search in Now LLM, then route queries to Granite LLM, and finally send them to the secured LLM before displaying the response in Virtual Agent? @Victor Chen @Melody Young @Ashley Snyder
