Which LLM model is used by Servicenow QA gen ai for search, summarize or generate content currently?

Prathamesh Cha1
Tera Contributor

Hi Team,

 

Which OOTB LLM model is used by Servicenow QA gen ai for search, summarize or generate content currently? 

can anyone tell?

5 REPLIES 5

Rahul Priyadars
Tera Sage

Hi Prathamesh

 

OOTB Service Now Uses MISTRAL 8X7B Model which is trained by Service Now . 

The Xanadu release, introduced a more fine-tuned model -Mixtral-8x7B-Instruct model (Previously Star Coder2). The fine-tuned model is called the ServiceNow text-to-text LLM.

The Mixtral-8x7B-Instruct base model has a good understanding of the English language and is trained on open-source datasets that give it the general ability to operate as a conversational agent. Mixtral’s Instruct model may not have had a focus on Service Management Generative AI use cases. To develop a Now LLM that provides the best possible performance on Now Assist skills such as summarization, Q&A, and conversational catalog, we’ve fine-tuned and aligned the model with proprietary data. 

Hope below TABLE is useful for you.

RahulPriyadars_0-1734316385716.png

 

There Model Training Flow.

 

RahulPriyadars_0-1734319202418.png

 

 

Regards

RP