Which LLM model is used by Servicenow QA gen ai for search, summarize or generate content currently?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-10-2024 02:06 AM - edited 12-10-2024 03:07 AM
Hi Team,
Which OOTB LLM model is used by Servicenow QA gen ai for search, summarize or generate content currently?
can anyone tell?

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-15-2024 06:33 PM - edited 12-15-2024 07:20 PM
Hi Prathamesh
OOTB Service Now Uses MISTRAL 8X7B Model which is trained by Service Now .
The Xanadu release, introduced a more fine-tuned model -Mixtral-8x7B-Instruct model (Previously Star Coder2). The fine-tuned model is called the ServiceNow text-to-text LLM.
The Mixtral-8x7B-Instruct base model has a good understanding of the English language and is trained on open-source datasets that give it the general ability to operate as a conversational agent. Mixtral’s Instruct model may not have had a focus on Service Management Generative AI use cases. To develop a Now LLM that provides the best possible performance on Now Assist skills such as summarization, Q&A, and conversational catalog, we’ve fine-tuned and aligned the model with proprietary data.
Hope below TABLE is useful for you.
There Model Training Flow.
Regards
RP