Generative AI Controller release notes
The ServiceNow® Generative AI Controller application enables you to use generative AI capabilities with third-party large language models (LLM) providers on the ServiceNow AI Platform. You can reduce complexity and enhance the user experience in your organization by generating and summarizing content, analyzing user sentiment, and writing unique prompts. Generative AI Controller was enhanced and updated in the Xanadu release.
Generative AI Controller highlights for the Xanadu release
- Review a read-only metadata log table for generative AI requests.
- Use the improved language support for skills and capabilities, including the Dynamic Translation services and native translation by the LLMs.
- Updated prompts for capabilities, semantic filtering, and recursive summarization that improve latency and processing for Generative AI Controller capabilities and Now Assist skills.
See Generative AI Controller for more information.
New in the Xanadu release
- Xanadu Patch 3
- Metadata log table for generative AI requests
- Use the new metadata log table that includes information about the requesting conversation, the capability definition, provided feedback (if any), and error codes.
- Translation for Now Assist
- Support users who speak different languages with new language information in LLM request metadata, better controls for Dynamic Translation, and translated text logging.
- Xanadu Patch 7
- Global Model selection for conversational skills
- Enable Now Assist Admins to choose between GPT4.o and Now Assist LLM model for data routing at a global level. This ensures compliance with any regional restrictions and helpful for APAC users who may face limitations with US-based models, such as GPT-4.0.
Changed in this release
- Directions for generative AI updates for Generative AI Controller
- The prompts, which are the instructions to the large language model (LLM), for all four capabilities (Generic Prompt, Generate Content, Summarization, and Sentiment Analysis), semantic filtering, and recursive summarization have been updated.
Activation information
Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of any ServiceNow® Now Assist application. For details, see Installing Generative AI Controller.
Localization information
Generative AI Controller uses Microsoft Azure OEM for Dynamic Translation in Now Assist for multi-language support. You can enable dynamic translation from the Now Assist Admin console.