Combined Generative AI Controller release notes for upgrades from Vancouver to Xanadu

How to use this page

To help you prepare for your upgrade, we have combined the cross-family Generative AI Controller release notes onto one page. Read this summary of the new features, changes, and updated information for your product from Vancouver to Xanadu.

Tip:

If there were no updates for a release notes section in a certain family release, we included a short note for your reference. For example, if a product did not have any updates in Tokyo, the row says "No updates for this release."

Important information for upgrading Generative AI Controller to Xanadu

Before you upgrade to Xanadu, review these pre- and post-upgrade tasks and complete the tasks as needed.


Release	Release notes
Vancouver	No updates for this release.
Washington DC	No updates for this release.
Xanadu	No updates for this release.

New features

Between your current release family and Xanadu, new features were introduced for Generative AI Controller.


Release	Release notes
Vancouver	Integrate with Aleph Alpha LLM models Bring your API keys and connect Luminous LLM with the Now Platform. Mask sensitive data in Now Assist prompts Configure how sensitive data is identified and removed from LLM prompts to protect your users and agents. Use your own MID server Use generative AI capabilities while using your MID server with no extra configuration necessary.
Washington DC	Recursive summarization for large inputs Large language models (LLMs) have a maximum number of tokens per request. Recursive summarization breaks down large inputs into smaller pieces, summarizes those pieces, and then recombines them to make the original call. This process prevents important context from being lost when submitting requests to the LLM, which can result in more accurate responses with fewer hallucinations. Integrate with Aleph Alpha models Bring your own API credentials and connect Aleph Alpha's Luminous LLM with the ServiceNow AI Platform. Integrate with IBM watsonx models Use your own API credentials to connect to IBM watsonx's Granite LLMs with the ServiceNow AI Platform. Integrate with external LLMs Connect API credentials with a generic LLM connector and use an external LLM on the ServiceNow AI Platform. Semantic filter for sensitive content in generative AI conversations Use AI Semantic Search to help determine if sensitive content is being discussed, such as workplace misconduct or employee health concerns, and trigger a switch to a different Virtual Agent topic. Disable Dynamic Translation for LLM conversations in Virtual Agent Dynamic Translation is enabled by default for ServiceNow AI Platform feature that is available with activation of any Now Assist applications, but you can disable it if you prefer not to have multi-language support for LLM conversations.
Xanadu	Xanadu Patch 3 Metadata log table for generative AI requests Use the new metadata log table that includes information about the requesting conversation, the capability definition, provided feedback (if any), and error codes. Translation for Now Assist Support users who speak different languages with new language information in LLM request metadata, better controls for Dynamic Translation, and translated text logging. Xanadu Patch 7 Global Model selection for conversational skills Enable Now Assist Admins to choose between GPT4.o and Now Assist LLM model for data routing at a global level. This ensures compliance with any regional restrictions and helpful for APAC users who may face limitations with US-based models, such as GPT-4.0.

Changes

Between your current release family and Xanadu, some changes were made to existing Generative AI Controller features.


Release	Release notes
Vancouver	No updates for this release.
Washington DC	No updates for this release.
Xanadu	Directions for generative AI updates for Generative AI Controller The prompts, which are the instructions to the large language model (LLM), for all four capabilities (Generic Prompt, Generate Content, Summarization, and Sentiment Analysis), semantic filtering, and recursive summarization have been updated.

Removed

Between your current release family and Xanadu, some Generative AI Controller features or functionality were removed.


Release	Release notes
Vancouver	No updates for this release.
Washington DC	The QnA capability has been removed and the action has been removed from Virtual Agent Designer and .
Xanadu	No updates for this release.

Deprecations

Between your current release family and Xanadu, some Generative AI Controller features or functionality were deprecated.


Release	Release notes
Vancouver	No updates for this release.
Washington DC	No updates for this release.
Xanadu	No updates for this release.

Activation information

Review information on how to activate Generative AI Controller.


Release	Release notes
Vancouver	To install and activate Generative AI Controller, you must install one of the Now Assist applications, such as Now Assist for CSM or Now Assist for HRSD. Generative AI Controller is activated as a dependency. Generative AI Controller can't be installed on its own.
Washington DC	Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of any Now Assist application. For details, see Installing Generative AI Controller.
Xanadu	Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of any ServiceNow® Now Assist application. For details, see Installing Generative AI Controller.

Additional requirements

If any additional requirements were introduced or changed for Generative AI Controller we have noted them here.


Release	Release notes
Vancouver	No updates for this release.
Washington DC	No updates for this release.
Xanadu	No updates for this release.

Browser requirements

If any specific browser requirements were introduced or changed for Generative AI Controller we have noted them here.


Release	Release notes
Vancouver	No updates for this release.
Washington DC	No updates for this release.
Xanadu	No updates for this release.

Accessibility information

Review details on accessibility information for Generative AI Controller, such as specific requirements or compliance levels.


Release	Release notes
Vancouver	No updates for this release.
Washington DC	No updates for this release.
Xanadu	No updates for this release.

Localization information

If there are specific localization considerations for Generative AI Controller we have noted them here.


Release	Release notes
Vancouver	OpenAI, Azure OpenAI, Google Cloud, and Aleph Alpha have various levels of proficiency in over 40 languages, including English, Spanish, French, Arabic, Chinese, and Japanese. Prompts that are written in a non-English language may not return responses in that same language.
Washington DC	No updates for this release.
Xanadu	Generative AI Controller uses Microsoft Azure OEM for Dynamic Translation in Now Assist for multi-language support. You can enable dynamic translation from the Now Assist Admin console.

Highlight information

If there are specific highlight considerations for Generative AI Controller we have noted them here.


Release	Release notes
Vancouver	Integrate with Aleph Alpha models and use Luminous LLM in generative AI capabilities in and Virtual Agent Designer. See Generative AI Controller for more information.
Washington DC	Integrate with custom LLMs in generative AI capabilities in and Virtual Agent Designer Add semantic filters in Virtual Agent to detect and handle sensitive topics See Generative AI Controller for more information.
Xanadu	Xanadu Patch 3 Review a read-only metadata log table for generative AI requests. Use the improved language support for skills and capabilities, including the Dynamic Translation services and native translation by the LLMs. Xanadu Patch 1 Updated prompts for capabilities, semantic filtering, and recursive summarization that improve latency and processing for Generative AI Controller capabilities and Now Assist skills. See Generative AI Controller for more information.