Generative AI Controller release notes
The ServiceNow® Generative AI Controller application enables you to use generative AI capabilities with third-party large language model (LLM) providers on the ServiceNow AI Platform. You can reduce complexity and enhance the user experience in your organization by generating and summarizing content, analyzing user sentiment, and writing unique prompts. Generative AI Controller was enhanced and updated in the Yokohama release.
Generative AI Controller highlights for the Yokohama release
- Review changes to Now Assist usage measurement.
- Some Now Assist skills, agents, and agentic workflows are on by default.
- Additional role configuration is required for agentic workflows and AI agents included with Now Assist applications.
- Protect your users by configuring settings for anonymization of personally identifiable information (PII) with the Data Privacy application.
See Generative AI Controller for more information.
Important information for upgrading Generative AI Controller to Yokohama
Generative AI Controller is installed and updated when you install or update any Now Assist application. If you have issues installing or updating applications, see this knowledge article for steps that may address your issue. Otherwise, you can make a Support case.
New in the Yokohama release
- yokohama-patch-13
- Connect Generative AI Controller to your Azure OpenAI deployment by configuring a custom resource path in your bring your own key (BYOK) model configuration. Use this when your Azure OpenAI endpoint includes a path segment that Generative AI Controller does not add by default.
- Yokohama Patch 10
- Administrator access to Gen AI log
- Access the Gen AI log [sys_generative_ai_log] table to gain insights for debugging purposes. Records related to HR remain restricted to HR admins.
- Enhanced AI asset inventory
- Track the enhanced AI asset inventory through AI Control Tower using new metadata fields in the Model [sys_generative_ai_model_config] and Prompt [sys_generative_ai_config] tables. Gain better visibility into AI asset status and life-cycle details, such as retirement dates.
- Yokohama Patch 8
- AI Model Version Mappings
- Review the mappings between AI model versions, their providers in the Gen AI Model Version Mapping [sys_gen_ai_model_version_mapping] table. It shows mapping between source and target models, along with associated metadata, such as skill type, model type, resource associations, and provider information.
- Yokohama Patch 6
- Identify third-party LLM information
- Access the Gen AI Log Metadata [sys_gen_ai_log_metadata] table to identify which LLM model, version, and requested language was used to generate the AI content.
- Restrict LLM usage based on the domain
- Enable or disable Now Assist for each domain so that you can restrict the use of LLMs and avoid using AI for data processing, if needed.
- Yokohama Patch 1
- Global Model selection for conversational skills
- Enable Now Assist Admins to choose between GPT4.o and Now Assist LLM model for data routing at a global level. This ensures compliance with any regional restrictions and helpful for APAC users who may face limitations with US-based models, such as GPT-4.0.
Changed in this release
- Yokohama Patch 11
- Changes to Now Assist usage measurement
- Starting with Yokohama Patch 5, Now Assist usage measurement is transitioning from a 365-day look-back model to a 365-day burn-down model, with usage resetting at the contract anniversary date. For more information, refer to KB KB2704710: Now Assist Usage - Overview & New Measurement Logic.
- Some Now Assist skills are turned on by default
- The new default behavior works as follows:
- New customers: When you install a Now Assist product, designated skills are turned on automatically.
- Existing customers who are upgrading (starting with Yokohama Patch 11): Any previously unconfigured skill is turned on automatically (the skill was never configured and turned on, then turned off again). Previously configured skills that were turned on, then off, remain inactive.
- Configure ACLs for AI agents and agentic workflows
- Configure the access control lists for who can discover and trigger AI agents and agentic workflows in their guided setups in AI Agent Studio. You can determine whether an AI agent or agentic workflow behaves as a dynamic user or as an AI user. You can also specify if an AI agent or agentic workflow can be available to all authenticated users or publicly available.
- Yokohama Patch 1
- Configure Data Privacy and Data Discovery to protect the personally identifying information (PII) of your users.
- Generative AI Controller has changed to use the Data Privacy application instead of the Sensitive Data Handler to help anonymize PII. The process for choosing what gets anonymized and how has shifted to different tables and forms that your administrator must configure for your organization.
Deprecations
The dependency on Sensitive Data Handler has been removed. Regular expressions that are configured with Sensitive Data Handler are applied to the Data Privacy application with a fix script when you upgrade to Yokohama.
Activation information
Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of a Now Assist application. For details, see Installing Generative AI Controller and Install Now Assist plugins.