AI Agent Studio overview
Summarize
Summary of AI Agent Studio overview
AI Agent Studio is a centralized application that enables ServiceNow customers to create, manage, and test AI agents and agentic workflows designed to automate and enhance business processes. To start using AI Agent Studio, you must first install ServiceNow Otto AI Agents. The platform provides a guided experience with an Overview page featuring ready-made templates, recent activities, and a checklist with educational resources to help you incorporate AI agents effectively into your workflows.
Show less
Managing AI Agents and Agentic Workflows
The Create and Manage page allows you to create, duplicate, and edit AI agents and agentic workflows via two tabs, offering flexible list views with search and filtering capabilities. Selecting an agent or workflow opens Guided Setup for configuration or reconfiguration, helping you tailor AI solutions to your specific business needs.
Monitoring and Testing AI Agents
The Activity page provides execution logs for AI agents and workflows, with filtering options including version control, facilitating oversight and troubleshooting. The Testing page supports both manual and automated testing:
- Manual tests: Simulate single executions to verify expected behavior or test security controls.
- Automated agentic evaluations: Conduct multiple executions to detect patterns and trends that might not be apparent from single tests.
Note that testing does not support Now Assist panel assistance for live agent interactions; Virtual Agent should be used instead to avoid session expiration issues during live chats.
Configuration and Analytics
From the AI Agent Studio Settings page, you can enable AI Guardian to enhance your AI agents with features such as offensiveness detection, prompt injection decision-making, and long-term memory management. The AI Agent Analytics dashboard offers vital metrics including agent usage, execution counts, and efficiency gains like time-to-resolution improvements, providing insights to optimize your AI deployments.
Create, manage, or test AI agents and agentic workflows so that you can create self-executing workflows to help you achieve your business goals.
AI Agent Studio homepage
With the AI Agent Studio application, you can create, manage, or test AI agents and agentic workflows all in one place. To enable the agentic AI experience, you must first install AI agents. For more information, see Install ServiceNow Otto AI Agents.
The Overview page has three sections where you can find the information that you must understand, begin, and continue developing AI agents and agentic workflows. When you first go to the AI Agent Studio, tour points are available to guide you through the experience.
In the Ready-made agentic workflows and AI agents section, you can find the templates and ready-made AI agents and agentic workflows that you can incorporate as-is or in custom workflows that you create. You can even explore more templates to find the ones that best fit your needs.
In the Recent agentic workflows and AI agents activity section, you can find the agentic workflows or AI agents that have been created or configured most recently. On both List views, you can create, duplicate, or delete agentic workflows or AI agents. The tab also includes a link to the AI Agents Dashboard where you can review the details about AI agent usage and performance.
The third section is a card to open a modal with a journey checklist that describes the steps to incorporate the AI agents into your workflows successfully and a video that provides an overview of the AI agents and workflows to get you started. Select View steps to open this section.
The following example shows the Overview page of AI Agent Studio.
Managing agentic workflows and AI agents
From the AI Agent Studio Create and manage page, you can create, duplicate, or manage the existing agentic workflows and AI agents. This page has two tabs, one for agentic workflows and one for AI agents. You can edit the columns of the List view to change what information is displayed. You can also search or filter the Lists to find the agentic workflows and AI agents that you're looking for quickly. By selecting the name of the agentic workflow or AI agent, you can open Guided Setup to configure or reconfigure the agentic workflow or AI agent.
The following example shows the AI Agent Studio create and manage page after several applications are installed.
agentic AI activity
The activity page contains execution logs for both agentic workflows and AI agents. The list allows you to filter based on various fields, including the version. For more information on creating multiple versions of the List of steps field, see Version control for AI agents and agentic workflows.
The following example shows several execution logs in AI Agent Studio.
Testing agentic AI
There are two types of manual tests you can do: AI agent or agentic workflow to test execution or Test access to test security controls. You can view your executed tests in the two tabs of the testing page. For manual execution tests, you can select the reply button to repeat the test. You can open the full details page of an automated test by selecting the test's name in the list in the Automated tab.
The following example shows the inputs for a Generate Resolution Plan agentic workflow testing setup of AI Agent Studio.
AI Agent Studio settings
The following image shows the AI Agent Studio settings.
AI Agent Analytics dashboard
From the AI Agent Analytics dashboard, you can review the vital statistics about your AI agents and agentic workflows. You can see the data about the number of agents and agentic workflows used, time-to-resolution efficiency gain, and the number of executions.
The following example shows the overview page for the AI Agent Analytics dashboard.