AI Agent Studio
Summarize
Summary of AI Agent Studio
AI Agent Studio enables ServiceNow customers to create, manage, and test AI agents and agentic workflows from a centralized application. These self-executing workflows help automate processes to achieve your business goals efficiently. To activate the full AI capabilities, you must first install Now Assist AI agents.
Show less
The Overview page in AI Agent Studio introduces you to ready-made AI agents and workflows, recent activity, and provides a journey checklist and instructional video to guide successful AI incorporation.
Managing AI Agents and Agentic Workflows
The Create and Manage page allows you to create, duplicate, edit, and organize AI agents and workflows via separate tabs. You can customize list views, apply search and filters, and use Guided Setup to configure or reconfigure agents and workflows, streamlining development and maintenance.
Monitoring AI Activity
The Activity page logs execution details of AI agents and workflows, supporting filtering by fields such as version. This makes tracking performance and troubleshooting easier. Version control capabilities help manage multiple versions effectively.
Testing AI Agents and Workflows
AI Agent Studio provides manual and automated testing options. Manual single-execution tests validate expected behavior, while automated agentic evaluations identify trends across multiple runs. Testing supports execution and security control verification but does not support live agent interactions via Now Assist panel; for live chat, use Now Assist in Virtual Agent.
Test results are accessible in dedicated tabs, with options to repeat manual tests or review detailed automated test reports.
Configuring AI Agent Studio Settings
Through the Settings page, you can enable and configure Now Assist Guardian features, including offensiveness detection, prompt injection response, and long-term memory management for AI agents, enhancing security and reliability.
Analyzing AI Agent Performance
The AI Agent Analytics dashboard provides vital statistics such as usage volume, time-to-resolution improvements, and execution counts. This data helps assess the effectiveness and efficiency gains from deploying AI agents and workflows.
Create, manage, or test AI agents and agentic workflows so that you can create self-executing workflows to help you achieve your business goals.
AI Agent Studio overview
With the AI Agent Studio application, you can create, manage, or test AI agents and agentic workflows all in one place. To enable the agentic AI experience, you must first install Now Assist AI agents. For more information, see Install Now Assist AI agents.
The Overview page has three sections where you can find the information that you must understand, begin, and continue developing AI agents and agentic workflows. When you first go to the AI Agent Studio, tour points are available to guide you through the experience.
In the Ready-made agentic workflows and AI agents section, you can find the templates and ready-made AI agents and agentic workflows that you can incorporate as-is or in custom workflows that you create. You can even explore more templates to find the ones that best fit your needs.
In the Recent agentic workflows and AI agents activity section, you can find the agentic workflows or AI agents that have been created or configured most recently. On both List views, you can create, duplicate, or delete agentic workflows or AI agents. The tab also includes a link to the AI Agents Dashboard where you can review the details about AI agent usage and performance.
The third section is a card to open a modal with a journey checklist that describes the steps to incorporate the AI agents into your workflows successfully and a video that provides an overview of the AI agents and workflows to get you started. Select View steps to open this section.
The following example shows the Overview page of AI Agent Studio.
Managing agentic workflows and AI agents
From the AI Agent Studio Create and manage page, you can create, duplicate, or manage the existing agentic workflows and AI agents. This page has two tabs, one for agentic workflows and one for AI agents. You can edit the columns of the List view to change what information is displayed. You can also search or filter the Lists to find the agentic workflows and AI agents that you're looking for quickly. By selecting the name of the agentic workflow or AI agent, you can open Guided Setup to configure or reconfigure the agentic workflow or AI agent.
The following example shows the AI Agent Studio create and manage page after several Now Assist applications are installed.
Agentic AI activity
The activity page contains execution logs for both agentic workflows and AI agents. The list allows you to filter based on various fields, including the version. For more information on creating multiple versions of the List of steps field, see Version control for AI agents and agentic workflows.
The following example shows several execution logs in AI Agent Studio.
Testing agentic AI
From the AI Agent Studio testing page, you can review the different tests your AI agents and agentic workflows, both manual and automated. You can test the performance of your agentic AI by simulating a single execution manually, or you can use automated agentic evaluations for testing multiple executions. Single tests are best for evaluating whether the AI agent or agentic workflow does what you expect it to. Agentic evaluations are better at finding underlying patterns and trends that may not be noticeable one execution at a time.
There are two types of manual tests you can do: AI agent or agentic workflow to test execution or Test access to test security controls. You can view your executed tests in the two tabs of the testing page. For manual execution tests, you can select the reply button to repeat the test. You can open the full details page of an automated test by selecting the test's name in the list in the Automated tab.
The following example shows the inputs for a Generate Resolution Plan agentic workflow testing setup of AI Agent Studio.
AI Agent Studio settings
The following image shows the AI Agent Studio settings.
AI Agent Analytics dashboard
From the AI Agent Analytics dashboard, you can review the vital statistics about your AI agents and agentic workflows. You can see the data about the number of agents and agentic workflows used, time-to-resolution efficiency gain, and the number of executions.
The following example shows the overview page for the AI Agent Analytics dashboard.