Manually test the execution of an agentic workflow

Test your agentic workflow in AI Agent Studio to analyze how it functions while it executes the instructions that you defined.

始める前に

Role required: sn_aia_admin and either admin or at least one role required by the ACL of the agentic workflow being testing and each of the ACLs of its downstream components

このタスクについて

After you create an agentic workflow, test it to see that it functions the way that you defined it. You can choose to run a manual test with a single instruction to test its basic functioning, or you can evaluate the AI agent's performance across multiple executions.

If you want to test multiple executions using execution logs, you can run an automated test. If you select Start automated evaluation, the agentic evaluation guided setup opens in a new browser tab. See Evaluate an agentic workflow for more details about running a new automated evaluation.

When manually testing performance, you can see how the agentic workflow and its AI agents interact with the AI Agent Orchestrator and the Communicator AI agent. The Orchestration is an agent that directs different AI agents, and the Communicator AI agent facilitates the communication between the user and other AI agents.

手順

1. Navigate to All > AI Agent Studio > Testing.
2. Select Start manual test.

   If you want to start an automated test, see Evaluate an agentic workflow for more details on that process.

3. In the Test type drop-down menu, select AI agent or workflow.

   If you want to test user access security controls, see Test agentic workflow user access.

4. Select an agentic workflow that you want to test by entering the name of a workflow or choosing from the drop-down menu.
5. In the Version drop-down list, select the version of the AI agent you want to test.

   See Version control for AI agents and agentic workflows for more information about creating and changing versions.

6. In the Task drop-down list, provide a concise summary of the task to be achieved.
   注:

   In the task summary, include a reference number for a specific record for better results during your testing.

   

7. Select Continue to Test Chat Response.

タスクの結果

When testing an agentic workflow, you can see the AI Agent Orchestrator and AI Agent Communicator working together to organize and manage the AI agents like a team. The AI agent Orchestrator assigns the individual, specialized agents to complete the subtasks. The AI Agent Communicator lets the AI Agent Orchestrator know the status of each agent.

注:

If you don't have the roles necessary to pass the ACLs of the agentic workflow and all of its AI agents and tools, you're notified that you don't have the necessary access and the test won't execute.

Your AI agents start to execute the test autonomously to resolve the agentic workflow by taking the input from the live agent as required.

図 : 1. Testing an agentic workflow

• A simulated chat experience begins on the Now Assist panel between your invoking user and AI agent.
• A diagram shows the tasks and communication of the AI agents that are working together to solve the case.
• A decision log records the thought process of each AI agent that is involved in solving the agentic workflow.
  注:

  You can view the entire decision log by selecting Download logs.

You can restart the entire testing process at any time by selecting Restart.