Test a Now Assist AI web agent or workflow

Test a Now Assist AI web agent or workflow in AI Agent Studio to evaluate its performance.

Vorbereitungen

• Confirm that the ServiceNow Web Automation browser extension currently displays Connected to your ServiceNow® instance. All browser windows to your instance must be currently active and logged in. For more information, see Install the browser extension for Now Assist AI web agents.
• Ensure that enhanced chat is available in Now Assist panel. The Web view pane is available only when enhanced chat is enabled. For more information see Enhanced chat.
• The Now Assist AI web agent checks its access to the internet by first opening the main Google website. If you have implemented an allow list, ensure that google.com is allowed. For information see Configure allowed websites for Now Assist AI web agents.
• Role required: sn_aia.admin

Warum und wann dieser Vorgang ausgeführt wird

As an AI agent administrator, you can run manual tests of Now Assist AI web agents in the AI Agent Studio by providing a task or request in the Testing module. Testing includes the user experience as seen in Now Assist panel, plus extra information for administrators. This information is provided in a split view in Node view:

• AI process map displays a diagram of agent orchestration.
• AI agent decision logs provide reports on the web agent's reasoning as it processes your request.

Because generative AI is non-deterministic, try several test runs of a task. The web agent's responses and results may vary from one test run to another. Your test runs are listed in the Activity tab of AI Agent Studio.

Prozedur

1. Confirm that the browser extension displays Connected, then in your instance, navigate to All > AI Agent Studio > Testing.
   The Testing module opens to the Test AI reasoning tab.
2. In the Test AI reasoning tab, fill in the fields.

   Tabelle : 1. Test AI reasoning fields

   Field	Description
   Search	You can test either an agent or a workflow. Enter Web Automation Agent or the name of the workflow you have configured.
   Version	(Optional) This field automatically fills in the most recent active version of your search item, but you can switch to a different active version from the drop-down list.
   Task	Enter a request that is typical of your users and their needs. Example tasks: Can you find the best coffeemaker on amazon.com? Can you find the latest invoice from invoiceninja.com? Navigate to https://www.accuweather.com/. In the Search field, enter "zip code 95054" and search. In the search results, open the first page. Find the current temperature in degrees Fahrenheit and tell me the temperature. Navigate to en.wikipedia.org. On the main page of wikipedia.org, in the Search field, search for "Santa Clara, California". In the search results, open the first page listed, and read its contents. Summarize the contents of the page in 2 or 3 sentences.

   Abbildung : 1. Test AI reasoning tab

   

3. Select Start test.
   • You are directed to the Chat responses tab. Here you can interact with the web agent the way a user does in Now Assist panel.
   • Initially the Node map view also displays AI process map (a diagram of the agent orchestration) and AI agent decision logs.
   • Under View AI Agent Processing Steps, the web agent prints an execution plan with numbered steps, and requests your confirmation. You must provide confirmation so the web agent can advance.

   Abbildung : 2. Chat responses tab and Node view with AI agent decision logs

   

4. Review the proposed plan in the Chat responses tab, then enter proceed or approve if you are satisfied that the web agent understood your request.
5. Wahlweise: If you are not satisfied with the web agent's plan, try to rephrase your request.
   Hinweis:

   The system may display an error about a setup configuration if the ServiceNow Web Automation browser extension is disconnected. Ensure that the browser extension displays Connected by refreshing any browser windows.
6. Monitor the web agent's process in AI Agent Studio while the web agent opens a concurrent browser tab to your target website, labeled "Opened for you".

   Abbildung : 3. Separate browser tab opened by the web agent

   

   As the web agent begins navigating to the website, Web view opens automatically to display periodic screenshots. (Your users can see Web view in Now Assist panel by selecting Show on the Walkthrough of AI agents on the web card).

   Abbildung : 4. Chat responses tab and Web view

   

7. Wahlweise: If a website requires a login, the web agent notifies you in Chat responses to enter your credentials: open the separate browser tab to your website, log in as required, then return to the AI Agent Studio window.
   To open the separate browser tab you can either select Switch to this tab from Web view, or you can directly select the browser tab labeled Opened for you.

Ergebnisse

When the test is finished:

• The web agent displays a summary of the outcome in the Chat responses pane. This is the outcome that is provided to your users when they are in Now Assist panel.
• The web agent closes the separate browser tab to the external website.
• Web view automatically switches back to Node view, where an End node is displayed in AI process map.
• AI agent decision logs all display Completed. You can review reports of the reasoning process by expanding the decision log sections.

For testing you don't need to enter a closing remark, such as "thank you", in the chat. (In actual use in Now Assist panel, a closing remark helps the web agent understand user intention).

Nächste Maßnahme

View information about your test runs in the Activity tab of AI Agent Studio. The most recent test run is located at the top of the list.

Your users can access your Now Assist AI web agent by using Now Assist panel. For information see Using a Now Assist AI web agent in Now Assist panel.

Zugehörige Tasks

• Manually test the execution of an agentic workflow
• Manually test the execution of an AI agent