--- sourceDocument: Brazil Conversational Interfaces sourceDocumentLink: https://www.servicenow.com/docs/r/conversational-interfaces Release : - brazil ft:locale : - en-US ft:publication_title : - Brazil Conversational Interfaces ft:clusterId : - convint bundleId : - convint workflow : - Platform --- # Testing assistant conversations # Testing assistant conversations {#ariaid-title1} Release version: Brazil Updated October 5, 2026 ![](https://www.servicenow.com/docs/portal-asset/ico-clock) 3 minutes to read The Testing tab in Assistant Designer helps you assess the quality and performance of your conversational assistant. You can test conversations manually or run automated evaluations on generated scenarios to measure the assistant's success in addressing the user request and usage of available assets. ## Testing tab {#evaluations-ad__section-1} The Testing tab provides evaluation capabilities across multiple conversation types including virtual agent topics, conversational catalog items, AI agents, knowledge base and external content search results, and small talk interactions. The feature analyzes conversations to help you identify areas for improvement in your assistant configuration. From the Testing tab, you can create simulated experiences through manual tests or generate evaluation metrics by setting up automated evaluations. You can select an assistant and test it manually, or select Set up automated evaluation to create an automated evaluation. To set up automated evaluations, see [Set up an automated evaluation](https://www.servicenow.com/docs/EzRS~cD0y4qsZmsT9MpEPA "Run an automated evaluation to measure how well your assistant handles generated conversation scenarios."). The Testing tab supports two evaluation approaches: * Test one conversation at a time (manual test): Test conversations individually by chatting with your assistant. See how the assistant responds and review what it does. Select your assistant and use the Test assistant option to validate whether an assistant is configured correctly and is working as intended. Note: This is meant to be a simulated experience. * Evaluate many conversations at a time (automated evaluation): Evaluate your assistant using auto-generated chats, explore multiple scenarios, and view detailed performance insights. Evaluation works by examining a conversation transcript: the full back-and-forth between a user and the assistant. When you run an evaluation, the simulated conversation transcripts are examined and selected metrics are applied to generate scores and insights. Each automated evaluation runs on one chat experience, either Standard or enhanced chat or Premium chat, which you select when you set up the evaluation. You can evaluate an assistant on either chat experience, even one that isn't configured for that assistant. Note: Before running your evaluation, upload a table that includes user requests, scenario context, and the correct ground truth responses. You can evaluate approximately 500 conversations per run. For more information about adding data sets for ground truth, see [Data sets for conversation evaluations](https://www.servicenow.com/docs/WdlMyFfQt_KzoSqdgsPU7g "Test data sets supply the scenarios and expected results that conversation evaluations run on to measure how your assistant performs."). You can also filter the table so that only records matching your conditions, such as a particular intent category or date range, are used to generate scenarios. For more information, see [Set up an automated evaluation](https://www.servicenow.com/docs/EzRS~cD0y4qsZmsT9MpEPA "Run an automated evaluation to measure how well your assistant handles generated conversation scenarios."). You can also clone a completed automated evaluation to reuse its configuration as a starting point for a new one. For more information about cloning an evaluation, see [Clone an existing evaluation](https://www.servicenow.com/docs/eG9kq3UBeZRUVOCq4vfDPw "To reuse the configuration of a completed evaluation, you can clone it instead of setting up a new evaluation from scratch."). ## View failure pattern insights {#evaluations-ad__section_insights_pointer_ad} After an automated evaluation with failed scenarios finishes running, Assistant Designer analyzes the results and clusters recurring failure patterns on the evaluation results page. You can prioritize what to fix without reviewing every failed scenario individually. For more information, see [Insights into failed scenarios](https://www.servicenow.com/docs/OB73D9u~M4gCR55vjybg~Q "Analyze failed scenarios in an automated evaluation and see the recurring failure patterns behind them, to prioritize what to fix without reviewing every failed scenario one by one."). You can customize the default severity level assigned to each failure pattern. For more information, see [Customizing severity levels](https://www.servicenow.com/docs/WhBKzwCOu4yMkWjaysCYjQ "Assign a severity level to each failure pattern that automated evaluations can detect, so your evaluation results reflect how your organization wants to weigh each type of failure."). ## Compare evaluations {#evaluations-ad__section_dnm_ppq_sjc} Compare the results of multiple auto-evaluation runs side by side to see how your assistant's metrics change from one run to the next. You can view trends across evaluation runs by comparing the results between different evaluations. From the Automated evaluations section, select the evaluations to compare and select Compare evaluations. You can compare up to 5 evaluation runs at a time. To see how your assistant performs on each chat experience, run an evaluation on each one and compare the results. ## Delete evaluations {#evaluations-ad__section_delete_evaluations_ad} To remove an evaluation, select the Delete evaluation icon ![]() at the end of its row in the Automated evaluations section. Then from the Confirm delete dialog box, select Delete. A message confirms that the evaluation was deleted. If the evaluation is still in progress, it stops running before it's deleted. * **[Customizing severity levels](https://www.servicenow.com/docs/WhBKzwCOu4yMkWjaysCYjQ)** Assign a severity level to each failure pattern that automated evaluations can detect, so your evaluation results reflect how your organization wants to weigh each type of failure. * **[Set up an automated evaluation](https://www.servicenow.com/docs/EzRS~cD0y4qsZmsT9MpEPA)** Run an automated evaluation to measure how well your assistant handles generated conversation scenarios. * **[Insights into failed scenarios](https://www.servicenow.com/docs/OB73D9u~M4gCR55vjybg~Q)** Analyze failed scenarios in an automated evaluation and see the recurring failure patterns behind them, to prioritize what to fix without reviewing every failed scenario one by one. * **[Clone an existing evaluation](https://www.servicenow.com/docs/eG9kq3UBeZRUVOCq4vfDPw)** To reuse the configuration of a completed evaluation, you can clone it instead of setting up a new evaluation from scratch. * **[Evaluation metrics for automated evaluation](https://www.servicenow.com/docs/hWlKAN0kPz_w2TfN~Nkdag)** Metrics used to define success for evaluations. * **[Data sets for conversation evaluations](https://www.servicenow.com/docs/WdlMyFfQt_KzoSqdgsPU7g)** Test data sets supply the scenarios and expected results that conversation evaluations run on to measure how your assistant performs. **Related concepts** * [Customizing severity levels](https://www.servicenow.com/docs/WhBKzwCOu4yMkWjaysCYjQ "Assign a severity level to each failure pattern that automated evaluations can detect, so your evaluation results reflect how your organization wants to weigh each type of failure.") * [Insights into failed scenarios](https://www.servicenow.com/docs/OB73D9u~M4gCR55vjybg~Q "Analyze failed scenarios in an automated evaluation and see the recurring failure patterns behind them, to prioritize what to fix without reviewing every failed scenario one by one.") **Related tasks** * [Set up an automated evaluation](https://www.servicenow.com/docs/EzRS~cD0y4qsZmsT9MpEPA "Run an automated evaluation to measure how well your assistant handles generated conversation scenarios.") * [Clone an existing evaluation](https://www.servicenow.com/docs/eG9kq3UBeZRUVOCq4vfDPw "To reuse the configuration of a completed evaluation, you can clone it instead of setting up a new evaluation from scratch.") **Related reference** * [Data sets for conversation evaluations](https://www.servicenow.com/docs/WdlMyFfQt_KzoSqdgsPU7g "Test data sets supply the scenarios and expected results that conversation evaluations run on to measure how your assistant performs.")