Handle failures caused by dynamic inputs in user testing of Virtual Agent topics

  • Release version: Xanadu
  • Updated October 23, 2024
  • 1 minute to read
  • Avoid failures when performing automated tests for topics in Virtual Agent by controlling which inputs that you want to run as part of a test case.

    Before you begin

    Set up a test case for a topic that includes dynamic inputs. See Create an automated test in Virtual Agent Designer for more information.

    Role required: virtual_agent_admin or admin

    About this task

    When running a test in Virtual Agent Designer, some tests may fail even when a topic has fully functional components. These failures can happen based on various cases, such as timestamps based on a function that always returns the current time. The timestamp is created correctly when the test runs, but isn’t a match with the recorded timestamp in the test case. Similar examples include different users entering different names, email or physical addresses, or other information specific to each user. Any topic that returns different data based on time or other changing conditions is a potential failing point in testing. By deactivating test steps that use dynamic input, you can run tests that won't fail due to a change in the data found in those steps.

    Procedure

    1. Navigate to All > Conversational Interfaces > Virtual Agent > Designer.
    2. Slide the discovery type toggle switch to NLU/keyword, then select Manage test cases.
    3. Under the Test Steps tab, select the Active column of the test step you want to exclude, and set its value to False.
    4. Repeat Step 3 with as many test steps as you want to deactivate.
    5. Run or debug your test case.