Test results record

  • Release version: Xanadu
  • Updated August 1, 2024
  • 3 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Test results record

    A Test Results record provides detailed information about a single test execution in ServiceNow’s Automated Test Framework (ATF). It helps you understand the outcome of a test, including success, failure, warnings, and errors, along with useful diagnostic details for troubleshooting.

    Show full answer Show less

    Key Features

    • Status Indicators: Shows the test result status such as Success, Failure, Success with warnings, Running, Skipped, Error, or Cancelled, enabling quick insight into test outcomes.
    • Client Error Details: Displayed only when a test fails due to client-side errors, this section identifies the failing step, provides detailed error messages, and includes screenshots for analysis. It also links to relevant test logs and allows you to manage client error warnings.
    • Failure Details: For failures not caused by client errors, this section highlights the failing step, step output, and failure screenshots to assist in root cause analysis.
    • Additional Information: Includes output from each test step, user agent strings of browsers involved, and retains previous test results for comparison during re-runs if you have appropriate roles.
    • Retain Indefinitely Option: Allows you to preserve critical test result records beyond standard data retention policies for compliance or audit purposes.
    • Related Lists: Provides access to step results, test logs, system transaction logs, and warnings associated with the test, facilitating comprehensive review and troubleshooting.

    Practical Use for ServiceNow Customers

    By leveraging the Test Results record, you can effectively track and analyze automated test executions, quickly identify client or server errors, and access detailed diagnostic information including screenshots and transaction logs. This enables faster resolution of issues within your business processes and ensures higher quality in your ServiceNow applications. The ability to retain important test records and manage client error warnings also supports governance and continuous improvement of your testing practices.

    A Test Results record contains detailed results information about one test execution. Client Error Details and Failure Details sections appear when a test fails due to error conditions, and include detailed error information you can use for troubleshooting purposes.

    Field Description
    Test Name of the test.
    Status Result of the Test execution:
    Success
    Test passed.
    Failure
    Test failed.
    Success with warning(s)
    Test run passed but encountered client error(s) that were allowed as warnings in the Allowed Client Error table.
    Waiting
    Test waiting to start.
    Running
    Test is running.
    Skipped
    Occurs if an earlier test in the suite failed and Abort on failure is set to true.
    Error
    An error occurred in the test framework. For example, the test runner halted, or the server encountered an unintended scenario. The error message appears in the Summary field of the steps results record for the step that threw the error.
    Cancelled
    User canceled the Test.
    Retain indefinitely Check box to keep this record even after the specified data retention period has passed. For more information, see Table Cleanup.
    Start time Date and time of day at which this test started executing.
    End time Date and time of day at which this test finished executing.
    Duration Elapsed time it took to execute this test.
    Previous test result Results of the previous test execution, indicating if the test passed or failed. Only appears if this test result is for a re-run of a failed test and you are logged on with the admin, atf_test_admin, or atf_test_designer role. Click the information icon (Reference field icon) to navigate to the original test result.
    Previous test result
    Note:
    If this test created screenshots, they appear as attachments in Manage attachments.

    Client Error Details

    This section only displays when a test fails due to a client error.

    Field Description
    Failing step Reference to the first test step result that failed during this test. Click the information icon (Reference field icon) to view detailed step results and error information in the Step Results form.
    Summary The following text indicates that a client error occurred at this step, and includes the detailed error message:

    This step failed because the client error 'DETAILED ERROR MESSAGE' was detected on the page being tested. See failing Test Logs. To ignore these errors in the next test run, use ‘Add all client errors to warning/ignored list’ links.

    Test designers and developers should always investigate client errors to determine if there are issues with your business process. For more details, see Identify and resolve client errors.
    First failing client error Reference to the first client error that failed during the test. Click the information icon ( Reference field icon) to view detailed test results and error information in the Test Logs form.
    Note:
    For details on how to allow client errors as ignored or warning entries, refer to Allowed client errors
    Failing step screenshot Screenshot of the step that failed. Click Reference field icon to download the screenshot.

    Failure Details

    This section only displays when a test fails due to a cause other than a client error.

    Field Description
    Failing step Reference to the first step result that failed during this test. Click Reference field icon to download the screenshot.
    Summary Output of the step that failed.
    Failing screenshot Screenshot of the step that failed.

    Additional information

    This section is visible for all test results.

    Field Description
    Output Output generated for the test step.
    • Test result (often Passed or Failed).
    • For failed tests, includes the same error message detail displayed in the Summary field for the first test step that failed. See Client Error Details above.
    Browsers involved User agent strings returned by browsers that ran the test.
    Table 1. Related lists
    Related list Description
    Step Results Record for each step result and log entry for this test.
    Test Log Record for each test log related to this test results record.
    Test Transactions Record for each transaction (from the system transaction log [syslog_transaction] related to this record.

    To view the step results associated with a transaction, click the appropriate link in the Step Results column.

    To view the transaction logs associated with a transaction, click the appropriate link in the Transaction column.

    Note:
    The system may not be able to log some transactions with short durations.
    Warnings List of test logs containing client errors with a warning status. The Warnings related list only appears on test results with warnings.