ATF Test Generator and Cloud Runner release notes

  • Release version: Store
  • Updated July 9, 2026
  • 4 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of ATF Test Generator and Cloud Runner Release Notes

    The ATF Test Generator and Cloud Runner application on the ServiceNow Store enables customers to automatically generate and run Automated Test Framework (ATF) tests with ease. It supports running tests in the ServiceNow-hosted Cloud Runner environment, allowing parallel test execution and improved test automation efficiency. This application is continuously enhanced to improve test generation, execution stability, and integration with ServiceNow features like Service Catalog and Flow Designer.

    Show full answer Show less

    Key Features

    • Automated Test Generation: Generate tests automatically for various ServiceNow components, including forms, Service Catalog items, and associated Flows, with a single click.
    • Cloud Runner Execution: Run ATF tests in the cloud with support for multiple parallel test lanes, asynchronous test execution via REST APIs, and enhanced progress tracking.
    • Role-Based Access: Introduced specific roles such as snatftg.cloudrunneradmin to allow users to manage cloud user settings and start test generations without full admin privileges.
    • API and Scripting Support: Server-side JavaScript APIs and REST APIs allow starting, canceling, and querying test runs programmatically, facilitating integration into CI/CD pipelines.
    • Advanced Test Generation Options: Features like Generation Presets and Condition Builder enable customers to create reusable, complex test generation configurations tailored to users, groups, roles, tables, and catalog items.
    • Scope Management: Ability to save generated tests within specific application scopes based on the related table or catalog item.
    • Improved Stability and Error Handling: Numerous fixes address timeouts, invalid user detection, network errors, and UI step reliability, enhancing overall test execution consistency.
    • Performance Enhancements: Faster test generation times and improved visibility of job progress in the Browser Orchestration Queue table.
    • Compatibility and Compliance: Availability in restricted environments such as the Australia SPP environment ensures broader compliance and deployment options.

    What Customers Can Expect

    • Streamlined test automation with the ability to generate and execute tests quickly and reliably on ServiceNow instances.
    • Improved control over cloud execution environments through role-specific permissions and API access for integration.
    • Enhanced user experience with clearer progress indicators, error messages, and support for complex test scenarios including flows and service catalog items.
    • Ongoing updates that fix bugs related to session limits, invalid users, and test execution timeouts, ensuring dependable operation.
    • Support for saving tests within appropriate scopes, aiding application lifecycle management and test organization.
    • Access to detailed REST and server-side APIs for automation and CI/CD pipeline integration.

    Important Notes

    Customers should review the system requirements and family compatibility details on the ServiceNow Store listing to ensure proper installation and operation of the ATF Test Generator and Cloud Runner applications.

    Version history for the ATF Test Generator and Cloud Runner on the ServiceNow Store.

    Important:
    For details on system requirements and family compatibility, view the application listing on the ServiceNow Store website.

    Version history

    Version 3.1.1 - July 2026 (Australia)
    • Added the role sn_atf_tg.cloud_runner_admin which allows users to set the cloud user and start test generations without needing the admin role themselves
    • Added asynchronous option to Test Runner Rest API which returns the root tracker id and does not wait for the Browser Orchestration Queue record to be inserted
    • Improved consistency of HTTP response codes to Cloud Runner Rest APIs
    • Improved consistency of progress percentage for test runs in the Browser Orchestration Queue table
    Version 3.0.5 - May 2026
    • Removed legacy ca certificate which is no longer necessary for mutual auth
    • Fixed a bug that prevented an invalid cloud user from being properly unset
    • Fixed an issue in TestUserAPILibrary that failed to detect invalid users
    Version 3.0.0 - March 2026
    • Fixed a bug where users with glide.invalid_query.returns_no_rows set to true were unable to set the cloud user properly
    • Fixed a bug that caused date and time fields in catalog items to be handled improperly by test generation
    Version 2.9.1 - December 2025 (Zurich)
    • Fixed:
      • Tests with UI steps time out when Limit Concurrent Sessions plugin is active and set for Cloud Runner user
      • Record producer steps are timing out in Cloud Runner
    Version 2.8.0 - August 2025
    • Fixed:
      • Fixed wait timeouts in Client and Cloud runners to mitigate difference in test results in multiple runs
      • Fixed REST API for running test suites to mitigate test execution errors when testId is passed
      • Fixed Non-admin user access to ATF test generator table with 2.7.3 ATF Cloud Runner store app
    Version 2.7.3 - May 2025
    Customers can now see the number of Cloud Runner Lanes they are entitled to displayed on the ATF Test Generator page.
    Version 2.6.1 - February 2025
    • Fixed:
      • Customers with alt sys_id for admin can set cloud runner
      • Improved network error handling, helping with test execution
    Version 2.5.4 - November 2024
    Starting with the 2.5 release, with the same single click test generation experience, generated tests will automatically include test steps for flows for forms.
    Version 2.4.6 - August 2024
    Flow Generation: Starting 2.4.6 release, with the same single click test generation experience, Service Catalog generated tests will automatically include test steps that drive the associated Flow to completion.
    Version 2.3.8 - May 2024
    • Application is now available for customers in the Australia SPP restricted environment
    • General performance and stability improvements
    Version 2.2.7 - April 2024
    • Fixed:
      • PRB1740597: Intermittent timeouts causing failures in 2.1+
      • PRB1746799: Broken ACL has wrong Script Include name and is missing roles
    Version 2.2.5 - February 2024
    • New:
      • Ability to save generated tests in a specific Scope
      • Ability to automatically save generated tests under the scope their table or catalog item belong to
      • Server-side JavaScript API and REST API to perform common Test Generator and Cloud Runner operations including:
        • Starting a test
        • Canceling a test
        • Querying test status
        • Starting test generation
        • Canceling test generation
        • Set Cloud User
        • and more
    • Fixed:
      • Generation errors when attempting to generate Service Catalog tests that lack permission
      • Other general stability and performance improvements
    Version 2.1.11 - November 2023
    • New:
      • Generation Presets
        • Allows customers to create new and more advanced generation options and save them for reusability
    • Changed:
      • Advanced test generation options
        • Users can now leverage Condition Builder to create complex generation options for Users (including Groups and Roles using Related List condition), Tables, and Service Catalog items
    • Fixed:
      • PRB1698533: ATF Test Generator and Cloud Runner: Update sets are not always set to "Completed" state
      • Other miscellaneous stability fixes
    Version 2.0.4 - August 2023
    • Changed: Expanded Test Generator support for Service Catalog:
      • Service Catalog Item test generation
      • Service Catalog Record Producer test generation
    • Fixed:
      • Improved Browser Orchestration Queue table progress bar accuracy
      • Fixed Tests with custom events failing in Cloud Runner
      • Fixed Cloud Runner tests timing out due to Max Waiters Reached error
      • Other miscellaneous stability improvements
    Version 1.2.6 - May 2023
    • Faster generation times
    • Ability to generate tests by Scope
    • Increased job progress visibility in the Browser Orchestration Queue table in the form of Journal Entries
    • Various stability fixes
    Version 1.1.1 - February 2023
    • Fixed:
      • Inactive and Locked users are not filtered from cloud users list
      • Harmless console error for sandbox attribute "allow-downloads-without-user-activation" - not a valid attribute in Chrome anymore
      • When navigating to a page, getting a non-200 error causes the browser to become stuck.
      • Wrong message shown when login is rejected and browser is redirected
    Version 1.0.7 - November 2022
    • New:
      • You have the ability to automatically generate tests for an instance with the click of a button.
      • You have the ability to run all test in ATF on the cloud runner that is hosted in ServiceNow infrastructure.
      • Customers can run up to two tests in parallel for free on the cloud runner.