ATF Test Generator and Cloud Runner

[kulkarnivivekn]

ATF Test Generator and Cloud Runner ServiceNow Store - ATF Test Generator and Cloud Runner
Description:   Enhancement of the Automated Test Framework to include test generation and cloud-based execution capabilities. The ATF Test Generator facilitates the creation of tests based on instance behavior and workflows, streamlining the testing process and reducing manual effort. Additionally, it allows test to be executed in the cloud. 

Requirements: 

We need to install this in Sandbox and answer the below questions. 

• What are the benefits of enabling this tool?
• The notes mentioned a rolling restart of nodes, find out what this impact looks like to us (impact to the instance, users, and any mitigation strategies)
• Review configuration and demonstrate this in the Sandbox
• Is this a paid for solution?
• For how many users its free ?

[Brian Lancaster]

When It comes to cost you should always reach out to your account rep. However I believe that is no cost to ATF Test Generator and Cloud Runner. One of the main benefits is that it run the test in the cloud so you don't have to worry about tests failing because you screen locked or you went to a different tab on the browser.

Also one thing to not when using the test generator. Make sure you tell it what table you want to generate test on otherwise it might try to generate test on all tables at once.

[kulkarnivivekn]

Thanks for the response . Can  i have details documents on below points please 

• What are the benefits of enabling this tool?
• The notes mentioned a rolling restart of nodes, find out what this impact looks like to us (impact to the instance, users, and any mitigation strategies)

[Brian Lancaster]

This is the documentation for ATF Test Generator and Cloud Runner. I did not see anything specific to rolling restart of nodes.

[SasiChanthati]

1. What are the benefits of enabling

ATF Test Generator + Cloud Execution enhancement brings two major improvements.

a. ATF Test Generator: Auto-generates tests based on actual instance behavior (e.g., form interactions, workflows). Reduces manual test creation time significantly. Ensures test coverage is aligned with real user activity or recent changes. Helps keep your test suite current and relevant to the actual workflows.

b. Cloud-Based Test Execution: Offloads test execution to ServiceNow’s cloud infrastructure, freeing up your own instance resources. Enables parallel test execution, speeding up test cycles. Supports larger and faster regression testing, especially useful in big upgrade windows or deployments.

2. What is the impact of the rolling restart of nodes?

Rolling restarts are a way to update or reconfigure nodes in your ServiceNow environment without full downtime.
there are a few things to consider:

What happens: Each node in your instance (application server) is restarted one at a time. The load balancer routes traffic to active nodes, avoiding the one being restarted. 

Impact to instance and users: Typically minimal for end users. You may experience short session interruptions, especially for long-running background processes or mid-interactions. ATF jobs or scheduled jobs could fail if they land on a restarting node.

Mitigation strategies: Schedule the install during low-usage windows. Inform users of potential minor disruptions. Pause or delay running batch jobs or tests during the process. If possible, use maintenance windows for the install.

3. Review configuration and demonstrate in the Sandbox. Once installed in the Sandbox, here's what you should do to test and demonstrate. Navigate to Automated Test Framework > Test Generator. Choose a table or workflow you want to test. Use the generator to create a test suite and inspect the generated test steps. Run the tests using cloud execution(ensure the setting is enabled). Monitor results in the Test Runs section, comparing performance vs. local runs.

4. Is this a paid-for solution? As of recent releases (e.g., Washington), this enhancement is available to most ServiceNow customers with core ATF functionality but cloud execution may require a subscription, depending on:

Your licensing tier (Enterprise vs. Pro or Advanced). Whether you have a Now Platform App Engine license or DevOps integration. You'll need to check with your ServiceNow account representative to confirm if cloud test execution is part of your entitlement or an add-on.

5. For how many users is it free? There isn’t a per-user limit for the ATF Generator itself, it's about instance usage rather than named users. But cloud execution may come with limits based on your ServiceNow subscription, some accounts may be allowed a certain number of cloud test runs per month. Others may require add-on licensing for extended or large-scale use. Again, your ServiceNow account rep or licensing agreement will have the definitive answer.