Let's connect together
Join us to make our over 890K member community even better. Create your free account and make the world work better for everyone.
Join the CommunityJoin us for our new series of live sessions focused on core, foundational platform topics like Automated Test Framework (ATF), Instance Scan, Upgrade Center, Source Control and CICD, etc.
This week's session will be a deep dive on ATF best and good practices.
This academy happens every other week Thursday (9am PDT, 6pm CEST), starting on July 8, 2021. We'll have product experts on hand to demonstrate concepts, best/good practices, provide guidance, and answer your questions in a live setting.
Here are some of the questions and answers from the session:
Question | Answer |
Is it a best practice to verify form fields, look up values example an incident form fields and its drop down values/look up values through ATF? | I think it would depend on which things are being validated and why. Focus on validating the experiences and processes that are most complicated or subject to likely issues. As an example should I validate that impact field drop down values - not sure that is valuable test to run. |
By any chance, can we parameterize custom UI steps? | Parameterized tests should be compatible with all kinds of test steps. |
Sometimes during scheduled run I observe that if run is not completed (due to closure of client runner unusually) the tests are stuck in pending state and we cannot really cancel it. Any suggestions o | You can cancel pending test suites with these instructions. |
I would like to know the best practice for schedule runs. Schedule runs on daily basis will have any impact on performance of the instance? | Scheduled testing in your subproduction instances should not negatively impact the performance of the subproduction instance as there is less contention for resources for the subproduction instances. |
how would you recommend to group the tests in suites? based on process, module, application? | I would recommend to have a hierarchy of test suites... top level application, 2nd level process, 3rd level smaller pieces of the process... and such. |
Is it possible to create ATFs for portals, i.e. Resource Workbench; Investment Portal; Time Sheet Portal? | For Service Portal based portals - you can test them via ATF with steps like Open a form (SP), Set Field Values (SP) |
When testing for the upgrade, do you have suggestions on how to do that during upgrade? | Testing for an upgrade should roughly go
|
How do you choose to test on the UI side vs. Server side? | Test the UI side once for the first test case, all subsequent test cases can be covered with server side steps supplying the test data. |
I'm new to the product, so it might be an easy one: can failed tests from ATF automatically create defects in the "Agile Board"? | Can it - Certainly! Does it automatically - nope. But you can build that process easily with a flow in flow designer! |
Have you witnessed any issues with Quebec in scheduled runs.. we have seen our Suites getting cancelled mid way a couple of times. | If you think you are having an issue with Quebec ATF - please open a support ticket at support.servicenow.com |
Is there any plan to integrate Test management 2.0 with ATF test results? | I don’t think there is any plans at this time for providing that from ServiceNow, BUT you can certainly tie those together today. |
It would be nice to select a subset of steps to copy, in the case you need to generate sets of test data within your test, insert and stay can assist with one step within the same test for now. | Creating a test template or custom test step to create and generate data or setup for common type tests. |
Join us to make our over 890K member community even better. Create your free account and make the world work better for everyone.
Join the Community