Need details about ATF challenges and things to watch for

Ravish Shetty · ‎10-04-2022

hi all,

We are setting up some ATF test cases and we are looking for answers to some challenges we got and also for best practices with using the module

Any best practices when it comes to ATF other than to create parameterized tests?
Can we create modular test cases?
Any gotchas when it comes to implementing ATF?
Challenge: the Microsoft Edge browser I use crashes when we have long-running test cases. we did not try to in Chrome. Has anybody able to fix this issue?
Do developers run the ATF cases in a Virtual machine?
has anybody got an instruction video to do a headless browser setup in Windows or Linux?

Ravish

Geoff Dench · ‎10-06-2022

Any best practices when it comes to ATF other than to create parameterized tests?
Capture EVERYTHING in Update Sets!
Use "Execution Order" in your Test Suites as it will make trawling through the suite results easier
Create suites of Negative tests and Positive tests and keep them separate. Use the convention in the naming of the tests. Number tests using "i" for tests using impersonations also helps.
Don't use the SN recommended method of Impersonation by creating userids on-the-fly, instead create test personas based upon real people. They can be used in Production but you will be able to make them Inactive so they won't be visible.
Leverage the Quick Start tests and suites.
Execute "incognito" in multiple sessions if desired. You can then fix tests whilst the suites are executing
Can we create modular test cases?
Absolutely
Any gotchas when it comes to implementing ATF?
Refer to previous responses. Attachments still don't work and issue around the slush bucket/list collector which requires a workaround.
Beware of using the additional set-up data from the plugins as it can produce undesirable results
Challenge: the Microsoft Edge browser I use crashes when we have long-running test cases. we did not try to in Chrome. Has anybody able to fix this issue?
I'm getting this all the time in all browsers. Went away for 2 weeks but has come back with a vengeance this week. Very frustrating when the Regression test pack is executed daily and contains well in excess of 200 test cases.
Do developers run the ATF cases in a Virtual machine?
Not currently but it is on our roadmap to set up a Linux vm.
has anybody got an instruction video to do a headless browser setup in Windows or Linux?
As above

View solution in original post

Ravish Shetty · ‎10-06-2022

Thank you, Geoff. Could you attach any articles for modular testing? Right now, we have like 10 common test steps in a couple of test cases and would like to keep them defined in one modular test case if possible

Geoff Dench · ‎10-13-2022

Hi Ravish

I'm not sure what you are trying to achieve through "modular test cases" but if I assume right you mean reusability of test artefacts? I'm a lazy tester in that I do not create everything from a blank screen unless I absolutely have to so I do a lot of test copying and re-work from there. Having said that every test will be subtly different from anything else I have otherwise it will be somewhat pointless and ultimately redundant.

Jochen Geist · ‎10-06-2022

@Ravish Shetty wrote:
has anybody got an instruction video to do a headless browser setup in Windows or Linux?

I would recommend this one: https://www.youtube.com/watch?v=HatVLw1o1hc

There are also more best practices in the Customer Success Center: https://www.servicenow.com/search-result.html?q=ATF&p=1&filter=sndc

E.g. these two:

https://www.servicenow.com/content/dam/servicenow-assets/public/en-us/doc-type/success/quick-answer/...

Ravish Shetty · ‎10-06-2022

thank you

Geoff Dench · ‎10-06-2022

Hi Ravish

I did find this ServiceNow video on YouTube for headless browser setup which was really good - https://www.youtube.com/watch?v=3e6bfXxBR84