What are the advantages and disadvantages of using ATF?

[ayano]

What are the advantages and disadvantages of using ATF?

I would like to know how to use ATF effectively.

[Gunjan Kiratkar · Accepted solution]

ServiceNow Automation testing will make your life easier

One of the most promising new features of the ServiceNow Istanbul release, is the Automated Testing Framework (ATF).

Roles:

• atf_test_designer: Can design and publish test. Could be developers or technical business analysts.
• atf_test_admin: Can create test items to for test designers. This is for hardcore developers specialized in automated testing.

     Advantages of ATF

• Custom test frameworks are very expensive to implement.
• Most customers only do manual testing.
•  ATF allows you to accelerate applications into production due to reduced test time.

• we can test forms by creating tests that mimic user actions with no scripting, like opening a form, setting and validating field values, or submitting a form. ATF can also take input variables and return output variables that you define when we set up custom steps.

• The framework provides batch, hierarchical and nested suites testing, and allows for fully automated tracking of all testing, which removes test data and eliminates the need to roll back changes.

• This may be just the amount of functionality that we need if we are looking to automate testing for version updates of ServiceNow or other small scale projects.

ATF Drawbacks:

ATF executes tests in a local browser. However, if we’re looking to do more advanced testing then an external solution is strongly recommended. This is because a testing solution that executes tests externally can validate the system independent of the system itself.

Another major drawback with ATF is that it’s primarily designed to test forms, so if you’re looking to test other modules such as notifications or your Service Portal, you’ll need a more advanced solution.

The Automated Test Framework also requires some level of attention while the tests are being run. This is not a major drawback, but may take some users by surprise. Instead of running a suite of tests in succession, it may require we to manually run the next test once the current test has completed.

-Can it be used to automate ServiceNow Portal as well ?

• -ATF is currently designed to test items in the standard lists and forms. Capabilities for testing Service Portal functionality does not yet exist.
• As of Jakarta, Service Portal pages are currently not supported by ATF.
• Currently the ATF module only supports the following client side elements: Forms, ServiceCatalog (new in Jakarta).

I'm quite sure ServiceNow is working to add Service Portal support to the ATF framework. Keep your eyes open for Kingston or London.

please go through below attachments:

https://www.cernasolutions.com/atf-is-here-now-what/

https://community.servicenow.com/community?id=community_blog&sys_id=942de2e5dbd0dbc01dcaf3231f961987

https://community.servicenow.com/community?id=community_blog&sys_id=00ecaa65dbd0dbc01dcaf3231f961970

Thanks & Regards

Gunjan

[Gunjan Kiratkar]

Hi @ayano ,

If I answer your question then please mark it as correct and helpful.

Thanks.

[Ankur Bawiskar]

@ayano 

There are some limitations for ATF.

Not everything can be tested using ATF.

Please find below links for more details

Automated Test Framework FAQs: How do I ATF?

When and how should I use Automated Test Framework (ATF)?

Disadvantages/Limitations:

1) ATF cannot use attachment validation for catalog item or record producer

2) ATF cannot effectively test Outbound REST which are aysnchronuos

3) There might be some more unless you come across

Regards
Ankur

[Ankur Bawiskar]

@ayano 

Did you get a chance to check on the comments provided for your questions?

Regards
Ankur