Manual and Automated testing

J_31
Kilo Sage

We wanted to implement ATF for regression testing - currently  the test cases are in word document. 

 

To move to ATF 
1. We want to create all test and sets in  test management 2.0 once implemented - we will move to ATF. 

 

is that the correct method or should we directly implement ATF?

1 ACCEPTED SOLUTION

Ratnakar7
Mega Sage
Mega Sage

Hi @J_31 ,

 

The approach you mentioned, starting with creating test cases and sets in Test Management 2.0 before moving to ATF (Automated Test Framework), can be a good way to transition from manual testing to automated testing. Here's a suggested workflow:

  1. Document your existing test cases: As a starting point, it's helpful to have your test cases documented in a Word document. This will serve as a reference for creating tests in Test Management 2.0 and later in ATF.

  2. Set up Test Management 2.0: Implement Test Management 2.0 in your ServiceNow instance and create test plans, test suites, and test cases based on your existing documentation. This will help you organize and manage your tests effectively.

  3. Execute manual regression testing: Initially, you can execute your regression tests manually using the test cases in Test Management 2.0. This allows you to ensure that your existing test cases are accurate and complete.

  4. Identify automation candidates: While performing manual regression testing, identify test cases that are suitable for automation. Consider the complexity, frequency of execution, and potential for automation benefits when selecting which test cases to automate.

  5. Implement ATF for automation: Once you have identified the test cases suitable for automation, you can start implementing them in ATF. This involves creating automated test steps, configuring test data, and setting up assertions to validate the expected outcomes.

  6. Execute automated regression testing: Gradually transition from manual testing to automated testing using ATF. Run the automated tests regularly as part of your regression testing to save time and effort.

Remember to continuously update and refine your test cases and automation as your application evolves and new features are added. Regularly review and update your tests to keep them in sync with your application changes and maintain the effectiveness of your regression testing efforts.

 

Thanks,

Ratnakar

View solution in original post

4 REPLIES 4

Ratnakar7
Mega Sage
Mega Sage

Hi @J_31 ,

 

The approach you mentioned, starting with creating test cases and sets in Test Management 2.0 before moving to ATF (Automated Test Framework), can be a good way to transition from manual testing to automated testing. Here's a suggested workflow:

  1. Document your existing test cases: As a starting point, it's helpful to have your test cases documented in a Word document. This will serve as a reference for creating tests in Test Management 2.0 and later in ATF.

  2. Set up Test Management 2.0: Implement Test Management 2.0 in your ServiceNow instance and create test plans, test suites, and test cases based on your existing documentation. This will help you organize and manage your tests effectively.

  3. Execute manual regression testing: Initially, you can execute your regression tests manually using the test cases in Test Management 2.0. This allows you to ensure that your existing test cases are accurate and complete.

  4. Identify automation candidates: While performing manual regression testing, identify test cases that are suitable for automation. Consider the complexity, frequency of execution, and potential for automation benefits when selecting which test cases to automate.

  5. Implement ATF for automation: Once you have identified the test cases suitable for automation, you can start implementing them in ATF. This involves creating automated test steps, configuring test data, and setting up assertions to validate the expected outcomes.

  6. Execute automated regression testing: Gradually transition from manual testing to automated testing using ATF. Run the automated tests regularly as part of your regression testing to save time and effort.

Remember to continuously update and refine your test cases and automation as your application evolves and new features are added. Regularly review and update your tests to keep them in sync with your application changes and maintain the effectiveness of your regression testing efforts.

 

Thanks,

Ratnakar

Thank you detailed reply.

 

Do you have any such sample documentation. Its hard to find testing document. 
Also, another question when we have test cases ready, instead of putting effort into updating test management, why cannot we directly do ATF. or what is the recommended approach?

Hi @J_31 ,

 

Regarding sample documentation for testing, it can be challenging to find generic testing documents that fit every organization's specific needs. However, there are some common components that you can include in your testing documentation:

  1. Test Plan: This document outlines the overall testing approach, objectives, scope, and timelines for the testing activities.

  2. Test Strategy: It defines the high-level approach for testing, including the types of testing (e.g., functional, regression, performance), test levels (e.g., unit, integration, system), and test techniques to be employed.

  3. Test Cases: These are detailed step-by-step instructions for executing specific test scenarios. Each test case should include preconditions, steps, expected results, and any necessary test data.

  4. Test Data: It specifies the data required for executing test cases and should cover a range of scenarios to ensure comprehensive testing.

  5. Test Scripts: These are automation scripts or code that automate the execution of test cases. Test scripts are particularly useful for regression testing and repetitive test scenarios.

  6. Test Logs and Defect Reports: These documents capture the test execution results, including any defects or issues encountered during testing.

Regarding your second question, if you already have well-defined and documented test cases, you can certainly leverage them in the ATF (Automated Test Framework) rather than starting from scratch in a separate test management tool. The ATF in ServiceNow allows you to automate the execution of test cases, track test results, and generate reports directly within the platform.

The recommended approach would be to:

  1. Review your existing test cases and identify which ones are suitable for automation.
  2. Create corresponding test scripts in ATF to automate the execution of those test cases.
  3. Execute the automated test cases using ATF and validate the results.
  4. Continuously update and maintain your test scripts in ATF as your application evolves.

By leveraging ATF, you can streamline your testing efforts, improve efficiency, and ensure consistent test execution. It also provides seamless integration with other ServiceNow features, such as incident management for tracking and managing defects encountered during testing.

 

Thanks,

Ratnakar

does ATF needs java script coding or its no code for implementation?