Test Management close-out
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎05-22-2017 02:01 AM
Hi All,
Posting here as Test Management (TM) comes under the project-portfolio with financials plugin.
We're investigating the TM plugin to support our UAT processes but while most of it makes sense there seem to be some missing functionality.
TM doesn't appear to ever close the tasks that it creates. Test Cases in a plan (TMTTs) are always in the Pending state, even when the respective tests have been completed. We wouldn't want a load of Active tasks hanging around the system forever - that's going to mess with our ability to report at a task level.
There are form actions for starting ("notify") and cancelling test plans but nothing to finish a test plan. The active field is exposed on the form but changing that doesn't cascade to child test cases - plus we would want to know whether a plan closed successfully or not. Test cases themselves have a bespoke state but that isn't linked to the task state.
Why a function for duplicating test suites and tests but not test cases?
The only link I could find between TM and other modules is in the task board for projects you can add a "Test Phase" that can be linked to a test plan. This misses some obvious points to link TM into: change management (testing evidence), the CMDB for test environments.
It feels like TM is an incomplete development - even though it hasn't changed in many major versions.
I'm about to start trying to make TM "work for us" but I wondered what other peoples experience is? Am I missing something?
- Labels:
-
Project Portfolio Management
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎05-24-2017 10:16 AM
Hi Tim
The root cause of the issue is we are not using state column of task table, and using a new column called execution_status. So to circumvent the problem you are raising, we can have a custom BR on tm_test_case_instance table and when test is marked as "Passed" you make it active=false.
Similarly as you mentioned when tm_test_plan is turned active=false, you will have to write a custom BR to make the tm_test_case_instance inactive.
When you duplicate a Test suite, all underlying test cases also gets duplicated. Is it not working that way for you. You can also pick a test case from Test suite and add it to a Test plan.
Regarding integrations, yes currently we have only integration only with Project management.
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎06-05-2017 01:49 AM
Hi Arun,
Thanks for your feedback.
It would be useful to know whether ServiceNow are going to maintain this application going forward. As we've identified it doesn't build on the task state model so is never going to work nicely amongst other work streams. I wouldn't expect to need to customise an application for it work consistently with other parts of ServiceNow?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎06-02-2017 01:52 PM
Tim,
We are glad you took advantage of the ServiceNow Community to learn more and to get your questions answered. The Customer Experience Team is working hard to ensure that the Community experience is most optimal for our customers.
If you feel that your question was answered, we would greatly appreciate if you could mark the appropriate thread as "Correct Answer". This allows other customers to learn from your thread and improves the ServiceNow Community experience.
If you are viewing this from the Community inbox you will not see the correct answer button. If so, please review How to Mark Answers Correct From Inbox View.
Thanks,
Shivani Patel
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎06-29-2017 02:29 AM
For the benefit of anyone picking up Test Management, I encountered a few bugs (/odd implementation). For anyone else customising TM this may save you some time.
State Management
- Added business rules to propagate the Test Case execution status onto task.state but found that when signing-off a test plan the test cases disappeared from the initial form (number of passed/failed etc.)
- Even though TM doesn't use Active/State it has a filter for Active. I worked around this in tm_SignOffAjaxProcessor to remove the Active filter:
countByTestStatus: function() {
// build new response xml element for result
var result = this.newItem("result");
var sysparm_testPlan = this.getParameter('sysparm_testPlan');
var testPlan = tm_TestManagement.getDecoratedGlideRecord(sysparm_testPlan, tm_TestManagement.TEST_PLAN);
var count = testPlan.countByTestStatus();
// FIXME
// OOB only shows Active test cases, even though this module never changes the active value
count = new GlideAggregate(count.getTableName());
count.addAggregate('COUNT', tm_TestManagement.EXECUTION_STATUS);
count.addQuery('tm_test_plan', testPlan.gr.getValue(tm_TestManagement.SYS_ID));
count.query();
// END OF FIX
while (count.next()) {
result.setAttribute(count.execution_status, count.getAggregate('COUNT', tm_TestManagement.EXECUTION_STATUS));
}
},
Platform URL
- This will break if you put in any http: or https: prefix (fix is coming in Jakarta?)
- In tm_TestPlanDecorator:
if ( ! url.match(/^http/) ) {
Testing End Date
- When you Notify tester, the due date given to the tester depends on the start_date of the Test Case, so will be wrong most of the time
- In tm_StartExecutionProcessor:
//var _duration = gs.dateDiff(testPlan.getValue('start_date'), _testingEndDate,false);
var _duration = gs.dateDiff(gs.now(), _testingEndDate,false);
Our Testing and QA team determined that ServiceNow's Test Management isn't good enough for their needs, although we don't have another product in use (I don't count Excel ...). We're also experimenting with SDLC ("Agile Development"), although the Test tasks in that application are very limited. I can see the benefit of an integrated tool with other IT processes, however OOTB Test Management is neither a comprehensive testing tool nor does it integrate into other processes. This makes it difficult to win the internal argument to "go ServiceNow" for test management.