Need your inputs re: Automated Test Framework

[marilynfrancisc]

Anyone here who has implemented the Automated Test Framework in their instances? Is there any licensing cost?

Your inputs and feedback are much appreciated.

[kimreverman]

Would you be willing to share your ATF tests and suites?

Kim Reverman

Texas A&M

[Terri Kouba]

Hi Kim,

Many of our ATFs are for our custom tables and fields, but my co-worker Bob created an update set with some ATFs for out-of-box tables.  You can find the update set at: https://drive.google.com/file/d/1iPGMdDpxw0rYoP9ItPZhj-3wYO5H7ZbM/  As always, review the update set before you load it on your instance and only load update sets from trusted sources.

We usually create 2 ATFs for each table:  field level validation and business rules.  The business rules ATFs are specific to Cal, so we haven't included these.

Additionally,  on London there are some canned out-of-box Tests.  If you're not on London yet, you can spin up a personal dev instance on developer.servicenow.com and load these plugins (search for plugin name that begins with Automated).  They have some nice generic Service Request form tests you can see as an example.

If you have any questions, please don't hesitate to ask.

Thanks,

Terri

[charliesdev]

Thank you for sharing this.  Unfortunately the test won't run as is,  ReferenceError: "atfHelper" is not defined

But it does provide some insight on how test steps are configured.

I edited that first test step and now it runs the first 4 steps, maybe I'll post updates as I make progress.  Here is the new script for the first Test Step:

// get a random user with 1 and only 1 write permissions, ie no other permissions besides the 1 write
(function(outputs, steps, stepResult, assertEqual) {
	// add test script here
	/*
	var atf = new atfHelper('User') ;
	var u = atf.get1WriteUser() ;  // I really want someone who doesn't have Admin or ist_power_roles, but that functionality isn't there right now, so I'll take a chance that I really get a customer and not also an admin
 	*/
	try{
		var editorUsers = getEditorUsers();
		var userArray = editorUsers.split(',');
		var u = userArray[0];
		if (u) {
			//gs.print('found 1 write user ' + u.getDisplayValue()) ;
			outputs.record_id = u ;
			outputs.table = 'sys_user' ;
			return true ;
		}
		stepResult.setOutputMessage("could not find any editor users") ;
		return false ;
	}
	catch(ex){
		stepResult.setOutputMessage("Exception in test : " + ex.message);
		return false ;
	}
})(outputs, steps, stepResult, assertEqual) ;

[Julio Valdez]

Hi Marylin, 

At UC Santa Barbara, we have used ATF to help us with testing our catalog and scripting associated with Incidents, Requests, and Problems. It's very useful when it comes to testing our system during our upgrade/patch schedules. 

We only have 2 tests consolidated into 1 test suite, but are looking to expand that number. We are also looking to expand into testing portal and other custom applications we have built. 

[marilynfrancisc]

Additional inquiry related to ATF - Anyone here who knows whether it can be used for testing applications outside ServiceNow?