Streamlining Regression Testing during ServiceNow Upgrades with AI-Driven Automation

lunaw
Tera Contributor

9 hours ago

Hi Team,

I have a question regarding regression testing during ServiceNow upgrades. We often face bottlenecks when a new patch is released, as manual updates to test scripts are time consuming.

I am researching how AI powered test automation can help in this area. Specifically, I am looking at a framework called TestMax that focuses on automated test case generation. The idea is to use AI to detect UI changes automatically during the upgrade phase.

Has anyone here used external AI automation testing tools to speed up UAT during a ServiceNow patch or upgrade? I would appreciate any advice or best practices you can share.

Regards,
Waqar

Preview file
1153 KB
0 Helpfuls
  • 98 Views
1 REPLY 1

Naveen20
ServiceNow Employee

7 hours ago

 

On AI-powered test automation for upgrades:

The core idea of using AI to auto-generate test cases from requirements and detect UI changes post-upgrade is sound. Tools like TestMax (shown in your screenshot) aim to solve this by ingesting user stories, generating test scripts (Playwright, Selenium, Python), and integrating with Jira/Azure DevOps for requirements traceability.

Practical advice from upgrade experience:

  1. Start with your critical path flows — Don't try to automate everything. Focus on your most-used ITSM/CSM/HRSD flows (incident creation, change approvals, catalog items) that are most likely to break during upgrades.

  2. ATF first, then supplement — ServiceNow's native Automated Test Framework (ATF) should be your baseline. It's upgrade-aware and handles server-side logic well. External AI tools like TestMax are better suited for UI-layer regression where ATF has gaps (Service Portal widgets, UI Builder pages, custom components).

  3. Skipped record review matters more — In my experience, the biggest upgrade risks come from skipped records and customization conflicts, not just UI changes. Make sure your upgrade plan includes skipped record analysis alongside test automation.

  4. Upgrade Preview Instance — Always leverage the upgrade preview instance to run your automated suite before committing the upgrade to production-like environments.

On external tools specifically:

If you go the external route, look for tools that can handle ServiceNow's shadow DOM and dynamic form rendering — many generic UI testing tools struggle with this. Also make sure the tool can authenticate properly through ServiceNow's login flow and handle session management.

0 Helpfuls