Complementing ATF with Agentic AI: Automating UI-Layer Testing for ServiceNow Upgrades

[lunaw]

Hi Community,

I’ve been exploring ways to optimize the ServiceNow upgrade cycle, specifically focusing on the gaps where the native Automated Test Framework (ATF) sometimes requires manual intervention like complex Service Portal widgets and custom UI Builder pages.

I am currently working on a framework called TestMax  that focuses on agentic AI-powered test automation. The goal is to generate test cases from requirements automatically, allowing us to map Jira user stories directly to executable Playwright scripts that handle ServiceNow's Shadow DOM and dynamic rendering.

Key areas I'm looking to discuss:
1. Shadow DOM Handling: How are you managing external automation tools with ServiceNow’s unique DOM structure?
2. Beyond Regression: To what extent can we trust AI to perform functional testing on *new* features during an upgrade, rather than just regression?
3. Integration: Strategies for syncing Mammoth-AI technical audits with ServiceNow's skipped record analysis.

In my experience, AI is transforming software testing not by replacing ATF, but by filling the UI-layer gaps that make upgrades "flaky."

I’d love to hear from anyone who has successfully integrated external AI automation testing tools alongside ATF for a more robust CI/CD pipeline.

Keywords: #ServiceNow #ATF #TestAutomation #TestMax #AIinQA #ServicePortal

[Tanushree Maiti]

Hi @lunaw 

You can refer this : AI-Powered ATF Testing: How Now Assist for Test Creation Saves Developers Time

                                     https://www.youtube.com/watch?v=6rBK3YZvaZk

[VaranAwesomenow]

Above video talks abt ATF creation but it doesnt mention specifically about playwright which offers extended capabilities to cover UI testing which are not easily achievable via ATF, also using agentic ATF consumes assists from ServiceNow while creating playwright can be done by any build agent so in my PoV depending on your organization's build agent availability it can be achieved with lesser [assists / coins] compared to now assist for creator [agentic ATF]