Can ATF automate prompts to Now Assist?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Sunday
I’m exploring ways to test Now Assist efficiently. Currently, giving prompts is a manual process.
I’m wondering:
Can ATF be used to automatically send prompts to Now Assist?
Is it possible to record the responses for verification?
Are there any best practices or limitations when trying this approach?
Any guidance or examples would be greatly appreciated!
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yesterday
Hi @Prapul Jain ,
Yes, you can efficiently test Now Assist using the Automated Test Framework (ATF) with some important capabilities and recommended practices.
Can ATF send prompts to Now Assist automatically?
Yes. ServiceNow offers "Now Assist for Test Creation", an AI-powered feature that allows you to generate automated ATF test cases by simply giving natural language instructions (prompts). This reduces the manual effort of defining every test step and helps automate Now Assist testing workflows.
Can ATF record and verify Now Assist responses?
Partially. ATF can run tests generated by Now Assist and verify expected UI changes, form field values, or system states resulting from AI-driven interactions.
For textual AI responses, a common approach is to capture the response display on the page (e.g., in a Virtual Agent chat widget) using ATF assertions and validate them against expected text or patterns.
You may need to create custom test steps or leverage scripts to parse and compare AI-generated content for verification.
Best Practices and Limitations
Prompt clarity is crucial. The quality and specificity of your prompts directly affect the test generation and AI output accuracy. Be explicit with expected actions or results.
Test small units or flows first before building complex end-to-end AI interaction tests.
Use AI-generated ATF tests as a baseline; tweak or extend them manually as needed for finer control.
Remember that AI responses can vary, so verification steps should accommodate expected variations (regex, type matching).
Some tests may need to tolerate timing delays due to asynchronous nature of AI processing.