ATF - Tests are failing in Cloud Runner but not in local client runner

Shan C
Mega Guru

‎01-09-2024 10:52 AM

Hello all,

 

Anyone faced similar issue? Appreciate any help.

When I run a test locally using test runner, it works perfectly fine. The same test fails when I run in cloud runner and I can see the screen form factor is different in the fail screenshot. I couldn't even troubleshoot the issue as the screenshot didn't cover the entire page though I have enabled that option.

0 Helpfuls
  • 1,215 Views
6 REPLIES 6

Masoom_Patthan
Tera Contributor

‎01-09-2024 11:23 AM

Hi Shan,

I hope you're doing well. I've encountered a similar issue in the past, and addressing it can be a bit tricky, but I'm here to help!

When facing discrepancies between local and cloud test runs, especially regarding screen form factor and incomplete screenshots, there are a few things you might want to consider:

  1. Viewport Configuration: Ensure that the viewport configurations for your local and cloud runners are consistent. Differences in screen resolutions might lead to unexpected behavior.

  2. Delay Settings: Sometimes, the cloud runner might need additional time to render the page compared to the local runner. Adjusting delay settings before taking screenshots could potentially resolve the issue.

  3. Synchronization: If your application involves asynchronous processes, ensure that your tests include proper synchronization mechanisms. Delays or waits might be necessary to allow elements to load completely in the cloud environment.

  4. Logging Additional Information: Consider logging additional information in your test script, especially around the failing point. This might help you gain insights into what's causing the discrepancy.

To better understand the issue, could you share more details about the environment configurations, such as the versions of your local and cloud runners, and any specific settings you've applied?

Additionally, for a more accurate assessment, I recommend attaching the screenshots you mentioned. This will provide the community with a visual context and facilitate more targeted assistance.

Looking forward to helping you resolve this issue!

Regards
Masoom Khan

Bhaskar Mantri
Tera Contributor
In response to Masoom_Patthan

‎12-02-2024 10:46 PM

Thanks for the information. In my test suit I have 4 Tests and I want to run the synchronously. is there any way to achieve that. Implementation order is not working in cloud runner

0 Helpfuls

Dave65
Tera Contributor
In response to Masoom_Patthan

‎05-05-2025 08:07 AM

Hi Masoom
How do I Configure the Viewport? I am not able to find any documentation on that in ServiceNow.

0 Helpfuls

Shan C
Mega Guru

‎01-12-2024 04:32 AM

@Masoom_Patthan Thanks for the details.

 

I have all these things as expected, and seems the issue is different one. I will post if I found out the actual root cause. Seems, the issue is from ServiceNow cloud runner side.

0 Helpfuls