ATF suite is failing in cloud runner

[nataliya_b]

Hello

We have the suite, that consists of 31 tests. Some of those tests use parameters and test run data sets (up to 5).

This suite constantly fails when run via the schedule in cloud runner. Every cloud run fails for the different test.  Re-run of failed tests is successful too. The same suite runs successfully in the test runner.

We tried different ways to address it, the suite is still failing in cloud runner.

Has anyone had this kind of issue? How did you resolve it?

If we need to take a look at the cloud runner - what would be points to check?

Please let me know.

thank you.

[Shaqeel]

Hi @nataliya_b 

Cloud Runner executes test asynchronously, sometimes faster than UI test runner.

If your test depends on record timing, background jobs, or UI updates it may pass locally. You can try wait steps.

Try running the suite with only 1 test run data set and slowly add more. The more dependency on data, it may fail.

Avoid referencing shared records directly if test ordering is not enforced.

Two tests may conflict if they rely on the same data.

Regards

Shql

[nataliya_b]

Thank you very much for your help!