hard20 pts · first answer countsflaky-testsci-cd

Passed on retry

CI is set to retry failed tests twice. A checkout test fails about 1 run in 15 but always passes on retry, so the pipeline is green. What should a senior QA do?

A.Nothing, because the pipeline is greenB.Raise retries to five to be safeC.Delete the test because it is unreliableD.Treat "passed on retry" as a signal: track flaky rates, investigate with traces, and check whether the product itself has an intermittent bug such as a race condition

Discussion 0

Join free to post in the discussion.

Passed on retry

Discussion 0

Related questions