Motivation: there exist tests which, due to brittleness, environment instability or cosmic rays, fail 1 in N times and pass (N-1) in N times. It is not economical to make the test 100% reliable.
Desired is a means to specify a test step may be rerun some specified # of times upon fail before reaching a final FAIL state. This should be in the testconfig file
Possible extension of testconfig [ezsteps] format :
[ezsteps]
getoalibs getoalibs.sh
oabuild[retry 3] oabuild.csh
cleanup cleanup.sh
In this example, the suffix on step "oabuild" is "retry 3" meaning an unsuccessful completion of any given iteration of this test will be retried 3 times until either success criteria are met or we have 3 unsuccessful runs in a row.
The sample syntax above is not a hard requirement, it is just there to illustrate the desired level of control.
|