Megatest

History Of Ticket 4b072de97c2b80e392d5e7e182fdf6d2f1d8a1dc
Login

Artifacts Associated With Ticket 4b072de97c2b80e392d5e7e182fdf6d2f1d8a1dc

  1. Ticket change [a8098329b6] (rid 9577) by bjbarcla on 2015-10-05 17:19:39:

    1. foundin initialized to: "1.6024"
    2. icomment:
      Motivation: there exist tests which, due to brittleness, environment instability or cosmic rays, fail 1 in N times and pass (N-1) in N times.  It is not economical to make the test 100% reliable.
      
      Desired is a means to specify a test step may be rerun some specified # of times upon fail before reaching a final FAIL state.  This should be in the testconfig file
      
      Possible extension of testconfig [ezsteps] format  :
      
      [ezsteps]
      getoalibs getoalibs.sh
      oabuild[retry 3]   oabuild.csh
      cleanup   cleanup.sh
      
      In this example, the suffix on step "oabuild" is "retry 3" meaning an unsuccessful completion of any given iteration of this test will be retried 3 times until either success criteria are met or we have 3 unsuccessful runs in a row.
      
      The sample syntax above is not a hard requirement, it is just there to illustrate the desired level of control.
      
    3. login: "bjbarcla"
    4. mimetype: "text/x-fossil-plain"
    5. private_contact initialized to: "463e166cbd557fda643f629dd4886619ce461689"
    6. severity initialized to: "Important"
    7. status initialized to: "Open"
    8. title initialized to:
      provide means to specify desire to rerun a test/step N times on fail
      
    9. type initialized to: "Feature_Request"