Megatest

Hex Artifact Content
Login

Artifact f4f75e41b31856cd46405a7d0e0d56a2d9b85b5f:


0000: 0a 3b 3b 20 43 6f 70 79 72 69 67 68 74 20 32 30  .;; Copyright 20
0010: 30 36 2d 32 30 31 32 2c 20 4d 61 74 74 68 65 77  06-2012, Matthew
0020: 20 57 65 6c 6c 61 6e 64 2e 0a 3b 3b 20 0a 3b 3b   Welland..;; .;;
0030: 20 54 68 69 73 20 66 69 6c 65 20 69 73 20 70 61   This file is pa
0040: 72 74 20 6f 66 20 4d 65 67 61 74 65 73 74 2e 0a  rt of Megatest..
0050: 3b 3b 20 0a 3b 3b 20 20 20 20 20 4d 65 67 61 74  ;; .;;     Megat
0060: 65 73 74 20 69 73 20 66 72 65 65 20 73 6f 66 74  est is free soft
0070: 77 61 72 65 3a 20 79 6f 75 20 63 61 6e 20 72 65  ware: you can re
0080: 64 69 73 74 72 69 62 75 74 65 20 69 74 20 61 6e  distribute it an
0090: 64 2f 6f 72 20 6d 6f 64 69 66 79 0a 3b 3b 20 20  d/or modify.;;  
00a0: 20 20 20 69 74 20 75 6e 64 65 72 20 74 68 65 20     it under the 
00b0: 74 65 72 6d 73 20 6f 66 20 74 68 65 20 47 4e 55  terms of the GNU
00c0: 20 47 65 6e 65 72 61 6c 20 50 75 62 6c 69 63 20   General Public 
00d0: 4c 69 63 65 6e 73 65 20 61 73 20 70 75 62 6c 69  License as publi
00e0: 73 68 65 64 20 62 79 0a 3b 3b 20 20 20 20 20 74  shed by.;;     t
00f0: 68 65 20 46 72 65 65 20 53 6f 66 74 77 61 72 65  he Free Software
0100: 20 46 6f 75 6e 64 61 74 69 6f 6e 2c 20 65 69 74   Foundation, eit
0110: 68 65 72 20 76 65 72 73 69 6f 6e 20 33 20 6f 66  her version 3 of
0120: 20 74 68 65 20 4c 69 63 65 6e 73 65 2c 20 6f 72   the License, or
0130: 0a 3b 3b 20 20 20 20 20 28 61 74 20 79 6f 75 72  .;;     (at your
0140: 20 6f 70 74 69 6f 6e 29 20 61 6e 79 20 6c 61 74   option) any lat
0150: 65 72 20 76 65 72 73 69 6f 6e 2e 0a 3b 3b 20 0a  er version..;; .
0160: 3b 3b 20 20 20 20 20 4d 65 67 61 74 65 73 74 20  ;;     Megatest 
0170: 69 73 20 64 69 73 74 72 69 62 75 74 65 64 20 69  is distributed i
0180: 6e 20 74 68 65 20 68 6f 70 65 20 74 68 61 74 20  n the hope that 
0190: 69 74 20 77 69 6c 6c 20 62 65 20 75 73 65 66 75  it will be usefu
01a0: 6c 2c 0a 3b 3b 20 20 20 20 20 62 75 74 20 57 49  l,.;;     but WI
01b0: 54 48 4f 55 54 20 41 4e 59 20 57 41 52 52 41 4e  THOUT ANY WARRAN
01c0: 54 59 3b 20 77 69 74 68 6f 75 74 20 65 76 65 6e  TY; without even
01d0: 20 74 68 65 20 69 6d 70 6c 69 65 64 20 77 61 72   the implied war
01e0: 72 61 6e 74 79 20 6f 66 0a 3b 3b 20 20 20 20 20  ranty of.;;     
01f0: 4d 45 52 43 48 41 4e 54 41 42 49 4c 49 54 59 20  MERCHANTABILITY 
0200: 6f 72 20 46 49 54 4e 45 53 53 20 46 4f 52 20 41  or FITNESS FOR A
0210: 20 50 41 52 54 49 43 55 4c 41 52 20 50 55 52 50   PARTICULAR PURP
0220: 4f 53 45 2e 20 20 53 65 65 20 74 68 65 0a 3b 3b  OSE.  See the.;;
0230: 20 20 20 20 20 47 4e 55 20 47 65 6e 65 72 61 6c       GNU General
0240: 20 50 75 62 6c 69 63 20 4c 69 63 65 6e 73 65 20   Public License 
0250: 66 6f 72 20 6d 6f 72 65 20 64 65 74 61 69 6c 73  for more details
0260: 2e 0a 3b 3b 20 0a 3b 3b 20 20 20 20 20 59 6f 75  ..;; .;;     You
0270: 20 73 68 6f 75 6c 64 20 68 61 76 65 20 72 65 63   should have rec
0280: 65 69 76 65 64 20 61 20 63 6f 70 79 20 6f 66 20  eived a copy of 
0290: 74 68 65 20 47 4e 55 20 47 65 6e 65 72 61 6c 20  the GNU General 
02a0: 50 75 62 6c 69 63 20 4c 69 63 65 6e 73 65 0a 3b  Public License.;
02b0: 3b 20 20 20 20 20 61 6c 6f 6e 67 20 77 69 74 68  ;     along with
02c0: 20 4d 65 67 61 74 65 73 74 2e 20 20 49 66 20 6e   Megatest.  If n
02d0: 6f 74 2c 20 73 65 65 20 3c 68 74 74 70 3a 2f 2f  ot, see <http://
02e0: 77 77 77 2e 67 6e 75 2e 6f 72 67 2f 6c 69 63 65  www.gnu.org/lice
02f0: 6e 73 65 73 2f 3e 2e 0a 3b 3b 0a 20 0a 3b 3b 3d  nses/>..;;. .;;=
0300: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0310: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0320: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0330: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0340: 3d 3d 3d 3d 3d 0a 3b 3b 20 52 75 6e 20 6b 65 79  =====.;; Run key
0350: 73 2c 20 74 68 65 73 65 20 61 72 65 20 75 73 65  s, these are use
0360: 64 20 74 6f 20 68 69 65 72 61 72 63 68 69 61 6c  d to hierarchial
0370: 6c 79 20 6f 72 67 61 6e 69 73 65 20 74 65 73 74  ly organise test
0380: 73 20 61 6e 64 20 72 75 6e 20 61 72 65 61 73 0a  s and run areas.
0390: 3b 3b 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ;;==============
03a0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
03b0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
03c0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
03d0: 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a 28 69 6d 70 6f 72  ========..(impor
03e0: 74 20 73 71 6c 69 74 65 33 20 73 72 66 69 2d 31  t sqlite3 srfi-1
03f0: 0a 09 3b 3b 20 70 6f 73 69 78 0a 09 72 65 67 65  ..;; posix..rege
0400: 78 20 72 65 67 65 78 2d 63 61 73 65 20 73 72 66  x regex-case srf
0410: 69 2d 36 39 20 28 70 72 65 66 69 78 20 73 71 6c  i-69 (prefix sql
0420: 69 74 65 33 20 73 71 6c 69 74 65 33 3a 29 0a 20  ite3 sqlite3:). 
0430: 63 68 69 63 6b 65 6e 2e 70 6f 72 74 0a 20 63 68  chicken.port. ch
0440: 69 63 6b 65 6e 2e 70 72 65 74 74 79 2d 70 72 69  icken.pretty-pri
0450: 6e 74 0a 20 63 68 69 63 6b 65 6e 2e 73 74 72 69  nt. chicken.stri
0460: 6e 67 0a 20 63 68 69 63 6b 65 6e 2e 74 69 6d 65  ng. chicken.time
0470: 0a 20 73 72 66 69 2d 31 33 0a 29 0a 0a 28 64 65  . srfi-13.)..(de
0480: 63 6c 61 72 65 20 28 75 6e 69 74 20 6b 65 79 73  clare (unit keys
0490: 29 29 0a 28 64 65 63 6c 61 72 65 20 28 75 73 65  )).(declare (use
04a0: 73 20 63 6f 6d 6d 6f 6e 29 29 0a 0a 28 69 6e 63  s common))..(inc
04b0: 6c 75 64 65 20 22 6b 65 79 5f 72 65 63 6f 72 64  lude "key_record
04c0: 73 2e 73 63 6d 22 29 0a 28 69 6e 63 6c 75 64 65  s.scm").(include
04d0: 20 22 63 6f 6d 6d 6f 6e 5f 72 65 63 6f 72 64 73   "common_records
04e0: 2e 73 63 6d 22 29 0a 0a 28 64 65 66 69 6e 65 20  .scm")..(define 
04f0: 28 6b 65 79 73 2d 3e 6b 65 79 73 74 72 20 6b 65  (keys->keystr ke
0500: 79 73 29 20 3b 3b 20 3d 3e 20 6b 65 79 31 2c 6b  ys) ;; => key1,k
0510: 65 79 32 2c 6b 65 79 33 2c 61 64 64 69 74 69 6f  ey2,key3,additio
0520: 6e 61 31 2c 20 2e 2e 2e 0a 20 20 28 73 74 72 69  na1, ....  (stri
0530: 6e 67 2d 69 6e 74 65 72 73 70 65 72 73 65 20 6b  ng-intersperse k
0540: 65 79 73 20 22 2c 22 29 29 0a 0a 28 64 65 66 69  eys ","))..(defi
0550: 6e 65 20 28 61 72 67 73 3a 75 73 61 67 65 20 2e  ne (args:usage .
0560: 20 61 29 20 23 66 29 0a 0a 3b 3b 3d 3d 3d 3d 3d   a) #f)..;;=====
0570: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0580: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0590: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
05a0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
05b0: 3d 0a 3b 3b 20 6b 65 79 20 3c 3d 3e 20 74 61 72  =.;; key <=> tar
05c0: 67 65 74 20 72 6f 75 74 69 6e 65 73 0a 3b 3b 3d  get routines.;;=
05d0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
05e0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
05f0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0600: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0610: 3d 3d 3d 3d 3d 0a 0a 3b 3b 20 54 68 69 73 20 69  =====..;; This i
0620: 6e 76 61 6c 69 64 61 74 65 73 20 75 73 69 6e 67  nvalidates using
0630: 20 22 2f 22 20 69 6e 20 69 74 65 6d 20 6e 61 6d   "/" in item nam
0640: 65 73 2e 20 45 76 65 72 79 20 6b 65 79 20 77 69  es. Every key wi
0650: 6c 6c 20 62 65 0a 3b 3b 20 61 76 61 69 6c 61 62  ll be.;; availab
0660: 6c 65 20 76 69 61 20 61 72 67 73 3a 67 65 74 2d  le via args:get-
0670: 61 72 67 20 61 73 20 3a 6b 65 79 66 69 65 6c 64  arg as :keyfield
0680: 2e 20 53 69 6e 63 65 20 74 68 69 73 20 6f 6e 6c  . Since this onl
0690: 79 20 6e 65 65 64 73 20 74 6f 0a 3b 3b 20 62 65  y needs to.;; be
06a0: 20 63 61 6c 6c 65 64 20 6f 6e 63 65 20 6c 65 74   called once let
06b0: 27 73 20 75 73 65 20 69 74 20 74 6f 20 73 65 74  's use it to set
06c0: 20 74 68 65 20 65 6e 76 69 72 6f 6e 6d 65 6e 74   the environment
06d0: 20 76 61 72 73 0a 3b 3b 0a 3b 3b 20 54 68 65 20   vars.;;.;; The 
06e0: 73 65 74 74 69 6e 67 20 6f 66 20 3a 6b 65 79 66  setting of :keyf
06f0: 69 65 6c 64 20 69 6e 20 61 72 67 73 20 73 68 6f  ield in args sho
0700: 75 6c 64 20 62 65 20 74 75 72 6e 65 64 20 6f 66  uld be turned of
0710: 66 20 41 53 41 50 0a 3b 3b 0a 28 64 65 66 69 6e  f ASAP.;;.(defin
0720: 65 20 28 6b 65 79 73 3a 74 61 72 67 65 74 2d 73  e (keys:target-s
0730: 65 74 2d 61 72 67 73 20 6b 65 79 73 20 74 61 72  et-args keys tar
0740: 67 65 74 20 68 74 29 0a 20 20 28 69 66 20 74 61  get ht).  (if ta
0750: 72 67 65 74 0a 20 20 20 20 20 20 28 6c 65 74 20  rget.      (let 
0760: 28 28 76 61 6c 73 20 28 73 74 72 69 6e 67 2d 73  ((vals (string-s
0770: 70 6c 69 74 20 74 61 72 67 65 74 20 22 2f 22 29  plit target "/")
0780: 29 29 0a 09 28 69 66 20 28 65 71 3f 20 28 6c 65  ))..(if (eq? (le
0790: 6e 67 74 68 20 76 61 6c 73 29 28 6c 65 6e 67 74  ngth vals)(lengt
07a0: 68 20 6b 65 79 73 29 29 0a 09 20 20 20 20 28 66  h keys))..    (f
07b0: 6f 72 2d 65 61 63 68 20 28 6c 61 6d 62 64 61 20  or-each (lambda 
07c0: 28 6b 65 79 20 76 61 6c 29 0a 09 09 09 28 73 65  (key val)....(se
07d0: 74 65 6e 76 20 6b 65 79 20 76 61 6c 29 0a 09 09  tenv key val)...
07e0: 09 28 69 66 20 68 74 20 28 68 61 73 68 2d 74 61  .(if ht (hash-ta
07f0: 62 6c 65 2d 73 65 74 21 20 68 74 20 28 63 6f 6e  ble-set! ht (con
0800: 63 20 22 3a 22 20 6b 65 79 29 20 76 61 6c 29 29  c ":" key) val))
0810: 29 0a 09 09 20 20 20 20 20 20 6b 65 79 73 0a 09  )...      keys..
0820: 09 20 20 20 20 20 20 76 61 6c 73 29 0a 09 20 20  .      vals)..  
0830: 20 20 28 64 65 62 75 67 3a 70 72 69 6e 74 2d 65    (debug:print-e
0840: 72 72 6f 72 20 30 20 2a 64 65 66 61 75 6c 74 2d  rror 0 *default-
0850: 6c 6f 67 2d 70 6f 72 74 2a 20 22 77 72 6f 6e 67  log-port* "wrong
0860: 20 6e 75 6d 62 65 72 20 6f 66 20 76 61 6c 75 65   number of value
0870: 73 20 69 6e 20 22 20 74 61 72 67 65 74 20 22 2c  s in " target ",
0880: 20 73 68 6f 75 6c 64 20 6d 61 74 63 68 20 22 20   should match " 
0890: 6b 65 79 73 29 29 0a 09 76 61 6c 73 29 0a 20 20  keys))..vals).  
08a0: 20 20 20 20 28 64 65 62 75 67 3a 70 72 69 6e 74      (debug:print
08b0: 20 34 20 2a 64 65 66 61 75 6c 74 2d 6c 6f 67 2d   4 *default-log-
08c0: 70 6f 72 74 2a 20 22 45 52 52 4f 52 3a 20 6b 65  port* "ERROR: ke
08d0: 79 73 3a 74 61 72 67 65 74 2d 73 65 74 2d 61 72  ys:target-set-ar
08e0: 67 73 20 63 61 6c 6c 65 64 20 77 69 74 68 20 6e  gs called with n
08f0: 6f 20 74 61 72 67 65 74 2e 22 29 29 29 0a 0a 3b  o target.")))..;
0900: 3b 20 67 69 76 65 6e 20 74 68 65 20 6b 65 79 73  ; given the keys
0910: 20 28 61 20 6c 69 73 74 20 6f 66 20 76 65 63 74   (a list of vect
0920: 6f 72 73 20 3c 6b 65 79 20 66 69 65 6c 64 3e 20  ors <key field> 
0930: 6f 72 20 61 20 6c 69 73 74 20 6f 66 20 6b 65 79  or a list of key
0940: 73 29 20 61 6e 64 20 61 20 74 61 72 67 65 74 20  s) and a target 
0950: 72 65 74 75 72 6e 20 61 20 6b 65 79 76 61 6c 20  return a keyval 
0960: 6c 69 73 74 0a 3b 3b 20 6b 65 79 76 61 6c 20 6c  list.;; keyval l
0970: 69 73 74 20 28 20 28 6b 65 79 31 20 76 61 6c 31  ist ( (key1 val1
0980: 29 20 28 6b 65 79 32 20 76 61 6c 32 29 20 2e 2e  ) (key2 val2) ..
0990: 2e 29 0a 28 64 65 66 69 6e 65 20 28 6b 65 79 73  .).(define (keys
09a0: 3a 74 61 72 67 65 74 2d 3e 6b 65 79 76 61 6c 20  :target->keyval 
09b0: 6b 65 79 73 20 74 61 72 67 65 74 29 0a 20 20 28  keys target).  (
09c0: 6c 65 74 2a 20 28 28 74 61 72 67 6c 69 73 74 20  let* ((targlist 
09d0: 28 73 74 72 69 6e 67 2d 73 70 6c 69 74 20 74 61  (string-split ta
09e0: 72 67 65 74 20 22 2f 22 29 29 0a 09 20 28 6e 75  rget "/")).. (nu
09f0: 6d 6b 65 79 73 20 20 28 6c 65 6e 67 74 68 20 6b  mkeys  (length k
0a00: 65 79 73 29 29 0a 09 20 28 6e 75 6d 74 61 72 67  eys)).. (numtarg
0a10: 20 20 28 6c 65 6e 67 74 68 20 74 61 72 67 6c 69    (length targli
0a20: 73 74 29 29 0a 09 20 28 74 61 72 67 74 77 65 61  st)).. (targtwea
0a30: 6b 65 64 20 28 69 66 20 28 3e 20 6e 75 6d 6b 65  ked (if (> numke
0a40: 79 73 20 6e 75 6d 74 61 72 67 29 0a 09 09 09 20  ys numtarg).... 
0a50: 20 28 61 70 70 65 6e 64 20 74 61 72 67 6c 69 73   (append targlis
0a60: 74 20 28 6d 61 6b 65 2d 6c 69 73 74 20 28 2d 20  t (make-list (- 
0a70: 6e 75 6d 6b 65 79 73 20 6e 75 6d 74 61 72 67 29  numkeys numtarg)
0a80: 20 22 22 29 29 0a 09 09 09 20 20 74 61 72 67 6c   ""))....  targl
0a90: 69 73 74 29 29 29 0a 20 20 20 20 28 6d 61 70 20  ist))).    (map 
0aa0: 28 6c 61 6d 62 64 61 20 28 6b 65 79 20 74 61 72  (lambda (key tar
0ab0: 67 29 0a 09 20 20 20 28 6c 69 73 74 20 6b 65 79  g)..   (list key
0ac0: 20 74 61 72 67 29 29 0a 09 20 6b 65 79 73 20 74   targ)).. keys t
0ad0: 61 72 67 74 77 65 61 6b 65 64 29 29 29 0a 0a 3b  argtweaked)))..;
0ae0: 3b 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ;===============
0af0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b00: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b10: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b20: 3d 3d 3d 3d 3d 3d 3d 0a 3b 3b 20 63 6f 6e 66 69  =======.;; confi
0b30: 67 20 66 69 6c 65 20 72 65 6c 61 74 65 64 20 72  g file related r
0b40: 6f 75 74 69 6e 65 73 0a 3b 3b 3d 3d 3d 3d 3d 3d  outines.;;======
0b50: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b60: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b70: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b80: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b90: 0a 0a 28 64 65 66 69 6e 65 20 6b 65 79 73 3a 63  ..(define keys:c
0ba0: 6f 6e 66 69 67 2d 67 65 74 2d 66 69 65 6c 64 73  onfig-get-fields
0bb0: 20 63 6f 6d 6d 6f 6e 3a 67 65 74 2d 66 69 65 6c   common:get-fiel
0bc0: 64 73 29 0a 28 64 65 66 69 6e 65 20 28 6b 65 79  ds).(define (key
0bd0: 73 3a 6d 61 6b 65 2d 6b 65 79 2f 66 69 65 6c 64  s:make-key/field
0be0: 2d 73 74 72 69 6e 67 20 63 6f 6e 66 64 61 74 29  -string confdat)
0bf0: 0a 20 20 28 6c 65 74 20 28 28 66 69 65 6c 64 73  .  (let ((fields
0c00: 20 28 63 6f 6e 66 69 67 66 3a 67 65 74 2d 73 65   (configf:get-se
0c10: 63 74 69 6f 6e 20 63 6f 6e 66 64 61 74 20 22 66  ction confdat "f
0c20: 69 65 6c 64 73 22 29 29 29 0a 20 20 20 20 28 73  ields"))).    (s
0c30: 74 72 69 6e 67 2d 6a 6f 69 6e 0a 20 20 20 20 20  tring-join.     
0c40: 28 6d 61 70 20 28 6c 61 6d 62 64 61 20 28 66 69  (map (lambda (fi
0c50: 65 6c 64 29 28 63 6f 6e 63 20 28 63 61 72 20 66  eld)(conc (car f
0c60: 69 65 6c 64 29 20 22 20 22 20 28 63 61 64 72 20  ield) " " (cadr 
0c70: 66 69 65 6c 64 29 29 29 0a 09 20 20 66 69 65 6c  field)))..  fiel
0c80: 64 73 29 0a 20 20 20 20 20 22 2c 22 29 29 29 0a  ds).     ","))).
0c90: 0a                                               .