Megatest

Differences From Artifact [e50a47bd5d]:

• File tests/fullrun/ezlog_fail/example.logpro — part of check-in [e06ef7ae11] at 2012-04-21 23:36:51 on branch extend-test-get-path — Moved the full run test suite to fullrun (user: matt, size: 2098) [annotate] [blame] [check-ins using]
• File tests/fullrun/ezlog_pass/example.logpro — part of check-in [e06ef7ae11] at 2012-04-21 23:36:51 on branch extend-test-get-path — Moved the full run test suite to fullrun (user: matt, size: 2098) [annotate] [blame] [check-ins using]
• File tests/fullrun/tests/ezlog_fail/example.logpro — part of check-in [423f168820] at 2012-04-22 00:03:24 on branch extend-test-get-path — Arduously moved tests to the tests dir (user: matt, size: 2098) [annotate] [blame] [check-ins using]
• File tests/fullrun/tests/ezlog_pass/example.logpro — part of check-in [423f168820] at 2012-04-22 00:03:24 on branch extend-test-get-path — Arduously moved tests to the tests dir (user: matt, size: 2098) [annotate] [blame] [check-ins using]
• File tests/tests/ezlog_fail/example.logpro — part of check-in [5868dd5b31] at 2011-11-03 22:59:04 on branch trunk — Added test placeholders (user: matt, size: 2098) [annotate] [blame] [check-ins using]
• File tests/tests/ezlog_pass/example.logpro — part of check-in [5868dd5b31] at 2011-11-03 22:59:04 on branch trunk — Added test placeholders (user: matt, size: 2098) [annotate] [blame] [check-ins using]
• File tests/tests/eztest_logpro/lookittmp.logpro — part of check-in [41350e06ff] at 2011-10-13 23:33:01 on branch trunk — Fixed erratic behaviour with scroll bars in dashboard. Removed suppression of empty runs. Rollup now resets the event_time on running. Added -pathmod for setting basepath on html logs when generating spreadsheets. Fixed search fields not forcing refresh. Added proper setting of logfile in eztests when using logpro (user: matt, size: 2098) [annotate] [blame] [check-ins using]

To Artifact [1d9c0ef873]:

• File tests/fullrun/ezlog_fail/lookithome.logpro — part of check-in [e06ef7ae11] at 2012-04-21 23:36:51 on branch extend-test-get-path — Moved the full run test suite to fullrun (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/fullrun/ezlog_fail_then_pass/firststep.logpro — part of check-in [e06ef7ae11] at 2012-04-21 23:36:51 on branch extend-test-get-path — Moved the full run test suite to fullrun (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/fullrun/ezlog_pass/lookittmp.logpro — part of check-in [e06ef7ae11] at 2012-04-21 23:36:51 on branch extend-test-get-path — Moved the full run test suite to fullrun (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/fullrun/tests/ezlog_fail/lookithome.logpro — part of check-in [423f168820] at 2012-04-22 00:03:24 on branch extend-test-get-path — Arduously moved tests to the tests dir (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/fullrun/tests/ezlog_fail_then_pass/firststep.logpro — part of check-in [423f168820] at 2012-04-22 00:03:24 on branch extend-test-get-path — Arduously moved tests to the tests dir (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/fullrun/tests/ezlog_pass/lookittmp.logpro — part of check-in [423f168820] at 2012-04-22 00:03:24 on branch extend-test-get-path — Arduously moved tests to the tests dir (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/tests/ezlog_fail/lookithome.logpro — part of check-in [4cf18277f3] at 2012-03-20 23:28:57 on branch trunk — Got nbfind working on ubuntu (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/tests/ezlog_fail/lookittmp.logpro — part of check-in [5868dd5b31] at 2011-11-03 22:59:04 on branch trunk — Added test placeholders (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/tests/ezlog_fail_then_pass/firststep.logpro — part of check-in [60d6b0411d] at 2011-11-09 15:09:58 on branch fixing-logpro-test_data — Logpro (pass) + test_data (fail) should be fail but is pass. Added test case for this (user: mrwellan, size: 431) [annotate] [blame] [check-ins using]
• File tests/tests/ezlog_pass/lookittmp.logpro — part of check-in [5868dd5b31] at 2011-11-03 22:59:04 on branch trunk — Added test placeholders (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/tests/ezlog_warn/lookittmp.logpro — part of check-in [5868dd5b31] at 2011-11-03 22:59:04 on branch trunk — Added test placeholders (user: matt, size: 431) [annotate] [blame] [check-ins using]
• File tests/tests/eztest_logpro/lookittmp.logpro — part of check-in [bc64078220] at 2011-10-29 21:51:45 on branch trunk — Fixed test of eztest with logpro (user: matt, size: 431) [annotate] [blame] [check-ins using]

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44

;; (c) 2006,2007,2008,2009 Matthew Welland matt@kiatoa.com
;;  
;;   License GPL.

;; define your hooks
(hook:first-error   "echo \"Error hook activated: #{escaped errmsg}\"")
(hook:first-warning "echo \"Got warning: #{escaped warnmsg}\"")
(hook:value "echo \"Value hook activated: expected=#{expected}, measured=#{measured}, tolerance=#{tolerance}, message=#{message}\"")

;; first ensure your run at least started
;;
(trigger "Init"     #/This is a header/)
(trigger "InitEnd"  #/^\s*$/)
(section "Init" "Init" "InitEnd")

(trigger "Body"     #/^.*$/) ;; anything starts the body
;; (trigger "EndBody"  #/This had better never match/)

(section "Body"     "Body" "EndBody")

(trigger "Blah2"    #/^begin Blah2/)
(trigger "Blah2End" #/^end Blah2/)
(section "Blah2"    "Blah2" "Blah2End")

(expect:required in "Init"  = 1 "Header"      #/This is a header/)
(expect:required in "LogFileBody" > 0 "Something required but not found" #/This is required but not found/)
(expect:value    in "LogFileBody" 1.9 0.1 "Output voltage" #/Measured voltage output:\s*([\d\.\+\-e]+)v/)
(expect:value    in "LogFileBody" 0.5 0.1 "Output current" #/Measured output current:\s*([\d\.\+\-e]+)mA/)
(expect:value    in "LogFileBody" 110e9 2e9 "A big number (first)" #/Freq:\s*([\d\.\+\-e]+)\s+Hz/)
(expect:value    in "LogFileBody" 110e9 1e9 "A big number (second), hook not called" #/Freq:\s*([\d\.\+\-e]+)Hz/)
(expect:value    in "LogFileBody" 110e9 1e9 "A big number (never activated)" #/Freq:\s*([\d\.\+\-e]+)zH/)

;; Using match number
(expect:value    in "LogFileBody" 1.9 0.1 "Time Voltage" #/out: (\d+)\s+(\d+)/ match: 2)

;; Comparison instead of tolerance
(expect:value    in "LogFileBody" 1.9 >   "Time voltage" #/out: (\d+)\s+(\d+)/ match: 2)

(expect:ignore   in "Blah2" < 99 "FALSE ERROR" #/ERROR/)
(expect:ignore   in "Body"  < 99 "Ignore the word error in comments" #/^\/\/.*error/)
(expect:warning  in "Body"  = 0 "Any warning" #/WARNING/)
(expect:error    in "Body"  = 0 "ERROR BLAH"  (list #/ERROR/ #/error/)) ;; but disallow any other errors

;(expect in "Init"  < 1 "Junk"        #/This is bogus/)

<
<
<
<

<
<
<
<
<
<
<
<
<
<
<
<
<
<
<
<
|
<
<
<
<
<

<
<
<
<
<
<
<
|
|
|
<
<

1
2
3
4




5
















6





7







8
9
10

;; (c) 2006,2007,2008,2009 Matthew Welland matt@kiatoa.com
;;  
;;   License GPL.






















(expect:required in "LogFileBody" > 0 "Must be some files in the dir" #/.*/)













(expect:ignore   in "LogFileBody"  < 99 "Ignore the word error in comments" #/^\/\/.*error/)
(expect:warning  in "LogFileBody"  = 0 "Any warning" #/WARNING/)
(expect:error    in "LogFileBody"  = 0 "Any error"  (list #/ERROR/ #/error/)) ;; but disallow any other errors