Overview
Comment: | Minor updates to manual |
---|---|
Downloads: | Tarball | ZIP archive | SQL archive |
Timelines: | family | ancestors | descendants | both | trunk |
Files: | files | file ages | folders |
SHA1: |
5696465b7a961e4fd152bcb4db43ddc5 |
User & Date: | matt on 2024-09-21 14:32:40 |
Other Links: | manifest | tags |
Context
2024-09-25
| ||
15:15 | Cleaned up uv files. Added tar releases to uv and captured some scratch files used to analyze configf check-in: bcc63efb47 user: matt tags: trunk | |
2024-09-21
| ||
14:32 | Minor updates to manual check-in: 5696465b7a user: matt tags: trunk | |
2024-09-20
| ||
07:03 | Updates to training doc. check-in: acb6016f77 user: matt tags: trunk | |
Changes
Modified docs/manual/Makefile from [4935d2a088] to [b09c61c87e].
︙ | ︙ | |||
30 31 32 33 34 35 36 37 38 39 40 41 42 43 | # asciidoc -b html5 -a icons -a iconsdir=$(DISPATH)/images/icons -a toc2 design_spec.txt # all : server.ps megatest_manual.html client.ps complex-itemmap.png megatest_manual.pdf megatest_manual.html : megatest_manual.txt *.txt installation.txt *png *.dot asciidoc -b html5 -a icons -a iconsdir=$(DISPATH)/images/icons -a toc2 megatest_manual.txt # dos2unix megatest_manual.html megatest_manual.pdf : megatest_manual.txt *.txt *png *.dot a2x -a toc -f pdf megatest_manual.txt %.pdf : %.dot dot -Tpdf $*.dot -o$*.pdf | > | 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 | # asciidoc -b html5 -a icons -a iconsdir=$(DISPATH)/images/icons -a toc2 design_spec.txt # all : server.ps megatest_manual.html client.ps complex-itemmap.png megatest_manual.pdf megatest_manual.html : megatest_manual.txt *.txt installation.txt *png *.dot asciidoc -b html5 -a icons -a iconsdir=$(DISPATH)/images/icons -a toc2 megatest_manual.txt fossil wiki commit Roadmap plan.txt # dos2unix megatest_manual.html megatest_manual.pdf : megatest_manual.txt *.txt *png *.dot a2x -a toc -f pdf megatest_manual.txt %.pdf : %.dot dot -Tpdf $*.dot -o$*.pdf |
︙ | ︙ |
Modified docs/manual/bisecting.png from [bd3e81c898] to [5a84a30eed].
cannot compute difference between binary files
Modified docs/manual/megatest-test-stages.png from [81fa066a5e] to [7d16f1261d].
cannot compute difference between binary files
Modified docs/manual/megatest_manual.html from [b4f1973471] to [70e10ea2d4].
1 2 3 4 | <!DOCTYPE html> <html lang="en"> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> | | | 1 2 3 4 5 6 7 8 9 10 11 12 | <!DOCTYPE html> <html lang="en"> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> <meta name="generator" content="AsciiDoc 10.2.0"> <title>The Megatest Users Manual</title> <style type="text/css"> /* Shared CSS for AsciiDoc xhtml11 and html5 backends */ /* Default font. */ body { font-family: Georgia,serif; |
︙ | ︙ | |||
955 956 957 958 959 960 961 | </div> <div class="sect1"> <h2 id="_todo_road_map">TODO / Road Map</h2> <div class="sectionbody"> <div class="paragraph"><p>Note: This road-map is a wish list and not a formal plan. Items are in rough priority but are subject to change. Development is driven by user requests, developer "itch" and bug reports. Please contact | | < < < < < < < < < < < < < < | 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 | </div> <div class="sect1"> <h2 id="_todo_road_map">TODO / Road Map</h2> <div class="sectionbody"> <div class="paragraph"><p>Note: This road-map is a wish list and not a formal plan. Items are in rough priority but are subject to change. Development is driven by user requests, developer "itch" and bug reports. Please contact <a href="mailto:matt@kiatoa.com">matt@kiatoa.com</a> with requests or bug reports.</p></div> <div class="paragraph"><p>Dashboard and runs</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> Multi-area dashboard view </p> </li> </ol></div> <div class="paragraph"><p>Tests Support</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> Add variable $MT_RUNPATH = $MT_LINKTREE/$MT_TARGET/$MT_RUNNAME </p> </li> <li> <p> Improve [script], especially indent handling </p> </li> </ol></div> <div class="paragraph"><p>Mtutils/CI</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> Enable mtutil calls from dashboard (for remote control) |
︙ | ︙ | |||
1026 1027 1028 1029 1030 1031 1032 | <div class="paragraph"><p>Build system</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> ./configure ⇒ ubuntu, sles11, sles12, rh7 [WIP] </p> </li> | < < < < < < < < < < > > > > > > > > > > | 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 | <div class="paragraph"><p>Build system</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> ./configure ⇒ ubuntu, sles11, sles12, rh7 [WIP] </p> </li> </ol></div> <div class="paragraph"><p>Code refactoring/quality/performance</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> Switch to scsh-process pipeline management for job execution/control </p> </li> <li> <p> Use call-with-environment-variables where possible. </p> </li> <li> <p> Switch to using simple runs query everywhere </p> </li> <li> <p> Add end_time to runs and add a rollup call that sets state, status and end_time </p> </li> </ol></div> <div class="paragraph"><p>Migration to inmem db and or overflow db</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> Re-work the dbstruct data structure? |
︙ | ︙ | |||
1069 1070 1071 1072 1073 1074 1075 | </ol></div> </li> </ol></div> <div class="paragraph"><p>Some ideas for Megatest 2.0</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> | | < < < < < | 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 | </ol></div> </li> </ol></div> <div class="paragraph"><p>Some ideas for Megatest 2.0</p></div> <div class="olist arabic"><ol class="arabic"> <li> <p> Generate cache files of megatest.config and runconfig.config and use them consistently. No magic. </p> <div class="olist loweralpha"><ol class="loweralpha"> <li> <p> Cache the configs in $MT_RUNPATH </p> </li> <li> <p> Following invocations of –run, -rerun* will calculate the new config but only overwrite the cached file IF changed </p> </li> </ol></div> </li> <li> <p> If the cached file changes ALL existing tests go from COMPLETED → STALE, I’m not sure what to do about RUNNING tests </p> </li> <li> <p> Per test copy commands (example is incomplete). </p> </li> </ol></div> |
︙ | ︙ | |||
1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 | Fully isolated tests (no use of NFS to see regression area files) </p> </li> <li> <p> Windows version </p> </li> </ol></div> </div> </div> <div class="sect1"> <h2 id="_installation">Installation</h2> <div class="sectionbody"> | > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > | 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 1466 1467 1468 1469 1470 1471 1472 1473 | Fully isolated tests (no use of NFS to see regression area files) </p> </li> <li> <p> Windows version </p> </li> </ol></div> <div class="paragraph"><p>WW14 . Streamline compilation - DONE, all non-official egg modules are now bundled.</p></div> <div class="paragraph"><p>WW15 . syscheck; touch file in home, tmp, runs, links and start xterm . pull in ftfplan (not integrated, just code pulled in) . fill newview matrix with data, filter pipeline gui elements . improve [script], especially indent handling</p></div> <div class="paragraph"><p>WW16 . split db into megatest.db (runs etc.) db/<something>.db . release basic newview implementation . add section "archive" to testconfig with save yes to save the test to archive at end of test run. . add -getdata and -savedata; writes a path to archive using provided target, runname, test and item_patt and path</p></div> <div class="paragraph"><p>WW18 . release split db implementation . mtutil calls from dashboard (for remote control) . logs browser (esp. for surfacing mtutil related activities)</p></div> <div class="paragraph"><p>WW19 .</p></div> <div class="paragraph"><p>WW20 . Switch to using simple runs query everywhere . Add end_time to runs and add a rollup call that sets state, status and end_time</p></div> <div class="paragraph"><p>Future . Switch to scsh-process pipeline management for job execution/control . Use call-with-environment-variables more.</p></div> </div> </div> <div class="sect1"> <h2 id="_migration_to_inmem_db_plus_per_run_db">Migration to inmem db plus per run db</h2> <div class="sectionbody"> <div class="olist arabic"><ol class="arabic"> <li> <p> Re-work the dbstruct data structure? </p> <div class="olist loweralpha"><ol class="loweralpha"> <li> <p> Move main.db to global? </p> </li> <li> <p> [ run-id.db inmemdb last-mod last-read last-sync inuse ] </p> </li> </ol></div> </li> <li> <p> Open main.db directly in calls to -runtests etc. No need to talk remote? </p> </li> </ol></div> </div> </div> <div class="sect1"> <h2 id="_installation">Installation</h2> <div class="sectionbody"> |
︙ | ︙ | |||
3014 3015 3016 3017 3018 3019 3020 | itemmap foo/ bar/</pre> </div></div> <div class="listingblock"> <div class="title">example for backreference (eg: item <span class="monospaced">foo23/thud</span> will imply waiton’s item <span class="monospaced">num-23/bar/thud</span></div> <div class="content monospaced"> <pre># # ## Example | | | 3048 3049 3050 3051 3052 3053 3054 3055 3056 3057 3058 3059 3060 3061 3062 | itemmap foo/ bar/</pre> </div></div> <div class="listingblock"> <div class="title">example for backreference (eg: item <span class="monospaced">foo23/thud</span> will imply waiton’s item <span class="monospaced">num-23/bar/thud</span></div> <div class="content monospaced"> <pre># # ## Example # ## can use {number} in replacement pattern to backreference a (capture) from matching pattern similar to sed or perl [requirements] mode itemwait # itemmap <item pattern for this test> <item replacement pattern for waiton test> itemmap foo(\d+)/ num-\1/bar/</pre> </div></div> <div class="listingblock"> <div class="title">example multiple itemmaps</div> |
︙ | ︙ | |||
3756 3757 3758 3759 3760 3761 3762 | </div> </div> <div id="footnotes"><hr></div> <div id="footer"> <div id="footer-text"> Version 1.5<br> Last updated | | | 3790 3791 3792 3793 3794 3795 3796 3797 3798 3799 3800 3801 | </div> </div> <div id="footnotes"><hr></div> <div id="footer"> <div id="footer-text"> Version 1.5<br> Last updated 2024-06-20 22:56:52 EDT </div> </div> </body> </html> |
Modified docs/manual/megatest_manual.pdf from [ab362656bb] to [598a365264].
cannot compute difference between binary files
Modified docs/manual/plan.txt from [5f519e210f] to [58a7955ac6].
|
| < < < < < < < < < < < < < < < < < | < < < < < < < < < < < < > > | < | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | TODO / Road Map --------------- Note: This road-map is a wish list and not a formal plan. Items are in rough priority but are subject to change. Development is driven by user requests, developer "itch" and bug reports. Please contact matt@kiatoa.com with requests or bug reports. Dashboard and runs . Multi-area dashboard view Tests Support . Add variable $MT_RUNPATH = $MT_LINKTREE/$MT_TARGET/$MT_RUNNAME . Improve [script], especially indent handling Mtutils/CI . Enable mtutil calls from dashboard (for remote control) . Logs browser (esp. for surfacing mtutil related activities) . Embed ftfplan for distributed automation, completed activities trigger QA runs which trigger deployment etc. . Jenkins junit XML support [DONE] . Add output flushing in teamcity support Build system . ./configure => ubuntu, sles11, sles12, rh7 [WIP] Code refactoring/quality/performance . Switch to scsh-process pipeline management for job execution/control . Use call-with-environment-variables where possible. . Switch to using simple runs query everywhere . Add end_time to runs and add a rollup call that sets state, status and end_time Migration to inmem db and or overflow db . Re-work the dbstruct data structure? .. [ run-id.db inmemdb last-mod last-read last-sync inuse ] Some ideas for Megatest 2.0 . Generate cache files of megatest.config and runconfig.config and use them consistently. No magic. .. Cache the configs in $MT_RUNPATH .. Following invocations of –run, -rerun* will calculate the new config but only overwrite the cached file IF changed . If the cached file changes ALL existing tests go from COMPLETED -> STALE, I’m not sure what to do about RUNNING tests . Per test copy commands (example is incomplete). ---------------- [testcopy] %/iind% unison SRC DEST % cp –r SRC DEST ---------------- |
︙ | ︙ | |||
157 158 159 160 161 162 163 | . Added option to compile IUP (needed for VMs) . Server side run launching . Wizards for creating tests, regression areas (current ones are text only and limited). . Fully functional built in web service (currently you can browse runs but it is very simplistic). . Gui panels for editing megatest.config and runconfigs.config . Fully isolated tests (no use of NFS to see regression area files) . Windows version | > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > | 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 | . Added option to compile IUP (needed for VMs) . Server side run launching . Wizards for creating tests, regression areas (current ones are text only and limited). . Fully functional built in web service (currently you can browse runs but it is very simplistic). . Gui panels for editing megatest.config and runconfigs.config . Fully isolated tests (no use of NFS to see regression area files) . Windows version WW14 . Streamline compilation - DONE, all non-official egg modules are now bundled. WW15 . syscheck; touch file in home, tmp, runs, links and start xterm . pull in ftfplan (not integrated, just code pulled in) . fill newview matrix with data, filter pipeline gui elements . improve [script], especially indent handling WW16 . split db into megatest.db (runs etc.) db/<something>.db . release basic newview implementation . add section "archive" to testconfig with save yes to save the test to archive at end of test run. . add -getdata and -savedata; writes a path to archive using provided target, runname, test and item_patt and path WW18 . release split db implementation . mtutil calls from dashboard (for remote control) . logs browser (esp. for surfacing mtutil related activities) WW19 . WW20 . Switch to using simple runs query everywhere . Add end_time to runs and add a rollup call that sets state, status and end_time Future . Switch to scsh-process pipeline management for job execution/control . Use call-with-environment-variables more. Migration to inmem db plus per run db ------------------------------------- . Re-work the dbstruct data structure? .. Move main.db to global? .. [ run-id.db inmemdb last-mod last-read last-sync inuse ] . Open main.db directly in calls to -runtests etc. No need to talk remote? |
Modified docs/manual/server.png from [2c71aac137] to [8f9f2b6550].
cannot compute difference between binary files