ADDED docs/manual/megatest-stand-alone-area.png Index: docs/manual/megatest-stand-alone-area.png ================================================================== --- /dev/null +++ docs/manual/megatest-stand-alone-area.png cannot compute difference between binary files ADDED docs/manual/megatest-system-architecture.png Index: docs/manual/megatest-system-architecture.png ================================================================== --- /dev/null +++ docs/manual/megatest-system-architecture.png cannot compute difference between binary files ADDED docs/manual/megatest-system-architecture.svg Index: docs/manual/megatest-system-architecture.svg ================================================================== --- /dev/null +++ docs/manual/megatest-system-architecture.svg @@ -0,0 +1,5662 @@ + + + + Index: docs/manual/megatest_manual.html ================================================================== --- docs/manual/megatest_manual.html +++ docs/manual/megatest_manual.html @@ -835,18 +835,19 @@ of a test or task. In most cases megatest is best used in conjunction with logpro or a similar tool to parse, analyze and decide on the test outcome.
-Self-checking -Repeatable strive for directed or self-checking test - as opposed to delta based tests. +Self-checking - make it as easy as possible to write self-checking + tests (as opposed to using deltas, i.e. tests that compare with a + previous measurement to deterine PASS/FAIL).
-Traceable - environment variables, host OS and other possibly influential - variables are captured and kept recorded. +Traceable - environment variables, host OS and other possibly + influential variables are captured and kept recorded.
Immutable - once a test is run it cannot be easily overwritten or @@ -853,27 +854,31 @@ modified accidentally.
-Repeatable - test results can be recreated in the future using all the original variables. +Repeatable - test results can be recreated in the future using all + the original variables.
-Relocatable - the testsuite or automation area can be checked out and the tests run anywhere in the disk hierarchy. +Relocatable - the testsuite or automation area can be checked out + and the tests run anywhere in the disk hierarchy.
-Encapsulated - the tests run in self-contained directories and all inputs - and outputs to the process can be found in the run areas. +Encapsulated - the tests run in self-contained directories and all + inputs and outputs to the process can be found in the run areas.
-Deployable - a testsuite is self-contained and can be bundled with a software project. +Deployable - a testsuite is self-contained and can be bundled with + a software project and easily used by others with little to no + setup burden.
Tests are launched using the launching system available for the distributed compute platform in use. A template script is provided which can launch jobs on local and remote Linux hosts. Currently megatest uses the network filesystem to call home to your master -sqlite3 database. Megatest has been used with the Intel Netbatch -system, the lsf batch system and it should be possible to use it with -other similar systems.
A single, stand-alone, Megatest based testsuite or "area" is +sufficient for most validation, automation and build problems.
Megatest is designed as a distributed or decoupled system. This means +you can run the areas stand-alone with no additional +infrastructure. I.e. there are no databases, web servers or other +centralized resources needed. However as your needs grow you can +integrate multiple areas into a bigger system.
+Multi-area dashboard and xterm. A gui (the dashboard) is usually the + best option for controlling and launching runs but all operations + can also be done from the commandline. Note: The not yet released + multi-area dashboard replaces the old dashboard for browsing and + controlling runs but for managing a single area the old dashboard + works very well. +
++Area/testsuite. This is your testsuite or automation definition and + consists of the information in megatest.config, runconfigs.config + and your testconfigs along with any custom scripting that can’t be + done with the native Megatest features. +
++If your testsuite or build automation is too large to run on a + single instance you can distribute your jobs into a compute server + pool. The only current requirements are password-less ssh access and + a network filesystem. +
+