Systemtest Framework

Simple Automation Framework for black box systemtesting, with following requirements

• Should be highly configurable


• Should provide plugin option


• Possible to simulate any test scenarios (like GUI testing/Test Report Preparation/etc)


• Tester friendly

I knew there are lot of opensource tools to do this, but each one has it own limitations and not full fill all above requirements . Now days testers are efficient in writing shell scripts then Java Program, so developed simple framework using shell script.

This version framework has been implemented with main 3 artifacts,

1. Datamodel: Test Data, one-to-one mapped with Testgroup.
   
2. Testgroup: Testgroup definition, defines one ore more rules.
   
3. Rules: Simple shell script with 4 life cycle functions.
4. 1 core shell script, to execute the testcases with above artifacts.
   

Rule:
Traditional shell script, with life cycle functions (initialize, execute, cleanup, output).

- initialize function will be invoked before starting executing t.
- execute function will be invoked once the testcase executed.
- cleanup function will be invoked on the testcase end.
- output function will be invoked to get more details (for reporting).

Testdata/Datamodel

Testdata in ":" seprated format, like

• Format

      GROUPNAME_TESTID:ANYTHING1=VALUE:ANYTHING2=VALUE:...

• Example

     SampleCases_Test001:Desc=Sample tescase:A=100

     SampleCases_Test002:Desc=Sample tescase:A=100

Testgroup

Group defines set of RULES.

• Format

        TEST_GROUP:<GROUPNAME>

           RULE:<RuleName1>

           RULE:<RuleName2>

           ....

        END_GROUP

• Example

        TEST_GROUP:SampleCases

           RULE:displayDescription

           RULE:displayAValue

           ...

        END_GROUP

In the above sample, Test001 and Test002 will be executed in the SampleCases? Group.

RULE

Rule is nothing but a shellscript with predefined life-cycle operations "initialize", "execute" and "cleanup"

• Format

       #!/bin/ksh -p

       function initialize

       {

           return 0

       }

       function execute

       {

           return 0

       }

       function cleanup

       {

           return 0

       }

• Example: displayDescription

       #!/bin/ksh -p

       function initialize

       {

         return 0

       }

       function execute

       {

            if [ $DEBUG ]; then set -x; PS4="displayDescription: "; fi

            . ${LIB}/toolsEnv.sh

            arrange "Desc" $*

            echo "TestCase  Desc: $Desc "

            return 0

        }

        function cleanup

        {

          return 0

        }

Where toolsEnv utility extracts the testdata from the input datamodel file.


There were lot of plans to enhance this framework, if you are interested reach me @ rathishraj@gmail.com

You can checkout the code from
http://code.google.com/p/regression-testing-framework/