Using Test Doubles: Difference between revisions

From STRIDE Wiki
Jump to navigation Jump to search
 
(24 intermediate revisions by 3 users not shown)
Line 1: Line 1:
==Introduction==
__NOTOC__
The ''Test Double'' feature provides a means for intercepting C language functions on the target, and directing the call to a substitute function with identical parameters and return value. The use case is a unit test where the function under test uses a ("C") function during its execution, and this dependency is simulated by a substitute or double function during testing. The unit test is able to control the substitution of the dependency during run time, and thereby verify the behavior of the function under test.
The ''Test Double'' feature provides a means for intercepting C/C++ language '''global functions''' on the target, and directing the call to a substitute function with identical parameters and return value. The use case is a unit test where the function under test uses a function during its execution, and this dependency is simulated by a substitute or double function during testing. The unit test is able to control the substitution of the dependency during run time, and thereby verify the behavior of the function under test.
The following sample illustrates the relationship of the function under test and a dependency:
The following sample illustrates the relationship of the function under test and a dependency:


Line 8: Line 8:
</source>
</source>
   
   
<source lang="c">
<source lang="c">
// depend.c
// depend.c
Line 17: Line 18:
}
}
</source>
</source>
   
   
<source lang="c">
<source lang="c">
Line 23: Line 25:
</source>
</source>
   
   
<source lang="c">
<source lang="c">
// test.c
// test.c
Line 34: Line 37:
</source>
</source>


In the above sample, test() is the function under test and depend() is a dependency candidate for doubling.


In the above sample, ''test()'' is the function under test and ''depend()'' is a dependency candidate for doubling.


The steps required to achieve doubling of a dependency function are as follows:
The steps required to achieve doubling of a dependency function are as follows:
#[[#Configuring_the_Double_Using_SCL|Configure the double parameters using SCL pragmas]]  
#[[#Configuring the Double Using Function Pragma | Configuring the Double Using Function Pragma]]  
#[[#Creating_Double_Intercepts_in_the_IM|Create the double intercepts in the IM]]
#[[#Creating_Double_Intercepts_in_the_IM|Create Double Intercepts in the IM]]
#[[#Switching_the_Double_Function_During_Runtime|Switch to/from the double function during runtime]]
#[[#Switching_the_Double_Function_During_Runtime|Switch Double Function During Runtime]]
 
 
==Configuring the Double Using Function Pragma==
 
The syntax of the [[Scl_function|function pragma]] supports a set of '''''optional''''' attributes that allow the specification of function interception parameters. When captured for the purpose of interception ('''intercept-able''') the optional arguments are '''required'''.
 
#pragma scl_function(function-name [,context, name-mangling, group-id])


==Configuring the Double Using SCL==


The syntax of the [[Scl_func|scl_func]] and [[Scl_function|scl_function]] pragmas have been expanded to include new '''''optional''''' attributes that allow the specification of function interception parameters.
Refer to the actual [[Scl_function | function pragma]] definition for an explanation of
* '''context''' - set to ''DEFINITION'' or ''REFERENCE''
* '''name-mangling''' - set to ''EXPLICIT'' or ''IMPLICIT''. Note if set to explicit requires usage of the ''srTEST_INTERCEPT'' macro
* '''group-id''' - user defined to enable or disable interception


In the above sample, depend() needs to be SCL captured and enabled for interception in a manner to be doubled.
 
In the above sample, ''depend()'' needs to be captured via the pragma and enabled for interception in the following manner.


<source lang="c">
<source lang="c">
Line 54: Line 67:
#pragma scl_function(depend, "DEFINITION", "IMPLICIT", "TEST_GROUP")
#pragma scl_function(depend, "DEFINITION", "IMPLICIT", "TEST_GROUP")
</source>
</source>


==Creating Double Intercepts in the IM==
==Creating Double Intercepts in the IM==
If a function has been configured as a double candidate using SCL as outlined in the above step, then the next step is to compile and bind using [[Build_Tools|STRIDE build tools]] and create the IM that contains the intercept for the double function. The options to [[s2sinstrument]] have been updated to support the test double feature.
If a function has been configured as a double candidate using the function pragma as outlined in the above step, the [[Build_Tools|Stride Build Tools]] will automatically create the [[Intercept Module]], aka IM, that contains the intercept for the double function. This all happens automatically during the build process.  
 
By default (see [[s2sinstrument]] '''--default_mode''' option for details) the IM generated code will contain interceptor for any intercept-able function there is not need to specify any special IM '''--mode''' options.


s2scompile –I"C:\STRIDE\inc" depend_scl.h
But to enable the interception the source file containing the <tt>depend()</tt> implementation '''must be altered''' to [[Name_Mangling|mangle the function's name]] by defining the Group ID and including the generated Intercept Module header file (xxxIM.h):
s2sbind --output=test.sidb depend_scl.h.meta
s2sinstrument –-im_name=test test.sidb
 
Once the IM has been successfully created, the source file containing the depend() implementation must be altered by defining the Group ID and including the generated Intercept Module mangling header file (xxxIM.h):


<source lang="c">
<source lang="c">
Line 80: Line 88:


==Switching the Double Function During Runtime==
==Switching the Double Function During Runtime==
The test unit will have access to the following STRIDE runtime macros for substituting a stub function for a double candidate.
In the context of the test unit code the following STRIDE runtime macros, defined in the STRIDE runtime header file '''srtest.h''', could be used for substituting a stub function for a double candidate.


<source lang="c">
<source lang="c">
srDOUBLE_GET(fn, pfnDbl)
srDOUBLE_SET(fn, fnDbl)
srDOUBLE_SET(fn, fnDbl)
srDOUBLE_RESET(fn)
srDOUBLE_GET(fn, pfnDbl) // used for more advanced scenarios
</source>
</source>


Where:
Where:
*'''fn''' is the function qualified by scl_function or scl_func as a dependency candidate, as above.
*'''fn''' is the function qualified by <tt>scl_function</tt> or <tt>scl_func</tt> as a dependency candidate, as above.
*'''pfnDbl''' is a pointer to a object of type srFnDbl_t, declared to hold the current value of the active double function.
*'''pfnDbl''' is a pointer to a object of type <tt>srFunctionDouble_t</tt>, declared to hold the current value of the active double function.
*'''fnDbl''' is a function that is to be the current active double. ''The function passed in should '''always''' match the signature of the dependency candidate specified by '''fn'''.''
*'''fnDbl''' is a function that is to be the current active double. ''The function passed in should '''always''' match the signature of the dependency candidate specified by '''fn'''.''
'''''Note:''''' the initial value of the current active double is always the dependency candidate function.
'''''Note:''''' the initial value of the current active double is always the dependency candidate function.


These macros are defined in the STRIDE runtime header file '''sr.h'''. The following example shows how they are used in a [[Test_Units#C.2B.2B_Test_Classes|C++ test unit]]:
=== Example 1 ===
The following example shows how to double a routine for the lifetime of a C++ Test Unit:


<source lang="cpp">
<source lang="cpp">
Line 107: Line 118:
     Test()
     Test()
     {
     {
        srDOUBLE_GET(depend, &m_depend_dbl);
         srDOUBLE_SET(depend, depend_dbl);
         srDOUBLE_SET(depend, depend_dbl);
     }
     }
Line 113: Line 123:
     ~Test()
     ~Test()
     {
     {
         srDOUBLE_SET(depend, m_depend_dbl);
         srDOUBLE_RESET(depend);
     }
     }


     int test1(void) { return test(1, 2); }
     int test1(void) { return test(1, 2); }
     int test2(void) { return test(5, 6); }
     int test2(void) { return test(5, 6); }
private:
  srFunctionDouble_t m_depend_dbl;
};
};
   
   
#ifdef _SCL
#ifdef _SCL
#pragma scl_test_class(Test)
#pragma scl_test_class(Test)
#pragma scl_function(depend_dbl, "DEFINITION", "IMPLICIT", "TEST_GROUP")
#pragma scl_function(depend, "DEFINITION", "IMPLICIT", "TEST_GROUP")
#endif  
#endif  
</source>
</source>


[[Category:Test Units]]
=== Example 2 ===
The following example shows how to make a call to the original routine in the context of a double by safely handling any nested doubling:
 
<source lang="c">
#include <srtest.h>
#include "depend.h"
 
extern "C" int depend_dbl(int a)
{
    int ret;
 
    srFunctionDouble_t fn;
    srDOUBLE_GET(depend, &fn);
    srDOUBLE_RESET(depend);
    ret = depend(a);
    srDOUBLE_SET(depend, fn);
   
    return ret;
}
</source>

Latest revision as of 20:08, 6 July 2015

The Test Double feature provides a means for intercepting C/C++ language global functions on the target, and directing the call to a substitute function with identical parameters and return value. The use case is a unit test where the function under test uses a function during its execution, and this dependency is simulated by a substitute or double function during testing. The unit test is able to control the substitution of the dependency during run time, and thereby verify the behavior of the function under test. The following sample illustrates the relationship of the function under test and a dependency:

// depend.h
int depend(int x);


// depend.c
#include "depend.h"
 
int depend(int x)
{
    return x + x;
}


// test.h
int test(int x, int y);


// test.c
#include "test.h"
#include "depend.h"
 
int test(int x, int y)
{
    return depend(x) * y;
}


In the above sample, test() is the function under test and depend() is a dependency candidate for doubling.

The steps required to achieve doubling of a dependency function are as follows:

  1. Configuring the Double Using Function Pragma
  2. Create Double Intercepts in the IM
  3. Switch Double Function During Runtime


Configuring the Double Using Function Pragma

The syntax of the function pragma supports a set of optional attributes that allow the specification of function interception parameters. When captured for the purpose of interception (intercept-able) the optional arguments are required.

#pragma scl_function(function-name [,context, name-mangling, group-id])


Refer to the actual function pragma definition for an explanation of

  • context - set to DEFINITION or REFERENCE
  • name-mangling - set to EXPLICIT or IMPLICIT. Note if set to explicit requires usage of the srTEST_INTERCEPT macro
  • group-id - user defined to enable or disable interception


In the above sample, depend() needs to be captured via the pragma and enabled for interception in the following manner.

// depend_scl.h
#include "depend.h"

#pragma scl_function(depend, "DEFINITION", "IMPLICIT", "TEST_GROUP")


Creating Double Intercepts in the IM

If a function has been configured as a double candidate using the function pragma as outlined in the above step, the Stride Build Tools will automatically create the Intercept Module, aka IM, that contains the intercept for the double function. This all happens automatically during the build process.

But to enable the interception the source file containing the depend() implementation must be altered to mangle the function's name by defining the Group ID and including the generated Intercept Module header file (xxxIM.h):

// depend.c
#include "depend.h"
/* define the Group ID before including the IM header */
#define TEST_GROUP
#include "strideIM.h"

int depend(int x)
{
    return x + x;
}

Switching the Double Function During Runtime

In the context of the test unit code the following STRIDE runtime macros, defined in the STRIDE runtime header file srtest.h, could be used for substituting a stub function for a double candidate.

srDOUBLE_SET(fn, fnDbl)
srDOUBLE_RESET(fn)

srDOUBLE_GET(fn, pfnDbl) // used for more advanced scenarios

Where:

  • fn is the function qualified by scl_function or scl_func as a dependency candidate, as above.
  • pfnDbl is a pointer to a object of type srFunctionDouble_t, declared to hold the current value of the active double function.
  • fnDbl is a function that is to be the current active double. The function passed in should always match the signature of the dependency candidate specified by fn.

Note: the initial value of the current active double is always the dependency candidate function.

Example 1

The following example shows how to double a routine for the lifetime of a C++ Test Unit:

#include <srtest.h>
#include "depend.h"

extern "C" int depend_dbl(int a) { return a * a; }

class Test: public stride::srTest
{ 
public:

    Test()
    {
        srDOUBLE_SET(depend, depend_dbl);
    }

    ~Test()
    {
        srDOUBLE_RESET(depend);
    }

    int test1(void) { return test(1, 2); }
    int test2(void) { return test(5, 6); }
};
 
#ifdef _SCL
#pragma scl_test_class(Test)
#pragma scl_function(depend, "DEFINITION", "IMPLICIT", "TEST_GROUP")
#endif

Example 2

The following example shows how to make a call to the original routine in the context of a double by safely handling any nested doubling:

#include <srtest.h>
#include "depend.h"

extern "C" int depend_dbl(int a) 
{
    int ret;

    srFunctionDouble_t fn;
    srDOUBLE_GET(depend, &fn);
    srDOUBLE_RESET(depend);
    ret = depend(a);
    srDOUBLE_SET(depend, fn);
    
    return ret; 
}