Notifications: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| (5 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
Testspace supports automatic user notification of noteworthy test results events, namely: | Testspace supports automatic user notification of noteworthy test results events, namely: | ||
* when a result set has regressions (setbacks) relative to a defined baseline. The baseline for comparison can be a fixed set of results (fixed baseline) or simply the previous result set (sequential baseline). | * when a result set has regressions (setbacks) relative to a defined baseline. The baseline for comparison can be a fixed set of results (fixed baseline) or simply the previous result set (sequential baseline). | ||
* when a result set has one or more errors. These errors are generated in the STRIDE Framework when an [[ | * when a result set has one or more errors. These errors are generated in the STRIDE Framework when an [[Test_Log |error log]] message is created or when a [[Test Point Testing in C/C++ |test point]] expectation is not met. | ||
* when a result set has one or more test cases that exceed the expected duration set in a baseline. It is possible to define an upper bound for the duration of a particular test case in a baseline. If this upper bound has been set (it is not set by default), then any time that test case exceeds the duration limit, a notification will be generated. | * when a result set has one or more test cases that exceed the expected duration set in a baseline. It is possible to define an upper bound for the duration of a particular test case in a baseline. If this upper bound has been set (it is not set by default), then any time that test case exceeds the duration limit, a notification will be generated. | ||
Notification is currently done via email messages. Each user has a notification option for each test space to which they have access. If the user has been selected to receive notifications '''and''' one or more of the notification options (''setback'', ''errors'', or ''timing'') is activated for the testspace, then a message will be sent to that user when any new result set is uploaded that triggers one of these notification events. | Notification is currently done via email messages. Each user has a notification option for each test space to which they have access. If the user has been selected to receive notifications '''and''' one or more of the notification options (''setback'', ''errors'', or ''timing'') is activated for the testspace, then a message will be sent to that user when any new result set is uploaded that triggers one of these notification events. | ||
This screencast demonstrates these concepts: | |||
<html5media width="640" height="480">http://www.s2technologies.com/video/wiki/TS_Notifications.mp4</html5media> | |||
[[Category:Test Space]] | [[Category:Test Space]] | ||
Latest revision as of 21:07, 15 October 2014
Testspace supports automatic user notification of noteworthy test results events, namely:
- when a result set has regressions (setbacks) relative to a defined baseline. The baseline for comparison can be a fixed set of results (fixed baseline) or simply the previous result set (sequential baseline).
- when a result set has one or more errors. These errors are generated in the STRIDE Framework when an error log message is created or when a test point expectation is not met.
- when a result set has one or more test cases that exceed the expected duration set in a baseline. It is possible to define an upper bound for the duration of a particular test case in a baseline. If this upper bound has been set (it is not set by default), then any time that test case exceeds the duration limit, a notification will be generated.
Notification is currently done via email messages. Each user has a notification option for each test space to which they have access. If the user has been selected to receive notifications and one or more of the notification options (setback, errors, or timing) is activated for the testspace, then a message will be sent to that user when any new result set is uploaded that triggers one of these notification events. This screencast demonstrates these concepts:
<html5media width="640" height="480">http://www.s2technologies.com/video/wiki/TS_Notifications.mp4</html5media>