STRIDE Test Space: Difference between revisions

From STRIDE Wiki
Jump to navigation Jump to search
No edit summary
Line 3: Line 3:
STRIDE Test Space is a hosted web application for storing and analyzing your test results. Test Space accepts data that results from the execution of STRIDE Test Units or Test Scripts. Data is uploaded to Test Space manually (using the web interface) or automatically from one of the STRIDE execution tools ([[Stride Runner|STRIDE Runner]] or [[STRIDE Studio]]). Once data is uploaded, it is retained until it is manually removed or automatically deleted (depending on the space configuration).
STRIDE Test Space is a hosted web application for storing and analyzing your test results. Test Space accepts data that results from the execution of STRIDE Test Units or Test Scripts. Data is uploaded to Test Space manually (using the web interface) or automatically from one of the STRIDE execution tools ([[Stride Runner|STRIDE Runner]] or [[STRIDE Studio]]). Once data is uploaded, it is retained until it is manually removed or automatically deleted (depending on the space configuration).


STRIDE Test Space organizes results in a hierarchy of ''projects'' and ''test spaces''. Any number of these entities can be created and managed by users to create a fluid hierarchy of test results that adapts to shifting needs during a product lifecycle.
STRIDE Test Space organizes results in a hierarchy of ''projects'' and ''test spaces''. Each time you upload data to a test space, a new result set is created (unless you explicitly add your data to an existing result set). With a given result set, test results are further organized into test suites containing test cases. Any number of these organizational entities can be used to create a fluid hierarchy of test results that adapts to shifting needs during a product lifecycle.


Viewing
==Viewing Results==
Baseline Comparison
 
Notifications
==Baseline Comparison==
Messages
 
==Notifications==
 
==Messages==


==Glossary==
==Glossary==
===Test Case===
This is the unit of measure for test results - and single pass/fail entity. Test cases can be supplemented with additional information in the form of annotations and comments.
===Test Suite===
===Test Suite===
TBD
TBD
===Test Case===
 
===Annotation===
TBD
 
===Comments===
TBD
TBD
===Result Set===
===Result Set===
a result set is a collection of test suites and test cases that represent a complete set of test results for a given test space. In it's simplest form, is the output from a single execution of the STRIDE Runner for a given set of test units.  
a result set is a collection of test suites and test cases that represent a complete set of test results for a given test space. In it's simplest form, is the output from a single execution of the STRIDE Runner for a given set of test units.  
===Test Space===
===Test Space===
A test space is a logical grouping of test results. Although STRIDE Test Space does not enforce any relationship between result sets, test spaces are only useful for analysis when you use them to hold sequential result set data that represent the same set of tests. That is, meaningful comparison between subsequent results sets can only be done when each result set represents execution of the same set of tests.
A test space is a logical grouping of test results. Although STRIDE Test Space does not enforce any relationship between result sets, test spaces are only useful for analysis when you use them to hold sequential result set data that represent the same set of tests. That is, meaningful comparison between subsequent results sets can only be done when each result set represents execution of the same set of tests.
Line 24: Line 37:
===Project===
===Project===
A project is logical grouping of test spaces. Every test space must be assigned to one and only one project.
A project is logical grouping of test spaces. Every test space must be assigned to one and only one project.
===Baseline===
===Baseline===
TBD
===Messages===
TBD
TBD


== STRIDE Test Space Features ==
* Works seamlessly with [[Test Units|STRIDE Test Units]] and [[Test Scripts|STRIDE Test Scripts]]
* Automatic results upload from STRIDE test runners
* Illustrates trends using [http://en.wikipedia.org/wiki/Sparkline sparklines], bar and line graphs
* Allows you to specify baseline results, then track progress/regression against the baseline
* Optionally emails notification of regressions and errors


[[Category: Test Space]]
[[Category: Test Space]]

Revision as of 16:35, 5 June 2009

What is STRIDE Test Space?

STRIDE Test Space is a hosted web application for storing and analyzing your test results. Test Space accepts data that results from the execution of STRIDE Test Units or Test Scripts. Data is uploaded to Test Space manually (using the web interface) or automatically from one of the STRIDE execution tools (STRIDE Runner or STRIDE Studio). Once data is uploaded, it is retained until it is manually removed or automatically deleted (depending on the space configuration).

STRIDE Test Space organizes results in a hierarchy of projects and test spaces. Each time you upload data to a test space, a new result set is created (unless you explicitly add your data to an existing result set). With a given result set, test results are further organized into test suites containing test cases. Any number of these organizational entities can be used to create a fluid hierarchy of test results that adapts to shifting needs during a product lifecycle.

Viewing Results

Baseline Comparison

Notifications

Messages

Glossary

Test Case

This is the unit of measure for test results - and single pass/fail entity. Test cases can be supplemented with additional information in the form of annotations and comments.

Test Suite

TBD

Annotation

TBD

Comments

TBD

Result Set

a result set is a collection of test suites and test cases that represent a complete set of test results for a given test space. In it's simplest form, is the output from a single execution of the STRIDE Runner for a given set of test units.

Test Space

A test space is a logical grouping of test results. Although STRIDE Test Space does not enforce any relationship between result sets, test spaces are only useful for analysis when you use them to hold sequential result set data that represent the same set of tests. That is, meaningful comparison between subsequent results sets can only be done when each result set represents execution of the same set of tests.

Each test space has properties that allow you to control who has access, if and how the results are compared to other results, whether to notify users of potential regressions, and how many result sets to keep in the space.

Project

A project is logical grouping of test spaces. Every test space must be assigned to one and only one project.

Baseline

TBD

Messages

TBD