Test matrix and Test metrics

Test matrix and test metrics are essential components of the test management process. Each plays a unique role in ensuring the effectiveness of the testing efforts and providing valuable insights into the quality of the software being tested.

Test Matrix

A test matrix is a table that shows the relationship between test cases and test conditions. It provides a structured way to manage and organize test cases based on different parameters, such as test types, test levels, or test environments. The matrix typically includes information about which test cases will be executed for specific combinations of conditions.

Example test matrix:

Test Case ID	Requirement	Test Type	Test Status
TC001	REQF001	Functional	Passed
TC002	REQP002	Performance	Failed
TC003	REQS003	Security	Not Run
TC004	REQU004	Usability	Passed
TC005	REQF002	Functional	Passed

The test matrix helps ensure test coverage of the requirements and allows for easy tracking of the execution status of each test case. Testing against well defined Requirements is a keystone of good practice.

Test Metrics

Test metrics involve the collection and analysis of quantitative data related to the testing process. These metrics provide insights into the effectiveness, progress, and quality of testing activities. They can highlight problems from early on in the project. Some common test metrics include:

• Test Coverage: Test coverage is a metric used in software testing to measure the extent to which a software application has been exercised by a set of test cases. It helps in evaluating the thoroughness of the testing process by determining which parts of the code have been tested and which parts remain untested. The goal is to ensure that the testing effort covers a sufficient portion of the software to minimize the risk of undetected defects.
• Defect Density: The number of defects per unit, often per line of code or per test case. I high value indicates problems with code quality.
• Execution Pass Rate: The percentage of test cases that passed during a test cycle.
• Test Effort vs. Defect Discovery: Analyses the relationship between testing effort (time or resources) and the number of defects discovered.

itsbusiness AG can help with all aspects of testing, with more than 20 years of delivering top Software Quality Assurance across a wide range of fields and projects. Please get in touch if you require advice in Software Quality Assurance.

Contact

If you have questions or need more information, please contact:

Andrew Connell​
QA Consultant, itsbusiness AG
+41 31 370 32 05
andrew.connell@itsbusiness.ch​