Coverage metrics for requirements-based testing

Michael W. Whalen, Mats P E Heimdahl, Ajitha Rajan, Steven R. Miller

Research output: Chapter in Book/Report/Conference proceedingConference contribution

65 Scopus citations

Abstract

In black-box testing, one is interested in creating a suite of tests from requirements that adequately exercise the behavior of a, software system without regard to the internal structure of the implementation. In current practice, the adequacy of black box test suites is inferred by examining coverage on an executable artifact, either source code or a software model. In this paper, we define structural coverage metrics directly on high-level formal software requirements. These metrics provide objective, implementation-independent measures of how well a black-box test suite exercises a set of requirements. We focus on structural coverage criteria on requirements formalized as LTL properties and discuss how they can be adapted to measure finite test cases. These criteria, can also be used to automatically generate a requirements-based test suite. Unlike model or code-derived test cases, these tests are immediately traceable to high-level requirements. To assess the practicality of our approach, we apply it on a realistic example from the avionics domain.

Original languageEnglish (US)
Title of host publicationProceedings of the 2006 International Symposium on Software Testing and Analysis, ISSTA 2006
Pages25-35
Number of pages11
DOIs
StatePublished - 2006
Event2006 International Symposium on Software Testing and Analysis, ISSTA 2006 - Portland, ME, United States
Duration: Jul 17 2006Jul 20 2006

Publication series

NameProceedings of the 2006 International Symposium on Software Testing and Analysis, ISSTA 2006
Volume2006

Other

Other2006 International Symposium on Software Testing and Analysis, ISSTA 2006
CountryUnited States
CityPortland, ME
Period7/17/067/20/06

Keywords

  • Verification

Fingerprint Dive into the research topics of 'Coverage metrics for requirements-based testing'. Together they form a unique fingerprint.

  • Cite this

    Whalen, M. W., Heimdahl, M. P. E., Rajan, A., & Miller, S. R. (2006). Coverage metrics for requirements-based testing. In Proceedings of the 2006 International Symposium on Software Testing and Analysis, ISSTA 2006 (pp. 25-35). (Proceedings of the 2006 International Symposium on Software Testing and Analysis, ISSTA 2006; Vol. 2006). https://doi.org/10.1145/1146238.1146242