Moving the goalposts: Coverage satisfaction is not enough

Gregory Gay, Matt Staats, Michael W Whalen, Mats Heimdahl

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Structural coverage criteria have been proposed to measure the adequacy of testing efforts. Indeed, in some domains-e.g., critical systems areas-structural coverage criteria must be satisfied to achieve certification. The advent of powerful search-based test generation tools has given us the ability to generate test inputs to satisfy these structural coverage criteria. While tempting, recent empirical evidence indicates these tools should be used with caution, as merely achieving high structural coverage is not necessarily indicative of high fault detection ability. In this report, we review some of these findings, and offer recommendations on how the strengths of search-based test generation methods can alleviate these issues.

Original languageEnglish (US)
Title of host publication7th International Workshop on Search-Based Software Testing, SBST 2014 - Proceedings
PublisherAssociation for Computing Machinery, Inc
Pages19-22
Number of pages4
ISBN (Electronic)9781450328524
DOIs
StatePublished - Jun 2 2014
Event7th International Workshop on Search-Based Software Testing, SBST 2014 - Hyderabad, India
Duration: Jun 2 2014Jun 3 2014

Publication series

Name7th International Workshop on Search-Based Software Testing, SBST 2014 - Proceedings

Other

Other7th International Workshop on Search-Based Software Testing, SBST 2014
CountryIndia
CityHyderabad
Period6/2/146/3/14

Keywords

  • Automated Test Generation
  • Software Testing
  • Structural Coverage

Fingerprint Dive into the research topics of 'Moving the goalposts: Coverage satisfaction is not enough'. Together they form a unique fingerprint.

Cite this