Toward Rigorous Object-Code Coverage Criteria

Tae Joon Byun, Vaibhav B Sharma, Sanjai Rayadurgam, Stephen A McCamant, Mats Heimdahl

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Object-branch coverage (OBC) is often used as a measure of the thoroughness of tests suites, augmenting or substituting source-code based structural criteria such as branch coverage and modified condition/decision coverage (MC/DC). In addition, with the increasing use of third-party components for which source-code access may be unavailable, robust object-code coverage criteria are essential to assess how well the components are exercised during testing. While OBC has the advantage of being programming language independent and is amenable to non-intrusive coverage measurement techniques, variations in compilers and the optimizations they perform can substantially change the structure of the generated code and the instructions used to represent branches. To address the need for a robust object coverage criterion, this paper proposes a rigorous definition of OBC such that it captures well the semantics of source code branches for a given instruction set architecture. We report an empirical assessment of these criteria for the Intel x86 instruction set on several examples from embedded control systems software. Preliminary results indicate that object-code coverage can be made robust to compilation variations and is comparable in its bug-finding efficacy to source level MC/DC.

Original languageEnglish (US)
Title of host publicationProceedings - 2017 IEEE 28th International Symposium on Software Reliability Engineering, ISSRE 2017
PublisherIEEE Computer Society
Pages328-338
Number of pages11
ISBN (Electronic)9781538609415
DOIs
StatePublished - Nov 14 2017
Event28th IEEE International Symposium on Software Reliability Engineering, ISSRE 2017 - Toulouse, France
Duration: Oct 23 2017Oct 26 2017

Publication series

NameProceedings - International Symposium on Software Reliability Engineering, ISSRE
Volume2017-October
ISSN (Print)1071-9458

Other

Other28th IEEE International Symposium on Software Reliability Engineering, ISSRE 2017
CountryFrance
CityToulouse
Period10/23/1710/26/17

Keywords

  • Coverage criteria
  • DO-178
  • OBC
  • Object-code testing
  • Structural testing

Fingerprint Dive into the research topics of 'Toward Rigorous Object-Code Coverage Criteria'. Together they form a unique fingerprint.

  • Cite this

    Byun, T. J., Sharma, V. B., Rayadurgam, S., McCamant, S. A., & Heimdahl, M. (2017). Toward Rigorous Object-Code Coverage Criteria. In Proceedings - 2017 IEEE 28th International Symposium on Software Reliability Engineering, ISSRE 2017 (pp. 328-338). [8109098] (Proceedings - International Symposium on Software Reliability Engineering, ISSRE; Vol. 2017-October). IEEE Computer Society. https://doi.org/10.1109/ISSRE.2017.33