Distinguished paper: The effect of program and model structure on MC/DC test adequacy coverage

Research output: Chapter in Book/Report/Conference proceedingConference contribution

49 Scopus citations

Abstract

In avionics and other critical systems domains, adequacy of test suites is currently measured using the MC/DC metric on source code (or on a model in model-based development). We believe that the rigor of the MC/DC metric is highly sensitive to the structure of the implementation and can therefore be misleading as a test adequacy criterion. We investigate this hypothesis by empirically studying the effect of program structure on MC/DC coverage. To perform this investigation, we use six realistic systems from the civil avionics domain and two toy examples. For each of these systems, we use two versions of their implementation-with and without expression folding (i.e., miming). To assess the sensitivity of MC/DC to program structure, we first generate test suites that satisfy MC/DC over a non-inlined implementation. We then run the generated test suites over the inlined implementation and measure MC/DC achieved. For our realistic examples, the test suites yield an average reduction of 29.5% in MC/DC achieved over the inlined implementations at 5% statistical significance level.

Original languageEnglish (US)
Title of host publicationICSE'08
Subtitle of host publicationProceedings of the 30th International Conference on Software Engineering 2008
Pages161-170
Number of pages10
DOIs
StatePublished - Dec 15 2008
Event30th International Conference on Software Engineering 2008, ICSE'08 - Leipzig, Germany
Duration: May 10 2008May 18 2008

Publication series

NameProceedings - International Conference on Software Engineering
ISSN (Print)0270-5257

Other

Other30th International Conference on Software Engineering 2008, ICSE'08
CountryGermany
CityLeipzig
Period5/10/085/18/08

Keywords

  • Experimentation
  • Verification

Fingerprint Dive into the research topics of 'Distinguished paper: The effect of program and model structure on MC/DC test adequacy coverage'. Together they form a unique fingerprint.

Cite this