Efficient observability-based test generation by dynamic symbolic execution

Dongjiang You, Sanjai Rayadurgam, Michael W Whalen, Mats Heimdahl, Gregory Gay

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Structural coverage metrics have been widely used to measure test suite adequacy as well as to generate test cases. In previous investigations, we have found that the fault-finding effectiveness of tests satisfying structural coverage criteria is highly dependent on program syntax - even if the faulty code is exercised, its effect may not be observable at the output. To address these problems, observability-based coverage metrics have been defined. Specifically, Observable MC/DC (OMC/DC) is a criterion that appears to be both more effective at detecting faults and more robust to program restructuring than MC/DC. Traditional counterexample-based test generation for OMC/DC, however, can be infeasible on large systems. In this study, we propose an incremental test generation approach that combines the notion of observability with dynamic symbolic execution. We evaluated the efficiency and effectiveness of our approach using seven systems from the avionics and medical device domains. Our results show that the incremental approach requires much lower generation time, while achieving even higher fault finding effectiveness compared with regular OMC/DC generation.

Original languageEnglish (US)
Title of host publication2015 IEEE 26th International Symposium on Software Reliability Engineering, ISSRE 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages228-238
Number of pages11
ISBN (Electronic)9781509004065
DOIs
StatePublished - Jan 13 2016
Event26th IEEE International Symposium on Software Reliability Engineering, ISSRE 2015 - Gaithersbury, United States
Duration: Nov 2 2015Nov 5 2015

Publication series

Name2015 IEEE 26th International Symposium on Software Reliability Engineering, ISSRE 2015

Other

Other26th IEEE International Symposium on Software Reliability Engineering, ISSRE 2015
CountryUnited States
CityGaithersbury
Period11/2/1511/5/15

Fingerprint Dive into the research topics of 'Efficient observability-based test generation by dynamic symbolic execution'. Together they form a unique fingerprint.

Cite this