Structural coverage metrics have been widely used to measure test suite adequacy as well as to generate test cases. In previous investigations, we have found that the fault-finding effectiveness of tests satisfying structural coverage criteria is highly dependent on program syntax - even if the faulty code is exercised, its effect may not be observable at the output. To address these problems, observability-based coverage metrics have been defined. Specifically, Observable MC/DC (OMC/DC) is a criterion that appears to be both more effective at detecting faults and more robust to program restructuring than MC/DC. Traditional counterexample-based test generation for OMC/DC, however, can be infeasible on large systems. In this study, we propose an incremental test generation approach that combines the notion of observability with dynamic symbolic execution. We evaluated the efficiency and effectiveness of our approach using seven systems from the avionics and medical device domains. Our results show that the incremental approach requires much lower generation time, while achieving even higher fault finding effectiveness compared with regular OMC/DC generation.
|Original language||English (US)|
|Title of host publication||2015 IEEE 26th International Symposium on Software Reliability Engineering, ISSRE 2015|
|Publisher||Institute of Electrical and Electronics Engineers Inc.|
|Number of pages||11|
|State||Published - Jan 13 2016|
|Event||26th IEEE International Symposium on Software Reliability Engineering, ISSRE 2015 - Gaithersbury, United States|
Duration: Nov 2 2015 → Nov 5 2015
|Name||2015 IEEE 26th International Symposium on Software Reliability Engineering, ISSRE 2015|
|Other||26th IEEE International Symposium on Software Reliability Engineering, ISSRE 2015|
|Period||11/2/15 → 11/5/15|
Bibliographical noteFunding Information:
This work has been partially supported by NSF grant CNS-1035715.
© 2015 IEEE.