Better testing through oracle selection (NIER track)

Matt Staats; Michael W Whalen; Mats Heimdahl

doi:10.1145/1985793.1985936

Better testing through oracle selection (NIER track)

Matt Staats, Michael W Whalen, Mats Heimdahl

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

18 Scopus citations

Abstract

In software testing, the test oracle determines if the application under test has performed an execution correctly. In current testing practice and research, significant effort and thought is placed on selecting test inputs, with the selection of test oracles largely neglected. Here, we argue that improvements to the testing process can be made by considering the problem of oracle selection. In particular, we argue that selecting the test oracle and test inputs together to complement one another may yield improvements testing effectiveness. We illustrate this using an example and present selected results from an ongoing study demonstrating the relationship between test suite selection, oracle selection, and fault finding.

Original language	English (US)
Title of host publication	ICSE 2011 - 33rd International Conference on Software Engineering, Proceedings of the Conference
Pages	892-895
Number of pages	4
DOIs	https://doi.org/10.1145/1985793.1985936
State	Published - 2011
Event	33rd International Conference on Software Engineering, ICSE 2011 - Waikiki, Honolulu, HI, United States Duration: May 21 2011 → May 28 2011

Publication series

Name	Proceedings - International Conference on Software Engineering
ISSN (Print)	0270-5257

Other

Other	33rd International Conference on Software Engineering, ICSE 2011
Country	United States
City	Waikiki, Honolulu, HI
Period	5/21/11 → 5/28/11

Bibliographical note

Copyright:
Copyright 2011 Elsevier B.V., All rights reserved.

Keywords

empirical studies
test oracles

Access

10.1145/1985793.1985936

Fingerprint Dive into the research topics of 'Better testing through oracle selection (NIER track)'. Together they form a unique fingerprint.

Cite this

Better testing through oracle selection (NIER track). / Staats, Matt; Whalen, Michael W ; Heimdahl, Mats.

ICSE 2011 - 33rd International Conference on Software Engineering, Proceedings of the Conference. 2011. p. 892-895 (Proceedings - International Conference on Software Engineering).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Staats, M, Whalen, MW & Heimdahl, M 2011, Better testing through oracle selection (NIER track). in ICSE 2011 - 33rd International Conference on Software Engineering, Proceedings of the Conference. Proceedings - International Conference on Software Engineering, pp. 892-895, 33rd International Conference on Software Engineering, ICSE 2011, Waikiki, Honolulu, HI, United States, 5/21/11. https://doi.org/10.1145/1985793.1985936

@inproceedings{cdca63e24de34827bcaea3053706d485,

title = "Better testing through oracle selection (NIER track)",

abstract = "In software testing, the test oracle determines if the application under test has performed an execution correctly. In current testing practice and research, significant effort and thought is placed on selecting test inputs, with the selection of test oracles largely neglected. Here, we argue that improvements to the testing process can be made by considering the problem of oracle selection. In particular, we argue that selecting the test oracle and test inputs together to complement one another may yield improvements testing effectiveness. We illustrate this using an example and present selected results from an ongoing study demonstrating the relationship between test suite selection, oracle selection, and fault finding.",

keywords = "empirical studies, test oracles",

author = "Matt Staats and Whalen, {Michael W} and Mats Heimdahl",

year = "2011",

doi = "10.1145/1985793.1985936",

language = "English (US)",

isbn = "9781450304450",

series = "Proceedings - International Conference on Software Engineering",

pages = "892--895",

booktitle = "ICSE 2011 - 33rd International Conference on Software Engineering, Proceedings of the Conference",

}

TY - GEN

T1 - Better testing through oracle selection (NIER track)

AU - Staats, Matt

AU - Whalen, Michael W

AU - Heimdahl, Mats

PY - 2011

Y1 - 2011

N2 - In software testing, the test oracle determines if the application under test has performed an execution correctly. In current testing practice and research, significant effort and thought is placed on selecting test inputs, with the selection of test oracles largely neglected. Here, we argue that improvements to the testing process can be made by considering the problem of oracle selection. In particular, we argue that selecting the test oracle and test inputs together to complement one another may yield improvements testing effectiveness. We illustrate this using an example and present selected results from an ongoing study demonstrating the relationship between test suite selection, oracle selection, and fault finding.

AB - In software testing, the test oracle determines if the application under test has performed an execution correctly. In current testing practice and research, significant effort and thought is placed on selecting test inputs, with the selection of test oracles largely neglected. Here, we argue that improvements to the testing process can be made by considering the problem of oracle selection. In particular, we argue that selecting the test oracle and test inputs together to complement one another may yield improvements testing effectiveness. We illustrate this using an example and present selected results from an ongoing study demonstrating the relationship between test suite selection, oracle selection, and fault finding.

KW - empirical studies

KW - test oracles

UR - http://www.scopus.com/inward/record.url?scp=79959899445&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79959899445&partnerID=8YFLogxK

U2 - 10.1145/1985793.1985936

DO - 10.1145/1985793.1985936

M3 - Conference contribution

AN - SCOPUS:79959899445

SN - 9781450304450

T3 - Proceedings - International Conference on Software Engineering

SP - 892

EP - 895

BT - ICSE 2011 - 33rd International Conference on Software Engineering, Proceedings of the Conference

T2 - 33rd International Conference on Software Engineering, ICSE 2011

Y2 - 21 May 2011 through 28 May 2011

ER -

Better testing through oracle selection (NIER track)

Abstract

Publication series

Other

Bibliographical note

Keywords

Access

Other files and links

Cite this