TY - JOUR
T1 - Online Proctored Versus Unproctored Low-Stakes Internet Test Administration
T2 - Is There Differential Test-Taking Behavior and Performance?
AU - Rios, Joseph A.
AU - Liu, Ou Lydia
N1 - Publisher Copyright:
© 2017 Educational Testing Service.
PY - 2017/10/2
Y1 - 2017/10/2
N2 - Online higher education institutions are presented with the concern of how to obtain valid results when administering student learning outcomes (SLO) assessments remotely. Traditionally, there has been a great reliance on unproctored Internet test administration (UIT) due to increased flexibility and reduced costs; however, a number of validity concerns have led some researchers to question its implementation and results. To mitigate the limitations of UIT, a relatively new approach, referred to as online proctoring, has been developed to mirror in-person proctoring remotely by capitalizing on technology to create verifiable and secure testing conditions. This study evaluated the comparability of online proctored and unproctored test administration in a low-stakes testing context on user-friendliness, examinee behavior, and mean scores. Results demonstrated improved user-friendliness (e.g., ease of logging in); however, no significant differences were observed in terms of keystroke information, rapid guessing, or aggregated scores between proctoring conditions. Overall, these results suggest that online institutions can implement UIT, which is a cost-effective approach to test administration, and obtain valid group-level inferences from SLO assessments.
AB - Online higher education institutions are presented with the concern of how to obtain valid results when administering student learning outcomes (SLO) assessments remotely. Traditionally, there has been a great reliance on unproctored Internet test administration (UIT) due to increased flexibility and reduced costs; however, a number of validity concerns have led some researchers to question its implementation and results. To mitigate the limitations of UIT, a relatively new approach, referred to as online proctoring, has been developed to mirror in-person proctoring remotely by capitalizing on technology to create verifiable and secure testing conditions. This study evaluated the comparability of online proctored and unproctored test administration in a low-stakes testing context on user-friendliness, examinee behavior, and mean scores. Results demonstrated improved user-friendliness (e.g., ease of logging in); however, no significant differences were observed in terms of keystroke information, rapid guessing, or aggregated scores between proctoring conditions. Overall, these results suggest that online institutions can implement UIT, which is a cost-effective approach to test administration, and obtain valid group-level inferences from SLO assessments.
UR - http://www.scopus.com/inward/record.url?scp=85011600850&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85011600850&partnerID=8YFLogxK
U2 - 10.1080/08923647.2017.1258628
DO - 10.1080/08923647.2017.1258628
M3 - Article
AN - SCOPUS:85011600850
SN - 0892-3647
VL - 31
SP - 226
EP - 241
JO - American Journal of Distance Education
JF - American Journal of Distance Education
IS - 4
ER -