TY - JOUR
T1 - Construct equivalence of multiple-choice and constructed-response items
T2 - A random effects synthesis of correlations
AU - Rodriguez, Michael C.
PY - 2003
Y1 - 2003
N2 - A thorough search of the literature was conducted to locate empirical studies investigating the trait or construct equivalence of multiple-choice (MC) and conslructed-response (CR) items. Of the 67 studies identified, 29 studies included 56 correlations between items in both formats. These 56 correlations were corrected for attenuation and synthesized to establish evidence for a common estimate of correlation (true-score correlations). The 56 disattenuated correlations were highly heterogeneous. A search for moderators to explain this variation uncovered the role of the design characteristics of test items used in the studies. When items are constructed in both formats using the same stem (stem equivalent), the mean correlation between the two formats approaches unity and is significantly higher than when using non-stem-equivalent items (particularly when using essay-type items). Construct equivalence, in part, appears to be a function of the item design method or the item writer's intent.
AB - A thorough search of the literature was conducted to locate empirical studies investigating the trait or construct equivalence of multiple-choice (MC) and conslructed-response (CR) items. Of the 67 studies identified, 29 studies included 56 correlations between items in both formats. These 56 correlations were corrected for attenuation and synthesized to establish evidence for a common estimate of correlation (true-score correlations). The 56 disattenuated correlations were highly heterogeneous. A search for moderators to explain this variation uncovered the role of the design characteristics of test items used in the studies. When items are constructed in both formats using the same stem (stem equivalent), the mean correlation between the two formats approaches unity and is significantly higher than when using non-stem-equivalent items (particularly when using essay-type items). Construct equivalence, in part, appears to be a function of the item design method or the item writer's intent.
UR - http://www.scopus.com/inward/record.url?scp=0037697027&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0037697027&partnerID=8YFLogxK
U2 - 10.1111/j.1745-3984.2003.tb01102.x
DO - 10.1111/j.1745-3984.2003.tb01102.x
M3 - Article
AN - SCOPUS:0037697027
SN - 0022-0655
VL - 40
SP - 163
EP - 184
JO - Journal of Educational Measurement
JF - Journal of Educational Measurement
IS - 2
ER -