A Two-Level Alternating Direction Model for Polytomous Items With Local Dependence

Igor Himelfarb, Katerina M. Marcoulides, Guoliang Fang, Bruce L. Shotts

Research output: Contribution to journalArticle

Abstract

The chiropractic clinical competency examination uses groups of items that are integrated by a common case vignette. The nature of the vignette items violates the assumption of local independence for items nested within a vignette. This study examines via simulation a new algorithmic approach for addressing the local independence violation problem using a two-level alternating directions testlet model. Parameter values for item difficulty, discrimination, test-taker ability, and test-taker secondary abilities associated with a particular testlet are generated and parameter recovery through Markov Chain Monte Carlo Bayesian methods and generalized maximum likelihood estimation methods are compared. To aid with the complex computational efforts, the novel so-called TensorFlow platform is used. Both estimation methods provided satisfactory parameter recovery, although the Bayesian methods were found to be somewhat superior in recovering item discrimination parameters. The practical significance of the results are discussed in relation to obtaining accurate estimates of item, test, ability parameters, and measurement reliability information.

Original languageEnglish (US)
Pages (from-to)293-311
Number of pages19
JournalEducational and Psychological Measurement
Volume80
Issue number2
DOIs
StatePublished - Apr 1 2020

    Fingerprint

Keywords

  • Bayesian methods
  • Markov Chain Monte Carlo (MCMC)
  • generalized maximum likelihood estimation (GMLE)
  • testlet response theory (TRT)
  • violation of local independence

PubMed: MeSH publication types

  • Journal Article

Cite this