Using Noncompensatory Models in Cognitive Diagnostic Mathematics Assessments: An Evaluation Based on Empirical Data
View/ Open
Issue Date
2013-08-31Author
Zhao, Fei
Publisher
University of Kansas
Format
181 pages
Type
Dissertation
Degree Level
Ph.D.
Discipline
Psychology & Research in Education
Rights
This item is protected by copyright and unless otherwise specified the copyright of this thesis/dissertation is held by the author.
Metadata
Show full item recordAbstract
The present study evaluates the performance of four noncompensatory cognitive diagnostic models -- AHM, DINA, Fusion, and Bayesian Networks -- using both formative and large-scale mathematics assessments (Fraction dataset, TIMSS dataset, and Slope dataset). The author describes the four models in terms of their parameter estimation results and global model-fit conditions, respectively. With regard to the latter, the posterior predictive model checking technique with the number-correct score serves as the discrepancy measure. The author describes model reliability within the Cognitive Diagnostic Modeling framework via the correct classification rate and test-retest consistency rate. Moreover, the author contrasts the DINA, Fusion, and Bayesian Networks model in terms of the discrimination of examinees at different mastery levels on each of the skills indicated by the Q-matrix. Ultimately, the results of examinee classification on individual bases for each of the model pairs are presented. Results of this study suggest: (1) the Attribute Hierarchy Model is better at classifying students when theoretical predictions about attribute dependencies are specified a priori. (2) Even though the DINA model is considered as a simple CDM, it can provide a greater degree of information regarding student classification for certain dataset. (3) The Fusion Model can better fit on the Fraction and TIMSS dataset, and the computation cost was lower than anticipated. (4) While the Bayesian Networks approach proved a flexible technique, it was superior with respect to fit and model interpretation on the Slope dataset and Fraction dataset within this study.
Collections
- Dissertations [4700]
- Education Dissertations and Theses [1065]
Items in KU ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
We want to hear from you! Please share your stories about how Open Access to this item benefits YOU.