Modeling Panelist Consistency in Bookmark Standard-Setting Studies
Issue Date
2017-12-31Author
Fitzpatrick, Joseph
Publisher
University of Kansas
Format
240 pages
Type
Dissertation
Degree Level
Ph.D.
Discipline
Psychology & Research in Education
Rights
Copyright held by the author.
Metadata
Show full item recordAbstract
The purpose of this study is to develop a psychometrics of standard-setting for the Bookmark standard-setting procedure. Using simulated and real data, the error variance of Bookmark cutscores is modeled as a function of both within-group and between-group variance. Fully Bayesian methods are then used to estimate the total error variance associated with Bookmark cutscores. The results of the study suggest that the estimates of error variance for the proposed method tend to be larger than those calculated using traditional methods. Consequently, the confidence intervals were more likely to include the “true” cutscore in the simulation study. Because the result of a standard-setting study is almost always a recommendation rather than a final cutscore, one goal is to provide policymakers with a more accurate representation of the amount of uncertainty around a panel’s recommendation.
Collections
- Dissertations [4626]
- Educational Psychology Scholarly Works [75]
Items in KU ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
We want to hear from you! Please share your stories about how Open Access to this item benefits YOU.