ATTENTION: The software behind KU ScholarWorks is being upgraded to a new version. Starting July 15th, users will not be able to log in to the system, add items, nor make any changes until the new version is in place at the end of July. Searching for articles and opening files will continue to work while the system is being updated.
If you have any questions, please contact Marianne Reed at mreed@ku.edu .
THE EFFECT OF NON-NORMALITY ON THE CUTSCORE OPERATING FUNCTION: ESTIMATION CORRECTNESS IN NON-NORMAL MONTE CARLO SIMULATIONS
dc.contributor.advisor | Poggio, John | |
dc.contributor.author | Pace, Jesse Rey | |
dc.date.accessioned | 2021-02-27T22:19:43Z | |
dc.date.available | 2021-02-27T22:19:43Z | |
dc.date.issued | 2019-12-31 | |
dc.date.submitted | 2019 | |
dc.identifier.other | http://dissertations.umi.com/ku:16835 | |
dc.identifier.uri | http://hdl.handle.net/1808/31545 | |
dc.description.abstract | Certification testing attempts to classify individuals into mutually exclusive categories, such as competent and non-competent. There is some potential for error whenever a classification decision is made as a result of a test score. The Grabovsky and Wainer cutscore operating function (GW-CSOF) is a recent addition to classification error estimates. This method allows for the prediction of error rates at all possible cutscore locations, but requires that certain assumptions about the examinee distribution are met. How the estimates made by the GW-CSOF compare to actual error values is currently unknown. Furthermore, the extent to which deviations from GW-CSOF assumptions impact error estimates is also unknown. The aim of this dissertation was to explore the extent to which non-normality of examinee true scores impacted the correctness of the GW-CSOF estimates. Monte Carlo methods were used to generate true score samples with systematically increased non-normality, and GW-CSOF estimates were compared to actual error rates. Findings indicated that GW-CSOF produced good estimates of error rates and optimal cutscore location in truly normal and minimally non-normal simulations. The degree to which GW-CSOF produced incorrect estimates was significantly correlated with the degree of non-normality. Specific guidelines for standard setting are discussed. | |
dc.format.extent | 135 pages | |
dc.language.iso | en | |
dc.publisher | University of Kansas | |
dc.rights | Copyright held by the author. | |
dc.subject | Educational psychology | |
dc.subject | classification error | |
dc.subject | cutscore operating function | |
dc.subject | cutscores | |
dc.subject | monte carlo methods | |
dc.subject | standard setting | |
dc.title | THE EFFECT OF NON-NORMALITY ON THE CUTSCORE OPERATING FUNCTION: ESTIMATION CORRECTNESS IN NON-NORMAL MONTE CARLO SIMULATIONS | |
dc.type | Dissertation | |
dc.contributor.cmtemember | Patterson, Meagan | |
dc.contributor.cmtemember | Peyton, Vicki | |
dc.contributor.cmtemember | Reynolds, Matthew | |
dc.contributor.cmtemember | Rice, Suzanne | |
dc.thesis.degreeDiscipline | Psychology & Research in Education | |
dc.thesis.degreeLevel | Ph.D. | |
dc.identifier.orcid | https://orcid.org/0000-0003-3961-5718 | |
dc.rights.accessrights | openAccess |
Files in this item
This item appears in the following Collection(s)
-
Dissertations [4889]
-
Educational Psychology Scholarly Works [75]