Atalmis, Erkan HasanKingston, Neal Martin2018-12-122018-12-122018-02-14Atalmis, E. H., & Kingston, N. M. (2018). The Impact of Homogeneity of Answer Choices on Item Difficulty and Discrimination. SAGE Open, 8(1), 2158244018758147.https://hdl.handle.net/1808/27500This study explored the impact of homogeneity of answer choices on item difficulty and discrimination. Twenty-two matched pairs of elementary and secondary mathematics items were administered to randomly equivalent samples of students. Each item pair comparison was treated as a separate study with the set of effect sizes analyzed using meta-analysis and a moderator analysis. The results show that multiple-choice (MC) items with homogeneous answer choices tend to be easier than MC items with nonhomogeneous answer choices, but the magnitude was related to item content (algebra vs. geometry) and answer choice construction strategy. For algebra items, items with homogeneous answer choices are easier than those with nonhomogeneous answer choices. However, the difficulty of geometry items with homogeneous and nonhomogeneous is not statistically different. Taking into account answer choice construction strategy, the findings showed that items with homogeneous answer choices were easier than items with nonhomogeneous answer choices when different strategy was applied. However, the same construction strategy was applied; thus, the difficulty of items with homogeneous answer choices and nonhomogeneous answer choices was not statistically different. In addition, we found that item discrimination does not significantly change across MC items with homogeneous and nonhomogeneous answer choices.This article is distributed under the terms of the Creative Commons Attribution 4.0 License which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).https://creativecommons.org/licenses/by/4.0/Multiple-Choice itemItem-writing guidelinesHomogeneity of answer choicesTest validityMeta-AnalysisArticle10.1177/2158244018758147openAccess