KUKU

KU ScholarWorks

  • myKU
  • Email
  • Enroll & Pay
  • KU Directory
    • Login
    View Item 
    •   KU ScholarWorks
    • Dissertations and Theses
    • Dissertations
    • View Item
    •   KU ScholarWorks
    • Dissertations and Theses
    • Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    The Impact of the Item Types and Number of Solution Steps of Multiple-Choice Items on Item Difficulty and Discrimination and Test Reliability

    Thumbnail
    View/Open
    Atalmis_ku_0099D_13305_DATA_1.pdf (1.772Mb)
    Issue Date
    2014-08-31
    Author
    Atalmis, Erkan Hasan
    Publisher
    University of Kansas
    Format
    98 pages
    Type
    Dissertation
    Degree Level
    Ed.D.
    Discipline
    Psychology & Research in Education
    Rights
    This item is protected by copyright and unless otherwise specified the copyright of this thesis/dissertation is held by the author.
    Metadata
    Show full item record
    Abstract
    This study examined two multiple choice item-writing guidelines addressed by Haladyna, Downing, and Rodriguez (2002). One is related to using the "None of the Above (NOTA)" option, the other is about the plausible number of options for a multiple-choice item (MCI). These two guidelines were empirically tested using one-step and multi-step problems to identify their impact on item characteristics (item difficulty and item discrimination) and test characteristics (test reliability). Three forms with MCIs were generated and administered to approximately 1500 7th and 8th grade students in the United States and Turkey. Bi-factor Item Response Theory (IRT) was applied to assess dimensionality related to the number of solution steps of items. Multiple regression models were employed to determine the degree of impact these item-writing guidelines had on item and test characteristics for MCIs with one step solution (MCI with one-step solution) and those with more than one step solutions (MCIs with multi-step solution). The results show that item characteristics do not change significantly across the conventional MCIs with four options, MCIs with three options, and MCIs with NOTA option. The interaction between solution steps and the three MCI types had no significant impact on item characteristics. For the test with MCIs with a one-step solution, the findings demonstrate that four options are significantly more reliable than the NOTA options and not statistically different from three options. For the test with MCIs with multi-step solutions, four options are not statistically different from three and NOTA options. Compared to MCIs with four options, the results support that MCIs with NOTA options are preferable for MCIs with multi-step solutions while three options are desirable for both MCIs with one-step solutions and multi-step solutions.
    URI
    http://hdl.handle.net/1808/15160
    Collections
    • Education Dissertations and Theses [1068]
    • Dissertations [4472]

    Items in KU ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.


    We want to hear from you! Please share your stories about how Open Access to this item benefits YOU.


    Contact KU ScholarWorks
    785-864-8983
    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    785-864-8983

    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    Image Credits
     

     

    Browse

    All of KU ScholarWorksCommunities & CollectionsThis Collection

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    Contact KU ScholarWorks
    785-864-8983
    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    785-864-8983

    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    Image Credits
     

     

    The University of Kansas
      Contact KU ScholarWorks
    Lawrence, KS | Maps
     
    • Academics
    • Admission
    • Alumni
    • Athletics
    • Campuses
    • Giving
    • Jobs

    The University of Kansas prohibits discrimination on the basis of race, color, ethnicity, religion, sex, national origin, age, ancestry, disability, status as a veteran, sexual orientation, marital status, parental status, gender identity, gender expression and genetic information in the University’s programs and activities. The following person has been designated to handle inquiries regarding the non-discrimination policies: Director of the Office of Institutional Opportunity and Access, IOA@ku.edu, 1246 W. Campus Road, Room 153A, Lawrence, KS, 66045, (785)864-6414, 711 TTY.

     Contact KU
    Lawrence, KS | Maps