KUKU

KU ScholarWorks

  • myKU
  • Email
  • Enroll & Pay
  • KU Directory
    • Login
    View Item 
    •   KU ScholarWorks
    • Dissertations and Theses
    • Dissertations
    • View Item
    •   KU ScholarWorks
    • Dissertations and Theses
    • Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Unidimensional Models Do Not Fit Unidimensional Mixed Format Data Better than Multidimensional Models

    Thumbnail
    View/Open
    Montgomery_ku_0099D_13764_DATA_1.pdf (368.6Kb)
    Issue Date
    2014-12-31
    Author
    Montgomery, Melinda Sue
    Publisher
    University of Kansas
    Format
    89 pages
    Type
    Dissertation
    Degree Level
    Ph.D.
    Discipline
    Psychology & Research in Education
    Rights
    Copyright held by the author.
    Metadata
    Show full item record
    Abstract
    This dissertation examines the scaling of large scale assessments containing both dichotomous and polytomous items, mixed format assessments. Because large scale assessments are generally built to measure one construct, e.g. eighth grade mathematics, unidimensional data was generated to simulate a mixed format assessment. The test length, number of polytomous to dichotomous items per assessment and the discrimination level between dichotomous and polytomous items were varied in this study. There were five item combinations and two level of discrimination defined. The goal of this dissertation was to compare the fit of the generated data to three different Item Response Theory models; one unidimensional and two multidimensional. The first model used to fit the data was the same model type used to generate the data; a 3PL IRT model in combination with the Generalized Partial Credit model. The second model was the Hierarchical MIRT Model. The final model was the bi-factor model. The research questions examined in this study were; (1) Which of the models achieves the best model fit across simulation conditions?, and (2) Do the variables of item combination or discrimination affect the model fit? The study showed that the bi-factor model fit unidimensional data, in mixed format, better than either the unidimensional or the hierarchical MIRT models. The criterion used to make this determination was the Bayesian convergence criterions; BIC, DIC and AIC. Overall, the bi-factor model fit the unidimensional mixed format data better than the generating model fit the data. The hierarchical MIRT model did not fit the data very well, and in a few cases, did not converge. The more polytomous item included on the assessment the better the bi-factor model improved overall fit over the unidimensional model. This result suggests that noise in the data from mixed format assessments can cause the unidimensional models to fail to fail to fit the data. This study illustrates the format alone can create the appearance of dimensionality. However since the data was generated as unidimensional, this format dimensionality affect was an attribute of the data alone, not of items or examinees interactions with the items. Mixed format assessments create an artifact in the data that causes the data to factor into dimensions that are not actually present. It appears there is noise in the data of mixed format assessment that needs to accounted for when scaling.
    URI
    http://hdl.handle.net/1808/18640
    Collections
    • Education Dissertations and Theses [695]
    • Dissertations [3958]

    Items in KU ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.


    We want to hear from you! Please share your stories about how Open Access to this item benefits YOU.


    Contact KU ScholarWorks
    785-864-8983
    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    785-864-8983

    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    Image Credits
     

     

    Browse

    All of KU ScholarWorksCommunities & CollectionsThis Collection

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    Contact KU ScholarWorks
    785-864-8983
    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    785-864-8983

    KU Libraries
    1425 Jayhawk Blvd
    Lawrence, KS 66045
    Image Credits
     

     

    The University of Kansas
      Contact KU ScholarWorks
    Lawrence, KS | Maps
     
    • Academics
    • Admission
    • Alumni
    • Athletics
    • Campuses
    • Giving
    • Jobs

    The University of Kansas prohibits discrimination on the basis of race, color, ethnicity, religion, sex, national origin, age, ancestry, disability, status as a veteran, sexual orientation, marital status, parental status, gender identity, gender expression and genetic information in the University’s programs and activities. The following person has been designated to handle inquiries regarding the non-discrimination policies: Director of the Office of Institutional Opportunity and Access, IOA@ku.edu, 1246 W. Campus Road, Room 153A, Lawrence, KS, 66045, (785)864-6414, 711 TTY.

     Contact KU
    Lawrence, KS | Maps