TY - JOUR
T1 - An Information Matrix Test for the Collapsing of Categories Under the Partial Credit Model
AU - Harel, Daphna
AU - Steele, Russell J.
N1 - Funding Information:
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Dr. Harel’s work is funded by NYU start-up research funds. Dr. Steele’s work was funded by a Discovery Grant from the Natural Sciences and Engineering Research Council of Canada (NSERC).
Publisher Copyright:
© 2018 AERA.
PY - 2018/12/1
Y1 - 2018/12/1
N2 - Collapsing categories is a commonly used data reduction technique; however, to date there do not exist principled methods to determine whether collapsing categories is appropriate in practice. With ordinal responses under the partial credit model, when collapsing categories, the true model for the collapsed data is no longer a partial credit model, and therefore refitting a partial credit model may result in model misspecification. This article details the implementation and performance of an information matrix test (IMT) to assess the implications of collapsing categories for a given data set under the partial credit model and compares its performance to the application of a nominal response model (NRM) and the S − X2 goodness-of-fit statistic. The IMT and NRM-based test are able to correctly determine the true number of categories for an item, given reasonable power through this goodness-of-fit test. We conclude by applying the test to a well-studied data set from the literature.
AB - Collapsing categories is a commonly used data reduction technique; however, to date there do not exist principled methods to determine whether collapsing categories is appropriate in practice. With ordinal responses under the partial credit model, when collapsing categories, the true model for the collapsed data is no longer a partial credit model, and therefore refitting a partial credit model may result in model misspecification. This article details the implementation and performance of an information matrix test (IMT) to assess the implications of collapsing categories for a given data set under the partial credit model and compares its performance to the application of a nominal response model (NRM) and the S − X2 goodness-of-fit statistic. The IMT and NRM-based test are able to correctly determine the true number of categories for an item, given reasonable power through this goodness-of-fit test. We conclude by applying the test to a well-studied data set from the literature.
KW - collapsing categories
KW - information matrix test
KW - item response theory
KW - partial credit model
UR - http://www.scopus.com/inward/record.url?scp=85050091737&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85050091737&partnerID=8YFLogxK
U2 - 10.3102/1076998618787478
DO - 10.3102/1076998618787478
M3 - Article
AN - SCOPUS:85050091737
SN - 1076-9986
VL - 43
SP - 721
EP - 750
JO - Journal of Educational and Behavioral Statistics
JF - Journal of Educational and Behavioral Statistics
IS - 6
ER -