Gender differential item functioning in polytomous items: A comparison of three method

Citation:

Consuelo Chua, Jose Pedrajita, and Kevin Carl Santos. 7/2018. “Gender differential item functioning in polytomous items: A comparison of three method.” Educational Measurement and Evaluation Review, 9, 1, Pp. 45-67. Publisher's Version

Abstract:

The present study compared the consistency of the results of three nonparametric differential item functioning (DIF) techniques – the Cumulative Common Log-Odds Ratio (CCLOR), Standardized Mean Difference (SMD), and the Mantel Test (Mantel) in detecting gender DIF in the Emotional Quotient Scale – College Version. The sample comprised 1,229 college students (male = 657; women= 572) from a state university in the Philippines. The agreement of the DIF methods was determined using classification consistency and matching percentages. Results show that CCLOR and Mantel agreed perfectly in detecting gender DIF items. SMD, on the other hand, had a moderate to high agreement with the two other DIF techniques. The agreement among the DIF methods was lower when DIF effect size was considered.