Kevin Carl Santos and Jimmy de la Torre. 8/2018. “Cognitive Diagnosis Modeling: An Overview and Illustration.” In Philippine and Global Perspectives on Educational Assessment, 1: Pp. 89-110. Manila: Philippine Educational Measurement and Evaluation Association.Abstract
In conjunction with appropriately designed test, cognitive diagnosis models (CDMs) can be used to identify students’ mastery or nonmastery of skills in a domain. The diagnostic and finer-grained information from CDMs can lead to tailored instruction and remediation. In this chapter, we introduce the generalized deterministic input, noisy “and” gate (G-DINA) model as a general CDM framework. In addition to various CDM formulations, the G-DINA model framework subsumes parameter
estimation, model fit evaluation, Q-matrix validation, differential item functioning analysis, and classification accuracy estimation. Using empirically based simulated data, we illustrate how CDM analysis can be performed using the GDINA R package.
Consuelo Chua, Jose Pedrajita, and Kevin Carl Santos. 7/2018. “Gender differential item functioning in polytomous items: A comparison of three method.” Educational Measurement and Evaluation Review, 9, 1, Pp. 45-67. Publisher's VersionAbstract
The present study compared the consistency of the results of three nonparametric differential item functioning (DIF) techniques – the Cumulative Common Log-Odds Ratio (CCLOR), Standardized Mean Difference (SMD), and the Mantel Test (Mantel) in detecting gender DIF in the Emotional Quotient Scale – College Version. The sample comprised 1,229 college students (male = 657; women= 572) from a state university in the Philippines. The agreement of the DIF methods was determined using classification consistency and matching percentages. Results show that CCLOR and Mantel agreed perfectly in detecting gender DIF items. SMD, on the other hand, had a moderate to high agreement with the two other DIF techniques. The agreement among the DIF methods was lower when DIF effect size was considered.
Kevin Carl Santos and Erniel Barrios. 2017. “Improving predictive accuracy of logistic regression model using ranked set samples.” Communications in Statistics - Simulation and Computation, 46, 1, Pp. 78-90. Publisher's VersionAbstract
Logistic regression is often confronted with separation of likelihood problem, especially with unbalanced success–failure distribution. We propose to address this issue by drawing a ranked set sample (RSS). Simulation studies illustrated the advantages of logistic regression models fitted with RSS samples with small sample size regardless of the distribution of the binary response. As sample size increases, RSS eventually becomes comparable to SRS, but still has the advantage over SRS in mitigating the problem of separation of likelihood. Even in the presence of ranking errors, models from RSS samples yield higher predictive ability than its SRS counterpart.
Erniel Barrios and Kevin Carl Santos. 2017. “Spatial-temporal models and computational statistics methods: A survey.” The Philippine Statistician, 66, 1, Pp. 1-20. Publisher's VersionAbstract
We introduce panel models and identify its link to spatial-temporal models. Both models are characterized and differentiated through the variance-covariance matrix of the disturbance term. The resulting estimates or tests are as complicated as the nature of the said variance-covariance matrix. Some iterative methods typically used in computational statistics are also presented. These methods are used in conducting statistical inference for spatial-temporal models.