Hostname: page-component-586b7cd67f-2plfb Total loading time: 0 Render date: 2024-11-22T14:08:15.924Z Has data issue: false hasContentIssue false

A New Approach for Differential Item Functioning Detection Using Mantel-Haenszel Methods. The GMHDIF Program

Published online by Cambridge University Press:  10 January 2013

Ángel M. Fidalgo*
Affiliation:
Universidad de Oviedo (Spain)
*
Correspondence concerning this article should be addressed to Ángel M. Fidalgo. Departamento de Psicología, Universidad de Oviedo, Plaza de Feijoo s/n, 33003 Oviedo (Spain). E-mail: fidalgo@uniovi.es

Abstract

To date, the statistical software designed for assessing differential item functioning (DIF) with Mantel-Haenszel procedures has employed the following statistics: the Mantel-Haenszel chi-square statistic, the generalized Mantel-Haenszel test and the Mantel test. These statistics permit detecting DIF in dichotomous and polytomous items, although they limit the analysis to two groups. On the contrary, this article describes a new approach (and the related software) that, using the generalized Mantel-Haenszel statistic proposed by Landis, Heyman, and Koch (1978), permits DIF assessment in multiple groups, both for dichotomous and polytomous items. The program is free of charge and is available in the following languages: Spanish, English and Portuguese.

Hasta la fecha, los programas informáticos diseñados específicamente para detectar el funcionamiento diferencial de los ítems (DIF) usando los métodos Mantel-Haenszel han empleado los siguientes estadísticos: el estadístico ji-cuadrado de Mantel-Haenszel, el test generalizado de Mantel-Haenszel y el test de Mantel. El presente artículo describe una nueva aproximación (y el software correspondiente) que permite evaluar el DIF en múltiples grupos, tanto en ítems dicotómicos como politómicos, empleando el estadístico generalizado de Mantel-Haenszel propuesto por Landis, Heyman, and Koch (1978). El programa es gratuito y está disponible en español, inglés y portugués.

Type
Research Article
Copyright
Copyright © Cambridge University Press 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Fidalgo, A. M. (1994). MHDIF: A computer program for detecting uniform and nonuniform differential item functioning with the Mantel-Haenszel procedure. Applied Psychological Measurement, 18, 300. doi:10.1177/014662169401800313CrossRefGoogle Scholar
Fidalgo, A. M. (1996). Funcionamiento diferencial de los ítems [Differential item functioning]. In Muñiz, J. (Ed.), Psicometría (pp. 371455). Madrid, Spain: Universitas.Google Scholar
Fidalgo, A. M. (2005a). Mantel-Haenszel Methods. In Everitt, B. S. & Howell, D. C. (Eds.), Encyclopedia of Statistics in Behavioral Science (Vol. 3, pp. 11201126). Chichester, UK: John Wiley & Sons. doi:10.1002/0470013192.bsa364Google Scholar
Fidalgo, A. M. (2005b). Enfoque de la teoría de respuesta a los ítems [Item response theory framework ]. In Muñiz, J., Fidalgo, A. M., García-Cueto, M. A., Martínez, R., & Moreno, R. (Eds.), Análisis de los ítems (pp. 79131). Madrid, Spain: La Muralla.Google Scholar
Fidalgo, A. M. (2010). GMHDIF: User's Manual. Oviedo, Spain: Universidad de Oviedo.Google Scholar
Fidalgo, A. M. (2011). GMHDIF: A computer program for detecting DIF in dichotomous and polytomous items using generalized Mantel-Haenszel Statistics. Applied Psychological Measurement, 35, 247249. doi:10.1177/0146621610375691CrossRefGoogle Scholar
Fidalgo, A. M., & Bartram, D. (2010). A comparison between some generalized Mantel-Haenszel statistics for detecting DIF in data simulated under the graded response model. Applied Psychological Measurement, 34, 600606. doi:10.1177/0146621610378405CrossRefGoogle Scholar
Fidalgo, A. M., & Madeira, J. M. (2008). Generalized Mantel-Haenszel methods for DIF detection. Educational and Psychological Measurement, 68, 940958. doi:10.1177/0013164408315265CrossRefGoogle Scholar
Fidalgo, A. M., & Scalon, J. D. (2010). Using Generalized Mantel-Haenszel Statistics to Assess DIF among Multiple Groups. Journal of Psychoeducational Assessment, 28, 6069. doi:10.1177/0734282909337302CrossRefGoogle Scholar
Fidalgo, A. M., Quintanilla, L., Fernández, R., Pons, F., & Aguerri, M. E. (2010). Detección del DIF en ítems politómicos mediante el uso de los métodos Mantel-Haenszel [Mantel-Haenszel methods for DIF detection in polytomous items]. Revista Española de Metodología Aplicada, 15, 1218.Google Scholar
Holland, W. P., & Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In Wainer, H. & Braun, H. I. (Eds.), Test validity (pp. 129145). Hillsdale, NJ: LEA.Google Scholar
Kim, S. H., Cohen, A. H., & Park, T.-H. (1995). Detection of differential item functioning in multiple groups. Journal of Educational Measurement, 32, 261276. doi:10.1111/j.1745-3984.1995.tb00466.xCrossRefGoogle Scholar
Landis, J. R., Heyman, E. R., & Koch, G. G. (1978). Average partial association in three-way contingency tables: A review and discussion of alternative tests. International Statistical Review, 46, 237254.CrossRefGoogle Scholar
Mantel, N. (1963). Chi-square tests with one degree of freedom; extension of the Mantel-Haenszel procedure. Journal of the American Statistical Association, 58, 690700.Google Scholar
Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719748.Google ScholarPubMed
Penfield, R. D. (2005). DIFAS: Differential Item Functioning Analysis System. Computer Program Exchange. Applied Psychological Measurement, 29, 150151. doi:10.1177/0146621603260686CrossRefGoogle Scholar
SAS Institute (2002). SAS/STAT software: Version 9.0 (TS M0). Cary, NC: SAS Institute Inc.Google Scholar
SPSS for Windows, Rel. 16.0.0 (2007). Chicago, IL: SPSS Inc.Google Scholar
Stokes, M. E., Davis, C. S., & Koch, G. G. (2000). Categorical data analysis using the SAS system. (2nd ed.). Cary, NC: SAS Institute.Google Scholar
Zwick, R., Donoghue, J. R., & Grima, A. (1993). Assessment of differential item functioning for performance tasks. Journal of Educational Measurement, 30, 233251. doi:10.1111/j.1745-3984.1993.tb00425.xCrossRefGoogle Scholar