Abstract
The present paper shows how to evaluated invariance using confirmatory factor analysis models for means and covariances (CFA-MACS) for categorical data and models of Item Response Theory (IRT). Invariance analysis in the study of Detection Scale Generalized Anxiety Disorder comparing men and women is exemplified. The scale is widely used in health institutions and by its nature (a brief scale of 12 dichotomous items) any measurement error can have a major impact. Results have shown that the scale has the same configuration, but the item 9 shows differential item functioning, being males more likely to respond affirmatively compared to women in the same trait level. The need for this type of analysis on the scales is discussed.
References
AERA-APA-NCME. (1999). Standards for educational and psychological testing. Washington, DC.: American Psychological Association.
Akaike, H. (1974). A new look at statistical model identification. Transactios on Automatic Control. AC-19.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed. ed.). Washington, DC: Author.
Argyropoulos, S., Ploubidis, G., Wright, T., Palm, M., Hood, S., Nash, J., Potokar, J. (2007). Development and validation of the generalized anxiety disorder inventory (GADI). Journal of Psycholpharmacology, 21, 145-152.
Bobes, J., García-Calvo, C., García-García, M., & Rico-Villademoros, F. (2006). Propiedades psicométricas de la versión española de la Escala de Detección del Trastorno de Ansiedad Generalizada según DSM-IV de Carroll y DAvidson. Actas Españolas de Psiquiatría, 34, 83-93.
Bollen, K., & Long, J. (1993). Introduction. En K. Bollen, & J. Long, Testing structural equation models (págs. 1-9). Newbury Park, CA.: SAGE.
Borsboom, D., Romeijn, J., & Wicherts, J. (2008). Measurement invariance versus selection invariance: Is fair selection possible? Psychological Methods, 13, 75-97.
Camilli, G., & Shepard, L. A. (1994). Methods for identigying biased test items. Thousand Oaks, CA: Sage publications.
Carroll, B. J., & Davidson, J. R. (2000). Screening Scale for DSM-IV GAD. Copyright.
Cheung, G., & Rensvold, R. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
Elosua, P. (2005). Evaluación progresiva de la invarianza factorial entre las versiones original y adaptada de una escala de autoconcepto. Psicothema, 17(2), 356-362.
Fidalgo, A. (1996). Funcionamiento diferencial de los ítems. En J. Muñiz, Psicometría (págs. 370-455). Madrid: Universitas.
Finch, W., & French, B. (2007). Detection of Crossing Differential Item Functioning: a comparison of four methods. Educational and psychological Measurement, 67(4), 565-582.
Gonzalez-Betanzos, F. (2011). Funcionamiento Diferencial del Ítem en Test Adaptativos Informatizados. Tesis del doctorado. Madrid: Universidad Autónoma de Madrid.
Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
Jöreskog, K. (1971). Simultaneous factor analysis en several populations. Psychometrika, 36, 409-426.
Jöreskog, K., & Sörbom, D. (1993). LISREL 8: user´s guide. Chicago: Scientific Software International.
Lubke, G., & Muthen, B. (2004). Applying multigroup confirmatory factor models for continuos outcomes to Likert scale data complicates meaninful group comparison. Structural Equation Modeling, 11, 514-534.
Martínez-Arias, R., Hernández-Lloreda, M., & Hernández-Lloreda, M. (2006). Psicometría. Madrid: Alianza Editorial.
Medina-Mora, M. E., Borges, G., Lara-Muñoz, C., Benjet, C., Blanco-Jaimes, J., Bautista, C., . . . Aguilar-Gaxiola, S. (2003). Prevalencia de trastornos mentales y uso de servicios: Resultado de la encuesta nacional de epidemiología psiquíatrica en México. Salud Mental, 26(4), 1-16.
Mellenbergh, G. (1989). Item bias and item response theory. International Journal of Mathematical and Statistical Psychology, 24, 49-82.
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525-543.
Millsap, R., & Yun-Tein, J. (2004). Assessing Factorial Invariance in Ordered-Categorical Measures. Applied Psychological Measurement, 39(3), 479-515.
Muthen, L., & Muthen, B. (2012). Mplus user´s guide. . Los Angeles, CA.: Muthen & Muthen.
Robles, R., Varela, R., Jurado, S., & Páez, C. (2001). Versión mexicana del Inventario de Ansiedad de Beck: Propiedades psicométricas. Revista Mexicana de Psicología, 18(2), 211-218.
Shealy, R., & Stout, W. F. (1993). A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF. Psychometrika, 58, 159-194.
Thissen, D. (2001). IRTLRTDIF (version 2.02b). Chapel Hill, NC: L.L. Thustone Psychometric Laboratory.