Hostname: page-component-78c5997874-mlc7c Total loading time: 0 Render date: 2024-11-13T00:36:28.009Z Has data issue: false hasContentIssue false
  • English
  • Français

Validation of a Questionnaire for Personality Profiling using Cognitive Diagnostic Modeling

Published online by Cambridge University Press:  03 December 2018

Javier Revuelta Open the ORCID record for Javier Revuelta [Opens in a new window] ,
Lucia Halty  and
Carmen Ximénez
Javier Revuelta*
Affiliation:
Universidad Autónoma de Madrid (Spain)
Lucia Halty
Affiliation:
Universidad Pontificia Comillas (Spain)
Carmen Ximénez
Affiliation:
Universidad Autónoma de Madrid (Spain)
*
*Correspondence concerning this article should be addressed to Javier Revuelta. Universidad Autónoma de Madrid. Facultad de Psicología. Departamento de Psicología Social y Metodología. 28049 Madrid (Spain). E-mail: javier.revuelta@uam.es
Get access Rights & Permissions [Opens in a new window]

Abstract

This article describes the development of the ENCUIST (Extroversion, Neuroticism, Callous-Unemotional, Instability, Short-Test) questionnaire, which has been created to provide a personality profiling method based on a cognitive diagnostic modeling framework. The ENCUIST measures the attributes of extroversion, neuroticism, callous unemotionality and overt expressions of anger that are relevant in a forensic context. The scores provided by the ENCUIST are binary classifications of the individuals (high/low) in these attributes. The ENCUIST was developed using a sample of 516 subjects to study its validation through psychometric procedures, including factor analysis, cognitive diagnostic modeling and structural equation modeling. The results supported a four-factor structure. Linear regressions were used to evaluate the predictive validity of the scores provided by ENCUIST with respect to two external criteria that are relevant in the forensic context, namely behavioral activation and behavioral inhibition. The results showed that the extroversion dimension is positively related to behavioral activation, although the effect size is modest and the proportion of explained variance is only 11%. Moreover, the dimensions of neuroticism and anger expression are positively related to behavioral inhibition, with 7% of the variance explained. Together, these results suggest that cognitive diagnostic models are useful tools for the elaboration of personality profiles based on classifying subjects along binary attributes.

Keywords

Cognitive Diagnostic Modelsfactor analysisforensic profilingpersonality profilestructural equation models
Type
Research Article
Information
The Spanish Journal of Psychology , Volume 21 , 2018 , E63
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This work was supported by Grant PSI2015-66366-P from the Spanish Ministerio de Ecomomía y Competitividad. The data were analyzed using the resources of the Centro de Computación Científica of the Universidad Autónoma de Madrid (CCC, https://www.ccc.uam.es).

How to cite this article:

Revuelta, J., Halty, L., & Ximénez, C. (2018). Validation of a Questionnaire for Personality Profiling using Cognitive Diagnostic Modeling. The Spanish Journal of Psychology, 21. e63. Doi:10.1017/sjp.2018.62

References

Barbour, K. A., Eckhardt, C. I., Davison, G. C., & Kassinove, H. (1998). The experience and expression of anger in maritally violent and maritally discordant-nonviolent men. Behavior Therapy, 29, 173–191. https://doi.org/10.1016/S0005-7894(98)80001-4CrossRefGoogle Scholar
Baron, K. G., Smith, T. W., Butner, J., Nealey-Moore, J., Hawkins, M. W., & Uchino, B. N. (2007). Hostility, anger, and marital adjustment: Concurrent and prospective associations with psychosocial vulnerability. Journal of Behavioral Medicine, 30, 1–10. https://doi.org/10.1007/s10865-006-9086-zCrossRefGoogle ScholarPubMed
Blair, R. J. R., Colledge, E., Murray, L., & Mitchell, D. G. (2001). A selective impairment in the processing of sad and fearful expressions in children with psychopathic tendencies. Journal of Abnormal Child Psychology, 29, 491–498. https://doi.org/10.1023/A:1012225108281CrossRefGoogle ScholarPubMed
Blair, R. J. R., Mitchell, D. G. V., Peschardt, K. S., Colledge, E., Leonard, R. A., Shine, J. H., … Perret, D. I. (2004). Reduced sensitivity to other’s fearful expressions in psychopathic individuals. Personality and Individual Differences, 37, 1111–1122. https://doi.org/10.1016/j.paid.2003.10.008CrossRefGoogle Scholar
Carver, C. S., & White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS scales. Journal of Personality and Social Psychology, 67, 319–333. https://doi.org/10.1037/0022-3514.67.2.319CrossRefGoogle Scholar
Chen, J., & de la Torre, J. (2013). A general cognitive diagnostic model for expert-defined polytomous attributes. Applied Psychological Measurement, 37, 419–437. https://doi.org/10.1177/0146621613479818CrossRefGoogle Scholar
Corr, P. J. (2010). The psychoticism–psychopathy continuum: A neuropsychological model of core deficits. Personality and Individual Differences, 48, 695–703. https://doi.org/10.1016/j.paid.2009.12.023CrossRefGoogle Scholar
Costa, P., & McCrae, R. (2008). Revised Neo Personality Inventory. In Boyle, G. J., Matthews, G., & Saklofske, D. H. (Eds.), The SAGE handbook of personality theory and assessment (Vol. 2). Thousand Oaks, CA: SAGE.Google Scholar
de la Torre, J. (2009). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115–130. https://doi.org/10.3102/1076998607309474CrossRefGoogle Scholar
de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76, 179–199. https://doi.org/10.1007/s11336-011-9207-7CrossRefGoogle Scholar
de la Torre, J., & Chiu, C.-Y. (2016). A general method of empirical Q-matrix validation. Psychometrika, 81(2), 253–272. https://doi.org/10.1007/s11336-015-9467-8CrossRefGoogle ScholarPubMed
de la Torre, J., van der Ark, L. A., & Rossi, G. (2015). Analysis of clinical data from cognitive diagnostic modeling framework. Measurement and Evaluation in Counseling and Development, 48, 1–16. https://doi.org/10.1177/0748175615569110Google Scholar
Embretson, S. (1984). A general latent trait model for response processes. Psychometrika, 49, 175–186. https://doi.org/10.1007/BF02294171CrossRefGoogle Scholar
Eysenck, H. (1952). The scientific study of personality. Oxford, UK: Macmillan.Google Scholar
Fabrigar, L. R., & Wegener, D. T. (2011). Exploratory factor analysis. New York, NY: Oxford University Press.CrossRefGoogle Scholar
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491. https://doi.org/10.1037/1082-989X.9.4.466CrossRefGoogle ScholarPubMed
Frick, P. J., & White, S. F. (2008). Research review: The importance of callous-unemotional traits for developmental models of aggressive and antisocial behavior. Journal of Child Psychology and Psychiatry, 49, 359–375. https://doi.org/10.1111/j.1469-7610.2007.01862.xCrossRefGoogle ScholarPubMed
García, P. E., Olea, J., & de la Torre, J. (2014). Application of cognitive diagnostic models to competency-based situational judgment tests. Psicothema, 26, 372–377. https://doi.org/10.7334/psicothema2013.322Google ScholarPubMed
George, A. C., Robitzsch, A., Kiefer, T., Groß, J., & Ünlü, A. (2016). The R Package CDM for cognitive diagnostic models. Journal of Statistical Software, 74, 1–24. https://doi.org/10.18637/jss.v074.i02CrossRefGoogle Scholar
Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48, 26–34. https://doi.org/10.1037/0003-066x.48.1.26CrossRefGoogle ScholarPubMed
Gray, J. A. (1970). The psychophysiological basis of introversion-extraversion. Behavior Research & Therapy, 8, 249–266. https://doi.org/10.1016/0005-7967(70)90069-0CrossRefGoogle ScholarPubMed
Haslam, N., Holland, E., & Kuppens, P. (2012). Categories versus dimensions in personality and psychopathology: A quantitative review of taxometric research. Psychological Medicine, 42, 903–920. https://doi.org/10.1017/S0033291711001966CrossRefGoogle ScholarPubMed
Heym, N., & Lawrence, C. (2010). The role of Gray’s revised RST in the P–psychopathy continuum: The relationships of psychoticism with a lack of fear and anxiety, and increased impulsivity. Personality and Individual Differences, 49, 874–879. https://doi.org/10.1016/j.paid.2010.07.021CrossRefGoogle Scholar
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185. https://doi.org/10.1007/BF02289447CrossRefGoogle ScholarPubMed
Jasisnki, M. J., Lumley, M. A., Latsch, D., Schuster, E., Kinner, E., & Burns, J. W. (2016). Assessing anger expression: Construct validity of three emotion expression-related measures. Journal of Personality Assessment, 98, 640–648. https://doi.org/10.1080/00223891.2016.1178650Google Scholar
Lievaart, M., van der Veen, F., Huijding, J., Naeije, L., Hovens, J., & Franken, I. (2016). Trait anger in relation to neural and behavioral correlates of response inhibition and error-processing. International Journal of Psychophysiology, 99, 40–47. https://doi.org/10.1016/j.ijpsycho.2015.12.001CrossRefGoogle ScholarPubMed
Ma, W., & de la Torre, J. (2018). GDINA: The generalized DINA model framework, R package version 2.0. [Computer software]. Retrieved from https://CRAN.R-project.org/package=GDINAGoogle Scholar
Maris, E. (1999). Estimating multiple classification latent class models. Psychometrika, 64, 187–212. https://doi.org/10.1007/BF02294535CrossRefGoogle Scholar
Matthews, G., & Gilliland, K. (1999). The personality theories of H. J. Eysenck and J. A. Gray: A comparative review. Personality and Individual Differences, 26, 583–626.CrossRefGoogle Scholar
Meyer, T. D., & Hofmann, B. U. (2005). Assessing the dysregulation of the behavioral activation system: The hypomanic personality scale and the BIS-BAS scales. Journal of Personality Assessment, 85, 318–324. https://doi.org/10.1207/s15327752jpa8503_08CrossRefGoogle ScholarPubMed
Newman, J. P., MacCoon, D. G., Vaughn, L. J., & Sadeh, N. (2005). Validating a distinction between primary and secondary psychopathy with measures of Gray’s BIS and BAS constructs. Journal of Abnormal Psychology, 114, 319–323. https://doi.org/10.1037/0021-843X.114.2.319CrossRefGoogle ScholarPubMed
R Core Team (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing [Computer software]. Vienna, Austria. Retrieved from http://www.R-project.org/Google Scholar
Ravand, H., & Robitzsch, A. (2015). Cognitive diagnostic modeling using R. Practical Assessment, Research & Evaluation, 20, 1–12.Google Scholar
Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552–566. https://doi.org/10.1037/0033-2909.114.3.552CrossRefGoogle ScholarPubMed
Robitzsch, A., Kiefer, T., George, A. C., & Uenlue, A. (2017). CDM: Cognitive diagnostic modeling. R package version 6.0–101. [Computer software]. Retrieved from https://CRAN.R-project.org/package=CDMGoogle Scholar
Roose, A., Bitjttebier, P., Decoene, S., Claes, L., & Frick, P. (2009). Assessing the affective features of psychopathy in adolescence: A further validation of the inventory of callous and unemotional traits. Assessment, 17, 44–57. https://doi.org/10.1177/1073191109344153CrossRefGoogle ScholarPubMed
Rosseel, Y. (2012). Iavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48 (2), 1–36. https://doi.org/10.18637/jss.v048.i02CrossRefGoogle Scholar
Smith, T. W, Glazer, K., Ruiz, J. M., & Gallo, L. C. (2004). Hostility, anger, aggressiveness, and coronary heart disease: An interpersonal perspective on personality, emotion, and health. Journal of Personality, 72, 1217–1270. https://doi.org/10.1111/j.1467-6494.2004.00296.xCrossRefGoogle Scholar
Sorrel, M. A., Olea, J., Abad, F. J., de la Torre, J., Aguado, D., & Lievens, F. (2016). Validity and reliability of situational judgement test scores: A new approach based on cognitive diagnostic models. Organizational Research Methods, 19, 506–532. https://doi.org/10.1177/1094428116630065CrossRefGoogle Scholar
Spielberger, C. D. (1988). Manual for the State-Trait Anger Expression Inventory. Odessa, FL: Psychological Assessment Resources.Google Scholar
Tatsuoka, K. (1985). A probabilistic model for diagnosing misconceptions in the pattern classification approach. Journal of Educational Statistics, 12, 55–73. https://doi.org/10.2307/1164930CrossRefGoogle Scholar
Webster, G. D., DeWall, C. N., Pond, R. S. Jr., Deckman, T., Jonason, P. K., Le, B. M., … Bator, R. J. (2015). The brief aggression questionnaire: Structure, validity, reliability and generalizability. Journal of Personality Assessment, 97, 638–649, https://doi.org/10.1080/00223891.2015.1044093CrossRefGoogle ScholarPubMed