Hostname: page-component-848d4c4894-x5gtn Total loading time: 0 Render date: 2024-06-01T18:05:03.671Z Has data issue: false hasContentIssue false

Measuring dispositional empathy in South African children

Published online by Cambridge University Press:  25 April 2024

Susan Malcolm-Smith*
Affiliation:
Applied Cognitive Science and Experimental Neuropsychology Team, Department of Psychology, University of Cape Town, Cape Town, South Africa Neuroscience Institute, University of Cape Town, Cape Town, South Africa
Lea-Ann Pileggi
Affiliation:
Applied Cognitive Science and Experimental Neuropsychology Team, Department of Psychology, University of Cape Town, Cape Town, South Africa
Raphaella Lewis
Affiliation:
Applied Cognitive Science and Experimental Neuropsychology Team, Department of Psychology, University of Cape Town, Cape Town, South Africa
*
Corresponding author: Susan Malcolm-Smith; Email: Susan.Malcolm-Smith@uct.ac.za
Rights & Permissions [Opens in a new window]

Abstract

Objective:

Empathy is a key factor to examine in development, because of its predictive associations with both aggression and successful prosocial behaviour. However, established measures of empathy for Low-to-Middle Income Countries, including South Africa, are lacking. In children, parent-report measures are key. However, a local study examining empathy and aggression (Malcolm-Smith et al., 2015) found poor psychometric performance for a widely used parent-report measure of dispositional empathy, the Griffith Empathy Measure (GEM). We thus investigated which of two questionnaires measuring dispositional cognitive and affective empathy perform better in this context.

Method:

We contrasted internal consistency reliability of a simplified version of the GEM (SGEM; n = 160) and a parent-report version of the Questionnaire of Cognitive and Affective Empathy (QCAE; n = 440) in a low-mid socio-economic status sample. Convergence between the measures and factor structure were also assessed.

Results:

The parent-report version of the QCAE performed well as a measure of child dispositional cognitive and affective empathy, with good reliability (overall α = 0.90 vs. SGEM α = .63), and confirmatory factor analysis supporting the two-factor structure. The SGEM’s reliability and failure to correlate with QCAE indicated poor psychometric performance.

Conclusion:

This is the first psychometric evaluation of the QCAE as a parent-report measure, and our results indicate that it should prove useful for future assessments of dispositional empathy in children across a variety of contexts.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of Scandinavian College of Neuropsychopharmacology

Significant outcomes

  • The simplified GEM did not evidence adequate reliability, and the questionnaire and its subscale scores did not converge with the QCAE total or subscale scores, indicating questionable validity.

  • The QCAE performed well, with good reliability and CFA confirming the important two-factor structure (cognitive and affective empathy subscales) in this non-WEIRD sample.

  • The parent-report version of the QCAE should be a useful measure of child dispositional empathy for LMIC contexts.

Limitations

  • The original five-factor structure of the QCAE was not supported – the peripheral responsivity scale (as in other studies) did not emerge.

  • The sample was urban and schooled in English. Findings from rural populations and translated versions would be valuable.

  • External validation of the QCAE for this context remains to be established.

Introduction

The examination of empathy in development is important for a number of reasons. Empathic skills facilitate successful social interactions and relationships (Eisenberg & Fabes, Reference Eisenberg and Fabes1990; Zahn-Waxler et al., Reference Zahn-Waxler, Radke-Yarrow, Wagner and Chapman1992; Decety & Cowell, Reference Decety and Cowell2014). In contrast, deficits in empathy contribute to significant individual and societal problems. A substantial body of research in High Income Countries (HICs) has demonstrated an important association between reduced levels of empathy and higher levels of aggressive and antisocial behaviour (Miller & Eisenberg, Reference Miller and Eisenberg1998; de Wied et al., Reference de Wied, Goudena and Matthys2005; de Kemp et al., Reference de Kemp, Overbeek, de Wied, Engels and Scholte2007; van Langen et al., Reference van Langen, Wissink, van Vugt, van der Stouwe and Stams2014; van Hazebroek et al., Reference van Hazebroek, Olthof and Goossens2017; Gantiva et al., Reference Gantiva, Cendales, Diaz and Gonzalez2021). Moreover, an early onset developmental trajectory has been identified, where early manifestations of aggression are followed by later delinquency, aggression, criminality, and in some cases, psychopathy (Farrington, Reference Farrington1989; Moffitt, Reference Moffitt1993; Broidy et al., Reference Broidy, Nagin, Tremblay, Bates, Brame, Dodge, Fergusson, Horwood, Loeber, Laird, Lynam, Moffitt, Pettit and Vitaro2003; Jones et al., Reference Jones, Happe, Gilbert, Burnett and Viding2010; Dadds et al., Reference Dadds, Allen, Oliver, Faulkner, Legge, Moul, Woolgar and Scott2012; Pingault et al., Reference Pingault, Cote, Lacourse, Galera, Vitaro and Tremblay2013; Robertson et al., Reference Robertson, Frick, Ray, Thornton, Wall Myers, Steinberg and Cauffman2018). Deficiencies in empathy are an important intra-individual risk factor for the development of such problematic behaviour and personality traits. Examining empathy in children is consequently key in order to identify its role and design interventions to disrupt potentially negative trajectories.

This line of investigation is particularly relevant in South Africa and other Low-Middle Income Countries (LMICs), where extremely high rates of violent crime and youth violence exist (Foster, Reference Foster, Ward, d. Merwe and Dawes2012; de Ribera et al., Reference de Ribera, Trajtenberg, Shenderovich and Murray2019; Statistics SA, 2019). In South Africa, as in many other LMICs, macro societal factors including poverty and the legacy of colonialism are undoubtedly major contributors to this picture; however, understanding how individual factors such as empathy may contribute to these high rates remains an important consideration. Research has shown that interventions at the individual level can mitigate the effects of societal risk factors on individual vulnerabilities (van der Merwe & Dawes, Reference van der Merwe and Dawes2007; Odgers et al., Reference Odgers, Caspi, Russell, Sampson, Arseneault and Moffitt2012). The ability to assess this fundamental social cognitive skill in development thus has broad applicability.

The precise definition and subsequent measurement of empathy remain contentious and variable. Many scholars consider empathy a multifaceted construct comprising at minimum both an affective and a cognitive component, where the affective component is concerned with emotion-sharing and the cognitive component with the ability to relate to others’ emotions or mental states on a cognitive level (Eisenberg & Fabes, Reference Eisenberg and Fabes1990; Bischof-Köhler, Reference Bischof-Köhler2012; Uribe et al., Reference Uribe, Puig-Davi, Abos, Baggio, Junque and Segura2019). Thus, several measures of dispositional empathy have been designed informed by this theoretical conceptualisation.

Assessing dispositional or trait empathy is a cornerstone in many studies concerned with empathy, with self-report measures widely used in adolescent and adult samples. Measuring empathy in younger children remains a challenge, as they do not yet have the cognitive capacity to comment reliably on their own emotional and behavioural states. Consequently, it is common practice for parents to be asked to report on their child’s dispositional empathy (Dadds et al., Reference Dadds, Hunter, Hawes, Frost, Vassallo, Bunn, Merz and Masry2008; Rieffe et al., Reference Rieffe, Ketelaar and Wiefferink2010). While the extent to which parents can accurately reflect on their child’s empathic abilities is open to question, when coupled with other measures of child empathy and behaviour, parent-report measures can provide a valuable contribution to understanding child empathy and its development.

The Griffiths Empathy Measure (Dadds et al., Reference Dadds, Hunter, Hawes, Frost, Vassallo, Bunn, Merz and Masry2008) is a well-known parent-report measure of dispositional cognitive and affective empathy which has previously demonstrated adequate reliability and validity in an Australian sample. While reasonable psychometric properties have been reported in a Chinese sample (Zhang. et al., Reference Zhang., Wang, Lui, Cheung, Neumann, Shum and Chan2014), Murphy (Reference Murphy2019) did not find this to be the case in an analysis of the literature regarding this questionnaire. His analysis indicated a lack of construct validity for the scale. Murphy cites the lack of conceptual precision in the questions comprising the respective cognitive and affective subcomponents as the reason for poor performance. He argues that the cognitive subscale appears to be assessing primarily callousness, while the affective subscale seems to be assessing a specific aspect of affective empathy, namely emotion contagion. Despite the general agreement regarding the overarching separable aspects of cognitive and affective empathy, consensus at the finer-grained level regarding what specific subcomponents may comprise the construct continues to elude the field (see for e.g. Table 1 in the systematic review by de Lima & Osorio, Reference de Lima and Osorio2021).

Table 1. Demographic information

Note: The QCAE sample includes the 160 primary caregivers who also completed the SGEM. Group contrasts were run using QCAE – SGEM and SGEM groups.

a Child Ethnicity: Black African: Coloured - Mixed Ancestry: Indian - South Asian: White; these terms include the South African terms as well as those recommended by the American Medical Association (Flanagin et al., Reference Flanagin, Frey and Christiansen2021).

In a South African study using the Griffith Empathy Measure (GEM), Malcolm-Smith and colleagues (2015) demonstrated poor internal consistency reliability for the overall measure of dispositional empathy (Cronbach’s α = 0.47), poor discriminant validity and poor convergent validity. One potential explanation for this poor performance was that the response format (i.e., 9-point Likert scale) was too complex for parents to reliably report on their child’s dispositional empathy. This was evidenced in biased response patterns (i.e., only middle-of-the-range or extremes reported) along with interviewer reports of respondents’ difficulties with understanding the 9-point response format. The GEM thus did not appear to be an appropriate measure of child dispositional empathy in this South African LMIC context.

The Questionnaire of Cognitive and Affective Empathy (QCAE) (Reniers et al., Reference Reniers, Corcoran, Drake, Shryane and Vollm2011), another relatively recently developed measure assessing dispositional cognitive and affective empathy, has been broadly used in recent years. This self-report measure has been translated and yielded good psychometric results in a number of HICs, including Italy, Australia, France, and Portugal as well as in the original UK sample (Reniers et al., Reference Reniers, Corcoran, Drake, Shryane and Vollm2011; Myszkowski et al., Reference Myszkowski, Brunet-Gouet, Roux, Robieux, Malezieux, Boujut and Zenasni2017; Queiros et al., Reference Queiros, Fernandes, Reniers, Sampaio, Coutinho and Seara-Cardoso2018; Di Girolamo et al., Reference Di Girolamo, Giromini, Winters, Serie and de Ruiter2019; Gomez et al., Reference Gomez, Brown, Watson and Stavropoulos2022). The QCAE has also been used in a multisite study including HICs and LMICs, where (although its psychometric properties were not reported) similar associations between parent and child empathy, as well as age and child empathy, emerged across the various countries (Kozloff et al., Reference Kozloff, Cowell, Huppert, Gomez-Sicard, Lee, Mahasneh, Malcolm-Smith, Selcuk, Zhou and Decety2021), indicating consistency in the QCAE’s performance across very different contexts. The QCAE’s broad applicability demonstrated across these contexts and China (an upper-middle income country; Liang et al., Reference Liang, Yang, Ma, Lui, Cheung, Wang and Chan2019) suggests it might prove appropriate for use in LMIC contexts.

Establishing a reliable and valid measure of empathy for the South African and other LMIC contexts is integral as poor measures undermine all findings. The aim of this study was therefore to examine the psychometric properties of the above-mentioned two-factor measures of child dispositional empathy in an LMIC, South African context. We assessed a version of the GEM using a simplified set of response options. We also set the question format of the QCAE to parent-report rather than self-report and assessed its performance. To our knowledge this is the first study to examine QCAE psychometric properties in this form. The goal was to determine whether either or both measures may be useful for assessing child empathy in a LMIC context.

Methods

We used a cross-sectional design, with repeated measures, to assess the psychometric properties of two widely used measures of dispositional cognitive and affective empathy. We examined a simplified 3-point response format version of the GEM (Simplified GEM or SGEM), along with that of the QCAE being used in a larger ongoing protocol. All analyses were conducted using R Studio (2020). SGEM data (n = 160) was compared to that of the QCAE (n = 440; including the 160 who completed the SGEM). We assessed internal consistency reliability using Cronbach’s alpha, and correlated cognitive and affective subscale scores from participants who completed both questionnaires to assess convergent validity. Subsequently, given poor performance of the SGEM, Confirmatory Factor Analysis was utilised to investigate the integrity of the two-factor structure (i.e., cognitive and affective subscales), as well as the 5-factor structure proposed by the authors, of the QCAE only. This analysis also yielded composite reliability scores for the QCAE.

Participants

The study adhered to principles for research with human participants outlined in the Declaration of Helsinki (World Medical Association, 2013) and ethical approval was granted by the Ethics Committee of the University of Cape Town’s Department of Psychology (PSY2013-001). Participants were recruited from several English-medium public schools serving low-mid SES communities in Cape Town. Recruitment proceeded with permission from the Western Cape Education Department, and all parents or primary caregivers provided written informed consent. Parents/primary caregivers self-identified as belonging to South African ethnic categories that remain in consistent use due to post-Apartheid attempts to achieve employment equity and ensure diversity in educational and other institutions. The majority of the sample (80%) identified as ‘Coloured’, a mixed ancestry group who have a unique identity, and form a large part of the Western Cape population; around 18% identified as Black African; with very small numbers of Indian (South Asian, 1%) and White (0.02%) participants. The sample is thus representative of the province’s population (Statistics South Africa, Census 2019; Provincial Profile Western Cape, 2004).

As part of a larger ongoing study protocol, primary caregivers were asked to complete several parent-report questionnaires including the QCAE. Due to concerns about the GEM outlined above, it was not initially used in this protocol, and we only introduced the SGEM later to a portion of the ongoing study participants who had yet to provide data, in order to assess its psychometric performance. Consequently, a total of 160 primary caregivers completed the SGEM while 440 completed the QCAE. Although different, these sample sizes were nonetheless sufficient for the required data analyses (Bujang et al., Reference Bujang, Omar and Baharum2018). Furthermore, all of those who completed the SGEM also completed the QCAE. Demographic information of the sample is presented in Table 1.

Materials

A simplified version of the GEM (SGEM; Dadds et al., Reference Dadds, Hunter, Hawes, Frost, Vassallo, Bunn, Merz and Masry2008) was used as one of two measures assessing dispositional empathy (i.e., cognitive and affective trait empathy).

T. E. Moffitt (personal communication, February 2014) suggested that a simplified response scale might be required to maximise parent comprehension and hence enable reliable reporting; based on her extensive experience with cohort studies, parents frequently do not understand the fine gradations present in complex response formats. To reduce its complexity, the original 9-point Likert scale format was thus changed to a 3-point Likert scale format with permission from the developers. In the original GEM, response options ranged from −4 to 4, with end-point anchors only (i.e., strongly disagree = −4 and strongly agree = 4), while the response options for the SGEM were never (1), sometimes (2) or always (3). This scale consists of 23 items of which 14 assess cognitive empathy and 9 assess affective empathy. Primary caregivers reported on their child’s empathy.

The Questionnaire of Cognitive and Affective Empathy (QCAE) developed by Reniers et al. (Reference Reniers, Corcoran, Drake, Shryane and Vollm2011) also measures dispositional cognitive and affective empathy. This scale consists of 32 items of which 17 assess cognitive empathy and 15 assess affective empathy. Responses are made on a 4-point Likert scale with four anchored response options: strongly disagree (1), disagree (2), agree (3), strongly agree (4). This scale was developed drawing from several widely used and validated questionnaires measuring empathy (see Reniers et al., Reference Reniers, Corcoran, Drake, Shryane and Vollm2011). Once again, primary caregivers reported on their child’s empathy.

Results

Reliability analyses

Internal consistency was assessed for each of the questionnaires (i.e., the overall scale) as well as the affective and cognitive subscales by means of Cronbach’s alpha coefficient. Values are presented in Table 2 below. Composite reliability for the QCAE was calculated via the CFA, and values are presented in that section below. As can be seen, the SGEM performed poorly, with consistently low alpha values. In contrast, the QCAE performed well. As is generally seen in the literature, alpha values were excellent for the overall scale and the cognitive subscale but only satisfactory for the affective subscale.

Table 2. Internal consistency reliability for the SGEM and QCAE

(Note that The data and code used in this report are available at https://osf.io/56x73/?view_only=de2327a53fe44ef8b2f2ee6794371b37)

Despite performing considerably better than the original version utilised in the Malcolm-Smith et al. (Reference Malcolm-Smith, Woolley and Ward2015) article (α = 0.47), the SGEM’s performance was less than satisfactory, overall α = .63. Both subscales also performed poorly. Inspection of the inter-item correlation matrix showed low correlations and multiple negative correlations (See supplementary material, Table 1). Furthermore, item-total correlations revealed that removing items would not make a significant difference to the internal consistency of the scale (supplementary material, Table 2).

The QCAE performed well, with an overall scale alpha of 0.89. Despite this, there were still some low and negative inter-item correlations. Item 1 specifically, was flagged as problematic, with a negative corrected item-total correlation. Furthermore, the affective subscale alpha of 0.72, while satisfactory, is less than ideal. However, removing 4 items would improve this alpha only slightly, to .74.

Convergence between the measures

Given the poor reliability of the SGEM, it is perhaps not surprising that the SGEM and QCAE scores did not converge. Specifically, scores for those 160 participants who completed both the SGEM and the QCAE were not correlated: overall scale: r = −0.01, p = .885; cognitive subscale: r = −0.04, p = .610; affective subscale: r = 0.03, p = .740.

Confirmatory Factor Analysis (CFA) of the QCAE

Because of the poor internal consistency values for the SGEM and poor convergence between the SGEM and the QCAE, no further analysis was conducted for the SGEM. CFA was employed to confirm the structural validity of the QCAE. CFA analyses were conducted using the R-package ‘lavaan’ (Rosseel, Reference Rosseel2012). Initial screening of the data indicated that the QCAE responses did not follow a normal distribution (Mardia multivariate kurtosis =47.43, p < 0.001). To account for this, maximum likelihood estimation with robust standard errors was used to compute the goodness of fit indices of the models (Lai, Reference Lai2018). An acceptable fit would be indicated by CFI > 0.90 and RMSEA ≤ 0.06 (Hu & Bentler, Reference Hu and Bentler1999). If the resulting model did not have an acceptable fit, items whose factor loadings were <0.4 were removed (Stevens, Reference Stevens1992). Furthermore, residual errors and modification indices were examined to identify covariance among items and those that fitted theoretically were included to improve the overall fit of the model (McDonald & Ho, Reference McDonald and Ho2002).

A two-factor CFA model tested the item loadings of the proposed Cognitive and Affective subscales of the QCAE. Goodness of fit measures indicated that the initial model did not fit the data well, with CFI = 0.76 and RMSEA = 0.08 (90% CI: 0.07–0.08). Inspection of the factor loadings flagged items 1, 2, 17, 23, and 29 as problematic as their loadings were well below the acceptable value of 0.4 (factor loadings = 0.21, 0.01, −0.17, 0.24, −0.09 respectively; supplementary material, Table 3). After removing these five items from the analysis the two-factor model continued to fit the data poorly (CFI = 0.82 and RMSEA = 0.08 [90% CI: 0.07–0.08]). Residual errors and modification indices revealed that the poor fit was likely due to covariation between, (a) items 30 and 31, (b) items 3 and 4, (c) items 5 and 6, (d) items 25 and 27, and (e) items 16 and 26. Careful examination of the QCAE revealed that these items assess similar aspects of cognitive and affective empathy, indicating some redundancy in items. A two-factor model accounting for these inter-item correlations fit the data well, with CFI = 0.90 and RMSEA = 0.058 (90% CI: 0.05–0.06; see Table 3). Composite reliability for this model was very good: overall scale = 0.94; cognitive subscale = 0.92; affective subscale = 0.80.

Table 3. Confirmatory factor analysis results for the QCAE – 2-factor model

*p < 0.0001.

Next, we performed a CFA using the five-factor structure suggested by the original authors (Reniers et al., Reference Reniers, Corcoran, Drake, Shryane and Vollm2011). We found that items in the Peripheral Responsivity subscale (items 2, 11, 17, 19), as well as items 1 and 23 did not demonstrate acceptable factor loadings and were removed from the model (supplementary material, Table 4). Additionally, covariation between items 30 and 31 and items 3 and 4 were accounted for to achieve a satisfactory model fit. The resulting four-factor model appears to be the best fit for the data (CFI = 0.91, RMSEA = 0.06 [90% CI: 0.05–0.06], see Table 4). The composite reliability scores of the factors within the four-factor structure are relatively good (perspective taking = 0.89; online simulation = 0.85; emotion contagion = 0.73, and proximal responsivity = 0.61). The total composite reliability for this four-factor structure was 0.95.

Table 4. Confirmatory factor analysis results for the QCAE – 4-factor model

*p < 0.0001.

Discussion

Our results indicate that the QCAE may be a useful parent-report measure of dispositional empathy for school-aged children in South Africa and other LMIC contexts. As the first examination of a parent-report version of the questionnaire these results are very promising: The scale evidenced good reliability, and confirmatory factor analysis indicated that, once item covariance was accounted for, the two-factor structure most commonly examined in empathy research (viz. cognitive and affective empathy subscales) fitted our data appropriately. A four-factor model, consistent with those reported by the original authors but excluding the peripheral responsivity subscale, fit our data well.

The SGEM, in contrast, did not perform optimally. Our initial concern regarding the GEM was that the complex response format might have been the cause of unreliable reporting in the 2015 Malcolm-Smith et al., study. The 9-point Likert scale features only end-point anchors (strongly disagree and strongly agree), and although fine-grained scaling of responses is often considered ideal, it is likely that parents in LMIC contexts would not be able to make meaningful sense of the many available but unlabelled scale points. We therefore simplified the response format to three easily understandable options - never, sometimes, or always. However, even with this simplified response format, the internal consistency reliability of this measure, although improved, was not satisfactory (see Table 2).

The fact that scores from the subsample that completed both the SGEM and the QCAE, two measures ostensibly assessing the same construct, and both featuring cognitive and affective subscales, did not correlate at all (all r values < 0.05; all p values > 0.60) raises serious questions about the validity of the SGEM. Our findings concur with those of Murphy (Reference Murphy2019), who also raises serious concerns about the scale’s validity. Moreover, as an unreliable instrument cannot be valid, we investigated construct validity via confirmatory factor analysis only in the QCAE.

The QCAE evidenced good reliability, both in terms of Cronbach’s alpha (see Table 2) and composite reliability values. We then examined whether the factor structure proposed by the original authors (Reniers et al., Reference Reniers, Corcoran, Drake, Shryane and Vollm2011) was evident in our data. Confirmatory factor analysis indicated that once covariance between a number of items was allowed, the two-factor model for cognitive and affective empathy subscales attained acceptable fit. Studies in Italy and China (Di Girolamo et al., Reference Di Girolamo, Giromini, Winters, Serie and de Ruiter2019; Liang et al., Reference Liang, Yang, Ma, Lui, Cheung, Wang and Chan2019) also found that the two-factor model fit their data, although researchers in France found that the 5-factor model fit their data better than a 2-factor model (Myszkowski et al., Reference Myszkowski, Brunet-Gouet, Roux, Robieux, Malezieux, Boujut and Zenasni2017). As the subdomains of cognitive and affective empathy are generally of central interest to researchers, it was important to confirm that these constructs are adequately captured by the questionnaire in our context.

We also attempted to confirm the more complex 5-factor structure seen by Reniers and colleagues (2011). Our data, however, did not fit this model, and CFA indicated that a four-factor structure was instead supported. These four factors are consistent with four of the five reported by Reniers et al., However, the peripheral responsivity subscale factor did not emerge. The original authors also found this problem, and applied corrections to improve their model. Queiros et al (Reference Queiros, Fernandes, Reniers, Sampaio, Coutinho and Seara-Cardoso2018) also noted difficulties with the peripheral responsivity subscale and point to studies with clinical samples (Michaels et al., Reference Michaels, Horan, Ginger, Martinovich, Pinkham and Smith2014; Horan et al., Reference Horan, Reise, Kern, Lee, Penn and Green2015) where its reliability and convergent validity were problematic. Similarly, Liang et al. (Reference Liang, Yang, Ma, Lui, Cheung, Wang and Chan2019) found poor performance for the peripheral responsivity subscale, and in a meta-analysis, de Lima and Osorio (Reference de Lima and Osorio2021) found low reliability for the peripheral responsivity subscale. Authors who wish to examine the five QCAE subscales should be cautious regarding interpretation of the peripheral responsivity subscale.

Other very recent studies term the factor structure of the QCAE undecided (de Lima & Osorio, Reference de Lima and Osorio2021; Gomez et al., Reference Gomez, Brown, Watson and Stavropoulos2022). Gomez et al. (Reference Gomez, Brown, Watson and Stavropoulos2022) critique the use of parcelling in factor analyses in several psychometric studies of the QCAE (Reniers et al., Reference Reniers, Corcoran, Drake, Shryane and Vollm2011; Horan et al., Reference Horan, Reise, Kern, Lee, Penn and Green2015; Myszkowski et al., Reference Myszkowski, Brunet-Gouet, Roux, Robieux, Malezieux, Boujut and Zenasni2017; Queiros et al., Reference Queiros, Fernandes, Reniers, Sampaio, Coutinho and Seara-Cardoso2018; Di Girolamo et al., Reference Di Girolamo, Giromini, Winters, Serie and de Ruiter2019; Liang et al., Reference Liang, Yang, Ma, Lui, Cheung, Wang and Chan2019), arguing that this method is only appropriate where there is clear evidence for the factor structure at the item level, and thus calling these studies’ results into question. In line with the recommendation from Gomez et al., our analysis was conducted at the item-level. The recent meta-analysis of empathy measures also points to difficulties regarding factor structure in various instruments (de Lima & Osorio, Reference de Lima and Osorio2021). As these authors argue, it is entirely likely that differences in the conceptualisation of the precise subcomponents of empathy impact on scale construction, and thus contribute to measurement difficulties. They concur that the agreement around the broader but differentiable components of cognitive and affective empathy is stronger. At present it is thus probably preferable to assess empathy in terms of these broader aspects or subscales.

Our results indicate that we may have some confidence in results generated via use of the parent-report QCAE in the South African context. These results also indicate that the QCAE can be used not only as a self-report measure as in previous studies, but also as a parent-report measure – an important tool when studying empathy development. The question of how accurately parents are able to report on their child’s empathic disposition remains a concern, but the evidence presented here indicates that data from the parent-report version of the QCAE, ideally in combination with other more direct measures of empathy, can yield valuable information.

This questionnaire may also be useful in other LMIC contexts, where similar factors pertain, such as low SES, low levels and poor quality of education, as well as multiple languages in the population. In such contexts, measures developed and found suitable for HICs are often applied, but their suitability and psychometric properties are seldom thoroughly interrogated (Malcolm-Smith et al., Reference Malcolm-Smith, Lake, Krwece, du Plooy, Hoffman, Donald, Zar and Stein2023; Zieff et al., Reference Zieff, Hoogenhout, Eastman, Christ, Galvin, de Menil, Abubakar, Newton, Robinson and Donald2023).

Our study features several limitations we must acknowledge. Although sufficient for the analyses conducted, our sample was relatively small, and included only parents in the Cape Town metropolitan region in the Western Cape of South Africa. Investigation of this measure in other regions, particularly more rural areas, would strengthen confidence in its broad applicability. We would ideally have liked to collect more SGEM responses, but the late stage of the ongoing study including the QCAE prohibited this. The SGEM sample size was sufficient for the reliability analysis, and correlation analyses between the two measures were only conducted for participants who had completed both questionnaires. It would of course be desirable to assess convergent validity for the QCAE with other empathy measures, however as no validated scale assessing empathy exists for South Africa, we were unfortunately unable to do this.

We assessed these parent-report questionnaires for school-aged children only. Future studies should include assessment of the self-report version of the QCAE for older children and adults in South African or other LMIC contexts.

Regarding the QCAE, item 1 seems to be particularly problematic. We note that the covariance between a number of QCAE items indicates some redundancy in the questionnaire, and a few items did not load particularly well in the two-factor structure. Researchers using the QCAE are thus faced with a choice between omitting certain items, or proceeding with caution as the removal of items from standard questionnaires makes comparisons across studies problematic. In the absence of a standard revised version of the questionnaire, our general preference would be to retain cross study comparability by using standard question sets, while acknowledging that most such questionnaires are relatively blunt instruments.

Conclusion

This investigation of two well-known questionnaire measures of dispositional empathy in a LMIC context provides evidence that the parent-report version of the QCAE is an appropriate scale for use in school-aged children in such contexts. The ability to assess empathy is critical, particularly in young children, where interventions and social skills training can have long-term individual and societal benefits (van der Merwe & Dawes, Reference van der Merwe and Dawes2007; Malti et al., Reference Malti, Chaparro, Zuffiano and Colasante2016; Spinrad & Gal, Reference Spinrad and Gal2018). Researchers working in LMIC contexts are encouraged to thoroughly examine the psychometric properties of well-used instruments developed in westernised HIC contexts, as the assumption that they will perform similarly in very different populations may not be correct.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/neu.2024.19.

Acknowledgements

We would like to thank the school principals, teachers and families who participated in this research.

Author contribution

Susan Malcolm-Smith and Lea-Ann Pileggi conceptualised and designed the study. Susan Malcolm-Smith, Lea-Ann Pileggi and Raphaella Lewis were responsible for data analysis and interpretation; and for drafting and revising the article. All authors approved the final submitted manuscript.

Financial support

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Competing interests

The authors declare none.

Ethical statement

This research complied with the principles for human research set out in the Declaration of Helsinki (2013) and received ethical approval from the Ethics Committee of the University of Cape Town’s Department of Psychology (PSY2013-001).

References

Bischof-Köhler, D (2012) Empathy and self-recognition in phylogenetic and ontogenetic perspective. Emotion Review 4(1), 4048. DOI: 10.1177/1754073911421377.CrossRefGoogle Scholar
Broidy, LM, Nagin, DS, Tremblay, RE, Bates, JE, Brame, B, Dodge, KA, Fergusson, D, Horwood, JL, Loeber, R, Laird, R, Lynam, DR, Moffitt, TE, Pettit, GS and Vitaro, F (2003) Developmental trajectories of childhood disruptive behaviors and adolescent delinquency: a six-site, cross-national study. Developmental Psychology 39(2), 222245. DOI: 10.1037//0012-1649.39.2.222.CrossRefGoogle ScholarPubMed
Bujang, MA, Omar, ED and Baharum, NA (2018) A review on sample size determination for Cronbach’s alpha test: a simple guide for researchers. Malaysian Journal of Medical Science 25(6), 8599. DOI: 10.21315/mjms2018.25.6.9.CrossRefGoogle Scholar
Dadds, MR, Allen, JL, Oliver, BR, Faulkner, N, Legge, K, Moul, C, Woolgar, M and Scott, S (2012) Love, eye contact and the developmental origins of empathy v. psychopathy. British Journal of Psychiatry 200(3), 191196. DOI: 10.1192/bjp.bp.110.085720.CrossRefGoogle ScholarPubMed
Dadds, MR, Hunter, K, Hawes, DJ, Frost, AD, Vassallo, S, Bunn, P, Merz, S and Masry, YE (2008) A measure of cognitive and affective empathy in children using parent ratings. Child Psychiatry and Human Development 39(2), 111122. DOI: 10.1007/s10578-007-0075-4.CrossRefGoogle ScholarPubMed
de Kemp, RA, Overbeek, G, de Wied, M, Engels, RC and Scholte, RH (2007) Early adolescent empathy, parental support, and antisocial behavior. Journal of Genetic Psychology 168(1), 518. DOI: 10.3200/GNTP.168.1.5-18.CrossRefGoogle ScholarPubMed
de Lima, FF and Osorio, FL (2021) Empathy: assessment instruments and psychometric quality - a systematic literature review with a meta-analysis of the past ten years. Frontiers in Psychology 12, 781346. DOI: 10.3389/fpsyg.2021.781346.CrossRefGoogle ScholarPubMed
de Ribera, OS, Trajtenberg, N, Shenderovich, Y and Murray, J (2019) Correlates of youth violence in low- and middle-income countries: a meta-analysis. Aggression and Violent Behaviour 49, 101306. DOI: 10.1016/j.avb.2019.07.001.CrossRefGoogle Scholar
de Wied, M, Goudena, PP and Matthys, W (2005) Empathy in boys with disruptive behavior disorders. Journal of Child Psychology and Psychiatry 46(8), 867880. DOI: 10.1111/j.1469-7610.2004.00389.x.CrossRefGoogle ScholarPubMed
Decety, J and Cowell, JM (2014) The complex relation between morality and empathy. Trends in Cognitive Sciences 18(7), 337339. DOI: 10.1016/j.tics.2014.04.008.CrossRefGoogle ScholarPubMed
Di Girolamo, M, Giromini, L, Winters, CL, Serie, CMB and de Ruiter, C (2019) The questionnaire of cognitive and affective empathy: a comparison between paper-and-pencil versus online formats in Italian samples. Journal of Personality Assessment 101(2), 159170. DOI: 10.1080/00223891.2017.1389745.CrossRefGoogle ScholarPubMed
Eisenberg, N and Fabes, RA (1990) Empathy: conceptualization, measurement, and relation to prosocial behaviour. Motivation and Emotion 14(2), 131149. DOI: 10.1007/BF00991640.CrossRefGoogle Scholar
Farrington, DP (1989) Early predictors of adolescent aggression and adult violence. Violence and Victims 4(2), 79100. PMID: 2487131.CrossRefGoogle ScholarPubMed
Flanagin, A, Frey, T, Christiansen, SL, AMA Manual of Style Committee (2021) Updated guidance on the reporting of race and ethnicity in medical and science journals. Journal of the American Medical Association 326(7), 621627. DOI: 10.1001/jama.2021.13304.CrossRefGoogle ScholarPubMed
Foster, D (2012) Gender, class, ‘race’ and violence. In Ward, CL, d. Merwe, AV and Dawes, A (ed), Youth Violence: Sources and Solutions in South Africa , UCT Press, pp. 2151.Google Scholar
Gantiva, C, Cendales, R, Diaz, M and Gonzalez, Y (2021) Is there really a relationship between empathy and aggression? Evidence from physiological and self-report measures. Journal of Interpersonal Violence 36(7-8), 34383458. DOI: 10.1177/0886260518776999.CrossRefGoogle ScholarPubMed
Gomez, R, Brown, T, Watson, S and Stavropoulos, V (2022) Confirmatory factor analysis and exploratory structural equation modeling of the factor structure of the Questionnaire of Cognitive and Affective Empathy (QCAE). PLoS One 17(2), e0261914. DOI: 10.1371/journal.pone.0261914.CrossRefGoogle ScholarPubMed
Horan, WP, Reise, SP, Kern, RS, Lee, J, Penn, DL and Green, MF (2015) Structure and correlates of self-reported empathy in schizophrenia. Journal of Psychiatric Research 66-67, 6066. DOI: 10.1016/j.jpsychires.2015.04.016.CrossRefGoogle ScholarPubMed
Hu, LT and Bentler, PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modelling 6(1), 155. DOI: 10.1080/10705519909540118.CrossRefGoogle Scholar
Jones, AP, Happe, FG, Gilbert, F, Burnett, S and Viding, E (2010) Feeling, caring, knowing: different types of empathy deficit in boys with psychopathic tendencies and autism spectrum disorder. Journal of Child Psychology and Psychiatry 51(11), 11881197. DOI: 10.1111/j.1469-7610.2010.02280.x.CrossRefGoogle ScholarPubMed
Kozloff, V, Cowell, JM, Huppert, E, Gomez-Sicard, N, Lee, K, Mahasneh, R, Malcolm-Smith, S, Selcuk, B, Zhou, X and Decety, J (2021) An investigation of children’s empathic dispositions and behaviours across seven countries. Infant and Child Development 30(5), e2251. DOI: 10.1002/icd.2251.CrossRefGoogle Scholar
Lai, K (2018) Estimating standardized SEM parameters given nonnormal data and incorrect model: methods and comparison. Structural Equation Modeling 25(4), 600620. DOI: 10.1080/10705511.2017.1392248.CrossRefGoogle Scholar
Liang, YS, Yang, HX, Ma, YT, Lui, SSY, Cheung, EFC, Wang, Y and Chan, RCK (2019) Validation and extension of the questionnaire of cognitive and affective empathy in the Chinese setting. PsyCH Journal 8(4), 439448. DOI: 10.1002/pchj.281.CrossRefGoogle ScholarPubMed
Malcolm-Smith, S, Lake, MT, Krwece, A, du Plooy, CP, Hoffman, N, Donald, KA, Zar, HJ and Stein, DJ (2023) Externalizing behavior in preschool children in a South African birth cohort: predictive pathways in a high-risk context. Development and Psychopathology 35(2), 982999. DOI: 10.1017/S095457942200027X.CrossRefGoogle Scholar
Malcolm-Smith, S, Woolley, D and Ward, CL (2015) Examining empathy and its association with aggression in young Western Cape children. Journal of Child and Adolescent Mental Health 27(2), 135147. DOI: 10.2989/17280583.2015.1085386.CrossRefGoogle ScholarPubMed
Malti, T, Chaparro, MP, Zuffiano, A and Colasante, T (2016) School-based interventions to promote empathy-related responding in children and adolescents: a developmental analysis. Journal of Clinical Child and Adolescent Psychology 45(6), 718731. DOI: 10.1080/15374416.2015.1121822.CrossRefGoogle ScholarPubMed
McDonald, RP and Ho, MH (2002) Principles and practice in reporting structural equation analyses. Psychological Methods 7(1), 6482. DOI: 10.1037/1082-989x.7.1.64.CrossRefGoogle ScholarPubMed
Michaels, TM, Horan, WP, Ginger, EJ, Martinovich, Z, Pinkham, AE and Smith, MJ (2014) Cognitive empathy contributes to poor social functioning in schizophrenia: evidence from a new self-report measure of cognitive and affective empathy. Psychiatry Research 220(3), 803810. DOI: 10.1016/j.psychres.2014.08.054.CrossRefGoogle ScholarPubMed
Miller, PA and Eisenberg, N (1998) The relation of empathy to aggressive and externalizing/antisocial behavior. Psychological Bulletin 103(3), 324344. DOI: 10.1037/0033-2909.103.3.324.CrossRefGoogle Scholar
Moffitt, TE (1993) Adolescence-limited and life-course-persistent antisocial behavior: a developmental taxonomy. Psychological Review 100(4), 674701. DOI: 10.1037/0033-295X.100.4.674.CrossRefGoogle ScholarPubMed
Murphy, BA (2019) The Griffith Empathy Measure does not validly distinguish between cognitive and affective empathy in children. Australian Psychologist 54(3), 159164. DOI: 10.1111/ap.12336.CrossRefGoogle Scholar
Myszkowski, N, Brunet-Gouet, E, Roux, P, Robieux, L, Malezieux, A, Boujut, E and Zenasni, F (2017) Is the Questionnaire of Cognitive and Affective Empathy measuring two or five dimensions? Evidence in a French sample. Psychiatry Research 255, 292296. DOI: 10.1016/j.psychres.2017.05.047.CrossRefGoogle ScholarPubMed
Odgers, CL, Caspi, A, Russell, MA, Sampson, RJ, Arseneault, L and Moffitt, TE (2012) Supportive parenting mediates neighborhood socioeconomic disparities in children’s antisocial behavior from ages 5 to 12. Development and Psychopathology 24(3), 705721. DOI: 10.1017/S0954579412000326.CrossRefGoogle ScholarPubMed
Pingault, JB, Cote, SM, Lacourse, E, Galera, C, Vitaro, F and Tremblay, RE (2013) Childhood hyperactivity, physical aggression and criminality: a 19-year prospective population-based study. PLoS One 8(5), e62594. DOI: 10.1371/journal.pone.0062594.CrossRefGoogle ScholarPubMed
Queiros, A, Fernandes, E, Reniers, R, Sampaio, A, Coutinho, J and Seara-Cardoso, A (2018) Psychometric properties of the questionnaire of cognitive and affective empathy in a Portuguese sample. PLoS One 13(6), e0197755. DOI: 10.1371/journal.pone.0197755.CrossRefGoogle Scholar
Reniers, RL, Corcoran, R, Drake, R, Shryane, NM and Vollm, BA (2011) The QCAE: a questionnaire of cognitive and affective empathy. Journal of Personality Assessment 93(1), 8495. DOI: 10.1080/00223891.2010.528484.CrossRefGoogle ScholarPubMed
Rieffe, C, Ketelaar, L and Wiefferink, CH (2010) Assessing empathy in young children: construction and validation of an Empathy Questionnaire (EmQue). Personality and Individual Differences 49(5), 362367. DOI: 10.1016/j.paid.2010.03.046.CrossRefGoogle Scholar
Robertson, EL, Frick, PJ, Ray, JV, Thornton, LC, Wall Myers, TD, Steinberg, L and Cauffman, E (2018) The associations among callous-unemotional traits, worry, and aggression justice-involved adolescent boys. Clinical Psychological Science 6(5), 671684. DOI: 10.1177/2167702618766351.CrossRefGoogle Scholar
Rosseel, Y (2012) Lavaan: an R package for structural equation modeling. Journal of Statistical Software 48(2), 136. DOI: 10.18637/jss.v048.i02.CrossRefGoogle Scholar
Statistics South Africa (2019) Mid-year population estimates - Census.Statssa.gov.za. P03022019. Available at https:://statssa.gov.za>PO3022019 (accessed 7 September 2023).PO3022019+(accessed+7+September+2023).>Google Scholar
Statistics South Africa (2006). Provincial profile Western Cape. Report No. 00-91-01. https:://statssa.gov.za>Report-00-91-012004 (accessed 7 September 2023).Report-00-91-012004+(accessed+7+September+2023).>Google Scholar
Spinrad, TL and Gal, DE (2018) Fostering prosocial behavior and empathy in young children. Current Opinion in Psychology 20, 4044. DOI: 10.1016/j.copsyc.2017.08.004.CrossRefGoogle ScholarPubMed
Stevens, JP (1992) Applied Multivariate Statistics for the Social Sciences , 2nd edn. Erlbaum.Google Scholar
R Studio Team (2020) RStudio: Integrated Development for R. RStudio, PBC. Available at http://www.rstudio.com/ Google Scholar
Uribe, C, Puig-Davi, A, Abos, A, Baggio, HC, Junque, C and Segura, B (2019) Neuroanatomical and functional correlates of cognitive and affective empathy in young healthy adults. Frontiers in Behavioral Neuroscience 13, 85. DOI: 10.3389/fnbeh.2019.00085.CrossRefGoogle ScholarPubMed
van der Merwe, A and Dawes, A (2007) Youth violence: a review of risk factors, causal pathways and effective intervention. Journal of Child and Adolescent Mental Health 19(2), 95113. DOI: 10.2989/17280580709486645.CrossRefGoogle ScholarPubMed
van Hazebroek, BCM, Olthof, T and Goossens, FA (2017) Predicting aggression in adolescence: the interrelation between (a lack of) empathy and social goals. Aggressive Behaviour 43(2), 204214. DOI: 10.1002/ab.21675.CrossRefGoogle ScholarPubMed
van Langen, MAM, Wissink, IB, van Vugt, ES, van der Stouwe, T and Stams, GJJM (2014) The relation between empathy and offending: a meta-analysis. Aggression and Violent Behavior 19(2), 179189. DOI: 10.1016/j.avb.2014.02.003.CrossRefGoogle Scholar
World Medical Association (2013) Declaration of Helsinki: ethical principles for medical research involving human subjects. Journal of the American Medical Association 310(20), 21912194. DOI: 10.1001%2Fjama.2013.281053.CrossRefGoogle Scholar
Zahn-Waxler, C, Radke-Yarrow, M, Wagner, E and Chapman, M (1992) Development of concern for others. Developmental Psychology 28(1), 126136. DOI: 10.1037/0012-1649.28.1.126.CrossRefGoogle Scholar
Zhang., Q, Wang, Y, Lui, SSY, Cheung, EFC, Neumann, DL, Shum, DHK and Chan, RCK (2014) Validation of the Griffith empathy measure in the Chinese context. Brain Impairment 15(1), 1017. DOI: 10.1017/Brimp.2014.1.CrossRefGoogle Scholar
Zieff, MR, Hoogenhout, M, Eastman, E, Christ, BU, Galvin, A, de Menil, V, Abubakar, A, Newton, CR, Robinson, E and Donald, KA (2023) Validity of the SNAP-IV for ADHD assessment in South African children with neurodevelopmental disorders. Journal of Autism and Developmental Disorders 53(7), 28512862. DOI: 10.1007/s10803-022-05530-1.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Demographic information

Figure 1

Table 2. Internal consistency reliability for the SGEM and QCAE

Figure 2

Table 3. Confirmatory factor analysis results for the QCAE – 2-factor model

Figure 3

Table 4. Confirmatory factor analysis results for the QCAE – 4-factor model

Supplementary material: File

Malcolm-Smith et al. supplementary material

Malcolm-Smith et al. supplementary material
Download Malcolm-Smith et al. supplementary material(File)
File 38.3 KB