Hostname: page-component-7bb8b95d7b-s9k8s Total loading time: 0 Render date: 2024-10-06T11:16:16.395Z Has data issue: false hasContentIssue false

Psychometric properties of the Turkish version of the developmental care scale for neonates with congenital heart disease

Published online by Cambridge University Press:  04 October 2024

Seçkin Kolak Sevgi
Affiliation:
Department of Pediatric Nursing, Ege University Institute of Health Sciences, Izmir, Bornova, Türkiye Department of Pediatrics, Division of Neonatology, Faculty of Medicine Hospital, Ege University, Izmir, Bornova, Türkiye
Kahraman Ayşe*
Affiliation:
Department of Pediatric Nursing, Faculty of Nursing, Ege University, Izmir, Bornova, Türkiye
*
Corresponding author: Kahraman Ayşe; Email: ayse.kahraman@ege.edu.tr
Rights & Permissions [Opens in a new window]

Abstract

Objective:

Developmental care for newborns with congenital heart disease (CHD) improves cardiac and respiratory patterns. According to the American Heart Association, developmental care in newborns with CHD is important for improving neurodevelopmental outcomes. This study aimed to evaluate the validity and reliability of the Turkish version of the Developmental Care Scale for Neonates with Congenital Heart Disease.

Methods:

This was a methodological, descriptive study conducted with 169 nurses from a tertiary-level NICU. The Demographical Information Form and the Developmental Care Scale for Neonates with Congenital Heart Disease were used to collect the data. The scales’ language and content validity, construct validity, and internal consistency were also assessed.

Results:

The scale consists of 31 items and four subscales. Factor loadings ranged from 0.44 to 0.82 and explained 65% of the total variance. Fit indices indicate that the model is acceptable. Cronbach’s α was 0.95 for the entire instrument, 0.91 for developing the external environment subscale, 0.94 for assessing family well-being, 0.86 for the caregiver activities toward the neonate, and 0.82 for the basic need subscale. Item–total correlations ranged between 0.34 and 0.75, according to the item analysis results.

Conclusions:

The Turkish version of the Developmental Care Scale for Neonates with Congenital Heart Disease is valid and reliable. The use of this scale could improve the performance of neonatal intensive care nurses in providing developmental care to newborns with CHD as well as the quality of care.

Type
Original Article
Copyright
© The Author(s), 2024. Published by Cambridge University Press

Introduction

Heidelise Als created the developmental care programme in the 1980s, based on the uniqueness of the newborn. Reference Als1 Developmental supportive care interventions reduce stress in high-risk neonates. Reference Pineda, Tjoeng, Vavasseur, Kidokoro, Neil and Inder2 Developmental care interventions have been shown to improve neurological outcomes and infant growth and development. Reference Altimier and Phillips3,Reference Spilker, Hill and Rosenblum4 The frequency of developmental and neurological problems in infants is an important finding in assessing the effectiveness of nursing care in the neonatal ICU. Reference Altimier and Phillips3,Reference Kahraman, Gümüş, Akar, Sipahi, Bal Yılmaz and Başbakkal5 Some infants monitored in the neonatal ICU have congenital heart disease (CHD), and it has been reported that approximately half of the newborns with CHD have neurodevelopmental delays. Reference Arter, Miller, Bakas and Cooper6Reference Miller, Lisanti and Witte8 In this situation, newborns with CHD require neuroprotective support, quality, and adequate developmental care approaches. Reference Byers7 Most studies that examined developmental care in newborn ICUs excluded infants born with complex CHD. Reference Lisanti, Uzark and Harrison9 Developmental care for newborns with CHD improves cardiac and respiratory patterns. Reference Peterson10,Reference Peterson and Evangelista11 According to the American Heart Association, developmental care in newborns with CHD is an important practice for improving neurodevelopmental outcomes, and there is a need for research evaluating developmental care interventions. Reference Lisanti, Uzark and Harrison9

One of the most important roles and responsibilities of neonatal intensive care nurses in the nursing process is to evaluate the developmental care needs of newborns with CHD in the neonatal ICU and to provide quality developmental care. Reference Kahraman, Gümüş, Akar, Sipahi, Bal Yılmaz and Başbakkal5,Reference Arter, Miller, Bakas and Cooper6,Reference Coughlin12 According to reports, nurses prioritise basic life functions in the care of newborns with CHD, and more effort is required to systematically apply developmental care to these vulnerable newborns. Reference Arter, Miller, Bakas and Cooper6 The Developmental Care Scale for Neonates with Congenital Heart Disease was created to assess the quality of developmental care provided to newborns with CHD by neonatal ICU. Reference Arter, Miller, Bakas and Cooper6 This could not be assessed because there is no scale in Turkey that can assess the status and quality of developmental care provided by neonatal intensive care nurses to newborns with CHD. This has been a deficiency in practice and literature. This study examined the validity and reliability of the Turkish version of the Developmental Care Scale for Neonates with Congenital Heart Disease.

Methods

Setting and sample

Between April and June 2021, data were collected from eight hospitals in two cities in Western Turkey. Sample selection method was not used in the study because it is recommended to take samples with a size of at least five and maximum 10 times the number of scale items in scale validity and reliability studies. Reference Bektas and Kudubes13,Reference Kahraman and Ceylan14 The study’s inclusion criteria were working as a nurse in the NICU for at least 6 months, caring for newborns with CHD, and volunteering to participate in the study. One hundred sixty-nine nurses from a tertiary-level neonatal ICU participated.

Ethics statement

Ethical approval was obtained for the study from the Medical Research Ethics Committee of the Faculty of Medicine (decision number: 21-3.1/21, approval date: 18 March 2021). Before the study, nurses were informed, and their written consent was obtained. All procedures performed in studies involving human participants were by the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Data collection forms

Demographical Information Form: This form included questions about the nurses’ sociodemographic characteristics.

The Developmental Care Scale for Neonates with Congenital Heart Disease: Arter et al. (2019) created the scale. It is a 5-point Likert-type scale with 31 items and four subscales that can be scored between 1 and 5 (1 = strongly disagree, 2 = disagree, 3 = neutral, 4 = agree, and 5 = strongly agree). The lowest possible score on this scale is 31, and the highest score is 155. There were no cut-off points on the scale. Higher scores indicated improved developmental care performance and quality of care. The subscales were as follows: creating an external environment (1–11 items), assessing family well-being (12–17 items), caregiver activities towards the neonate (18–26 items), and basic needs (27–31 items). Cronbach’s α coefficient for the scale was 0.89, and that of the subscales ranged between 0.74 and 0.87. Reference Arter, Miller, Bakas and Cooper6

Translation and adaptation of the scale

The authors of the original scale granted permission to adapt the scale to Turkish via email, which was then adapted to the Turkish society. Three expert translators translated the scale from English into Turkish. An expert translator performed the back translation. The researchers developed the scale items after back translation. Eight experts were presented with Turkish and the original forms to determine language and content validity. The experts had a Ph.D. in paediatric nursing. For expert opinion, it is necessary to get the opinion of at least six experts. Reference Yusoff15 The Davis method and content validity index were used to assess expert opinions. Reference Zamanzadeh, Rassouli, Abbaszadeh, Alavi-Majd, Nikanfar and Ghahramanian16 Following expert consultation, pilot implementation was conducted with 10 nurses who met the inclusion criteria. No modifications were made because each item was found understandable in the pilot study.

Data collection

Data were collected online because of limited access to neonatal ICUs owing to the COVID-19 pandemic. The questionnaires were created using Google Docs and administered using the web-based software, LimeSurvey. The link to the online questionnaire was distributed to nurses of eight hospitals via WhatsApp groups. Nurses who clicked on the link to the online survey were first informed about the study, and their permission was obtained. Permission was obtained for the care and delivery of newborns with CHD. Nurses who completed the consent form were able to answer the survey questions. During the nurse work shift, data collection forms were filled out through self-reporting. This process required approximately 5–10 min.

Data analysis

IBM SPSS 23 and LİSREL v. 8.72 statistical packages were used for the analysis. Descriptive characteristics were evaluated using numbers, percentages, means, and standard deviations. The validity of the scale was judged on the basis of its content and structure. Content validity index was calculated (using the Davis method) for content validity. Confirmatory factor analysis (e.g., Kaiser–Meyer–Olkin) and explanatory factor analysis were used to assess the scale’s structural validity. Cronbach’s α and item–total score correlations were used to determine internal consistency.

Results

The average age of the nurses who took part was 34.05 ± 6.14, and 97.0% were female. Fifty-five percent of the participants worked in the neonatal ICU between the ages of 6 months and 5 years. Seventy-one percent of the nurses had a bachelor’s degree, and 82.2% had developmental care training. Of the nurses, 98.2% provided developmental care to newborns, and 97.0% provided developmental care to newborns with CHD.

The content validity index values of the scale items calculated for content validity ranged from 0.90 to 1.00. The Kaiser–Meyer–Olkin score for explanatory factor analysis was 0.906, and Bartlett’s test was significant. Figure 1 depicts the model’s factor loadings. The values on the left in the figure represent error variance, whereas those in the middle represent factor loadings. These items account for 65% of the total variance. The factor loadings for the items were 0.44 and 0.82.

Figure 1. Confirmatory factor analysis path diagram of the scale.

Based on the confirmatory factor analysis results, the suggested modifications were carried out because the root-mean-square error of approximation value was 0.12. The final data analysis revealed that the chi-square value was 914.36, the degrees of freedom were 409, and the p value was 0.000. The chi-square to degrees of freedom ratio was calculated to be 2.25. The root-mean-square error of approximation was 0.086 after modification. The goodness of fit index was 0.74, adjusted goodness of fit index was 0.68, comparative fit index was 0.96, normed fit index was 0.94, and non-normed fit index was 0.96 (Table 1).

Table 1. Confirmatory factor fit index results of the developmental support competency scale

a RMSEA = root-mean-square error of approximation;

b GFI = goodness of fit index;

c AGFI = adjusted goodness of fit index;

d CFI = comparative fit index;

e NFI = normed fit index;

f NNFI = non-normed fit index.

Cronbach’s α was 0.95 for the entire instrument, 0.91 for developing the external environment subscale, 0.94 for assessing family well-being, 0.86 for the caregiver activities towards the neonate, and 0.82 for the basic need subscale (Table 2). Table 2 displays the item–total score correlations of the scale. The item–subscale total score correlations varied from 0.34 to 0.75.

Table 2. Factor analysis, Cronbach’s α coefficient, and corrected item–total correlation of the Turkish version of the Developmental Care Scale for Neonates with Congenital Heart Disease

Discussion

First, language and content validity studies were conducted to adapt the Turkish version of the scale. It was determined that there was an agreement between the experts. Reference Bektas and Kudubes13,Reference Jonhson and Christensen17

The fit of the sample included in the factor analysis was evaluated using the Kaiser–Meyer–Olkin and Bartlett X 2 tests, and the Kaiser–Meyer–Olkin value was greater than 0.60, indicating that the data were appropriate for factor analysis and that the sample size was adequate. Reference Boateng, Neilands, Frongillo, Melgar-Quiñonez and Young18 According to theexplanatory factor analysis, the scale’s four-factor structure explained 65% (64.707%) of the overall variance. Factor loads ranged from 0.44 to 0.82. The factor loads in the original scale were in the range of 0.418–0.823, with a variance of 52%. Reference Arter, Miller, Bakas and Cooper6 Previous research suggests that the factor load of each item should be≥0.30. Reference Jonhson and Christensen17,Reference Ceylan, Keskin and Yavaş19,Reference Turan, Erdoğan and Serap Ceylan20 These values indicate that the factor loadings were satisfactory.

According to cultural adaptation studies, confirmatory factor analysis should be conducted after explanatory factor analysis. Confirmatory factor analysis was used to assess the suitability of the scale’s factor structure. The fit indices are extremely diverse. 21 The chi-squared–to–degrees of freedom ratio was calculated to be 2.25. This value was less than five, indicating that the fit was satisfactory. Reference Kahraman and Ceylan14,Reference Marsh, Guo, Dicke, Parker and Craven22

This scale has not yet been adapted to other languages. Therefore, the results of the confirmatory factor analysis are discussed along with the general literature. A value of <0.08 indicates a good fit for root-mean-square error of approximation. Reference Marsh, Guo, Dicke, Parker and Craven22 A value of >0.95 indicates a perfect fit, and a value of >0.90 indicates an acceptable fit for other fit indices. 21 The root-mean-square error of approximation value was close to the acceptable value. The goodness of fit index and adjusted goodness of fit index values were below the threshold. The sample size influenced the values of the root-mean-square error of approximation, goodness of fit index, and goodness of fit index. Reference Ainur, Sayang, Jannoo and Yap23,Reference Shi, Maydeu-Olivares and Rosseel24 Because the sample size was less than 200 people, it may be more appropriate to evaluate the comparative fit index, normed fit index, and non-normed fit index, which are unaffected by the sample size. Values greater than 0.90 for these indices indicate that the model is acceptable. 21

Item–total correlation is a method for determining a scale’s reliability. Jonhson and Christensen (2014) recommended that the item–total correlation coefficient be higher than 0.20. Reference Jonhson and Christensen17 The item–subscale correlations in the original scale ranged from 0.31 to 0.77. Reference Arter, Miller, Bakas and Cooper6 The scale’s item–total score correlations were acceptable, and no items were removed because their correlations were not less than 0.20.

Cronbach’s α reliability coefficient is another value commonly used to determine scale reliability. Cronbach’s α coefficients between 0.00 and 0.40 indicate unreliability, 0.40–0.60 indicate low reliability, 0.60–0.80 indicate moderate reliability, and 0.80–1.00 indicate high reliability. Reference Jonhson and Christensen17 Cronbach’s α was 0.89, and the reliability of the subscales ranged between 0.74 and 0.87 in the original scale. Reference Arter, Miller, Bakas and Cooper6 In this study, Cronbach’s α coefficient of the scale was extremely reliable.

Study limitations

During the COVID-19 pandemic, data were collected online. Test–retest analysis could not be performed because the same person could not reach the second time after a 15-day interval. The small sample size of this study is one of its limitations. Due to the pandemic, it was difficult to find nurses who voluntarily participated in this study. Therefore, these findings cannot be generalised. Further research with a larger sample size is warranted.

Conclusion

A reliable and valid measure is required to adequately intervene and improve the quality of developmental care. As a result of the study, the Turkish form of the scale was found to be valid and reliable. In Turkey, a scale to assess the quality of developmental care for newborns with CHD is now available. The scale can be used to identify developmental care methods in which nurses are ineffective so that necessary interventions can be planned. The use of this scale could improve the performance of neonatal intensive care nurses in providing developmental care to newborns with CHD as well as the quality of care. Neonatal intensive care nurses should be aware that quality developmental care can improve the neurodevelopmental outcomes of newborns with heart disease.

Acknowledgements

We would like to thank the nursing staff for their collaboration. We would like to thank the Ege University Department of Biostatistics for statistical analysis. We are grateful to the Ege University Planning and Monitoring Coordination of Organizational Development and Directorate of Library and Documentation for their support in editing and proofreading this study.

Financial support

This research did not receive any specific grants from funding agencies in the public, commercial, or not-for-profit sectors.

Competing interests

The authors declare no potential conflicts of interest with respect to the research, authorship, or publication of this article.

Ethical standard

The study was approved by the Ege University Medical Research Ethics Committee of the Faculty of Medicine (decision number: 21-3.1/21, approval date: 18 March 2021). The nurses were informed about the study and provided written informed consent. All procedures performed in studies involving human participants were by the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

References

Als, H. Newborn Individualized Developmental Care and Assessment Program (NIDCAP): new frontier for neonatal and perinatal medicine. J Neonatal-Perinatal med 2009; 2: 135147. DOI: 10.3233/NPM-2009-0061.CrossRefGoogle Scholar
Pineda, RG, Tjoeng, TH, Vavasseur, C, Kidokoro, H, Neil, JJ, Inder, T. Patterns of altered neurobehavior in preterm infants within the neonatal intensive care unit. J pediatr 2013; 162: 470476.e1. DOI: 10.1016/j.jpeds.2012.08.011.CrossRefGoogle ScholarPubMed
Altimier, L, Phillips, RM. The neonatal integrative developmental care model: seven neuroprotective core measures for family-centered developmental care. Newborn Infant Nurs. Rev 2013; 13: 922. DOI: 10.1053/j.nainr.2016.09.030.CrossRefGoogle Scholar
Spilker, A, Hill, C, Rosenblum, R. The effectiveness of a standardised positioning tool and bedside education on the developmental positioning proficiency of NICU nurses. Intensive Crit Care Nurs 2016; 35: 1015. DOI: 10.1016/j.iccn.2016.01.004.CrossRefGoogle ScholarPubMed
Kahraman, A, Gümüş, M, Akar, M, Sipahi, M, Bal Yılmaz, H, Başbakkal, Z. The effects of auditory interventions on pain and comfort in premature newborns in the neonatal intensive care unit; a randomised controlled trial. Intensive Crit Care Nurs 2020; 61: 2904. DOI: 10.1016/j.iccn.2020.102904.CrossRefGoogle ScholarPubMed
Arter, S, Miller, E, Bakas, T, Cooper, DS. Psychometric testing of the developmental care scale for neonates with congenital heart disease. Cardiol young 2019; 29: 749755. DOI: 10.1017/S1047951119000337.CrossRefGoogle ScholarPubMed
Byers, JF. Components of developmental care and the evidence for their use in the NICU. MCN Am J Matern Child Nurs 2003; 28: 174182. DOI: 10.1097/00005721-200305000-00007.CrossRefGoogle ScholarPubMed
Miller, TA, Lisanti, AJ, Witte, MK et al. A collaborative learning assessment of developmental care practices for infants in the cardiac intensive care unit. J Pediatr 2020; 220: 93100. DOI: 10.1016/j.jpeds.2020.01.043.CrossRefGoogle ScholarPubMed
Lisanti, AJ, Uzark, KC, Harrison, TM et al. & American Heart Association Pediatric Cardiovascular Nursing Committee of the Council on Cardiovascular and Stroke Nursing, Council on Lifelong Congenital Heart Disease and Heart Health in the Young and Council on Hypertension Developmental Care for Hospitalized Infants With Complex Congenital Heart Disease: A Science Advisory From the American Heart Association. J Am Heart Assoc 2023; 12: 28489. DOI: 10.1161/JAHA.122.028489.Google Scholar
Peterson, JK. Supporting optimal neurodevelopmental outcomes in infants and children with congenital heart disease. Crit Care Nurse 2018; 38: 6874. DOI: 10.4037/ccn2018514.CrossRefGoogle ScholarPubMed
Peterson, JK, Evangelista, LS. Developmentally supportive care in congenital heart disease: a concept analysis. J Pediatr Nur 2017; 36: 241247. DOI: 10.1016/j.pedn.2017.05.007.CrossRefGoogle ScholarPubMed
Coughlin, ME. Chapter 8. Age appropriate Activities of Daily Living. In Transformative Nursing in the NICU, Trauma-Informed Age Appropriate Care. Springer publishing company, 2014.Google Scholar
Bektas, M, Kudubes, AA. Psychometric characteristics of the Turkish version of the pain flexibility scale for children with cancer. J Pediatr Nur 2022; 62: 8490. DOI: 10.1016/j.pedn.2021.09.011.CrossRefGoogle ScholarPubMed
Kahraman, A, Ceylan, SS. Psychometric properties of the Turkish Version of the Developmental Support Competency Scale for Nurses (DSCS-N). J Pediatr Nur 2020; 54: e47e52. DOI: 10.1016/j.pedn.2020.04.021.CrossRefGoogle ScholarPubMed
Yusoff, MSB. ABC of content validation and content validity index calculation. Edu Med J 2019; 11: 4954. DOI: https://doi.org/10.21315/eimj2019.11.2.6.CrossRefGoogle Scholar
Zamanzadeh, V, Rassouli, M, Abbaszadeh, A, Alavi-Majd, H, Nikanfar, AR, Ghahramanian, A. Details of content validity and objectifying it in instrument development. Nur Pract To 2014; 1: 163171.Google Scholar
Jonhson, B, Christensen, L. Educational research: Quantitative, qualitative, and mixed approaches, 5th ed. SAGE publication, London, 2014.Google Scholar
Boateng, GO, Neilands, TB, Frongillo, EA, Melgar-Quiñonez, HR, Young, SL. Best practices for developing and validating scales for health, social, and behavioral research: a primer. Front Public Health 2018; 6: 149. DOI: https://doi.org/10.3389/fpubh.2018.00149.CrossRefGoogle ScholarPubMed
Ceylan, SS, Keskin, Z, Yavaş, Z, et al. Developing the scale of parental participation in care: neonatal intensive care unit and examining the scale’s psychometric properties. Intensive Crit Care Nurs 2021; 65: 103037. DOI: 10.1016/j.iccn.2021.103037.CrossRefGoogle ScholarPubMed
Turan, T, Erdoğan, Ç, Serap Ceylan, S. The validity and reliability study of Turkish version of the fathers’ support scale: neonatal intensive care unit. Intensive Crit Care Nurs 2019; 50: 125130. DOI: 10.1016/j.iccn.2018.08.007.CrossRefGoogle ScholarPubMed
Çokluk Ö, Şekercioğlu G, Büyüköztürk Ş. Multivariate Statistics for Social Sciences: SPSS and LISREL Applications. Ankara, Pegem Akademi 2021. (Original work published in Turkish).Google Scholar
Marsh, HW, Guo, J, Dicke, T, Parker, PD, Craven, RG. Confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), and set-ESEM: optimal balance between goodness of fit and parsimony. Multivar Behav Res 2020; 55: 102119. DOI: 10.1080/00273171.2019.1602503.CrossRefGoogle ScholarPubMed
Ainur, AK, Sayang, MD, Jannoo, Z, Yap, BW. Sample size and Non-normality effects on goodness of fit measures in structural equation models. Pertanika J Sci Techno 2017; 25: 575586.Google Scholar
Shi, D, Maydeu-Olivares, A, Rosseel, Y. Assessing fit in ordinal factor analysis models: SRMR vs. RMSEA. Structural Equation Modeling: A Multidis J 2019; 27: 115. DOI: 10.1080/10705511.2019.Google Scholar
Figure 0

Figure 1. Confirmatory factor analysis path diagram of the scale.

Figure 1

Table 1. Confirmatory factor fit index results of the developmental support competency scale

Figure 2

Table 2. Factor analysis, Cronbach’s α coefficient, and corrected item–total correlation of the Turkish version of the Developmental Care Scale for Neonates with Congenital Heart Disease