Hostname: page-component-78c5997874-94fs2 Total loading time: 0 Render date: 2024-11-17T16:33:00.032Z Has data issue: false hasContentIssue false
  • English
  • Français

Controlling contamination in child maltreatment research: Impact on effect size estimates for child behavior problems measured throughout childhood and adolescence

Published online by Cambridge University Press:  15 March 2021

Chad E. Shenk Open the ORCID record for Chad E. Shenk [Opens in a new window] ,
Joseph R. Rausch ,
Kenneth A. Shores ,
Elizabeth K. Allen  and
Anneke E. Olson
Chad E. Shenk*
Affiliation:
Department of Human Development and Family Studies, The Pennsylvania State University, University Park, PA, USA Department of Pediatrics, The Pennsylvania State University College of Medicine, Hershey, PA, USA
Joseph R. Rausch
Affiliation:
The Research Institute at Nationwide Children's Hospital, Columbus, OH, USA Department of Pediatrics, The Ohio State University College of Medicine, Columbus, OH, USA
Kenneth A. Shores
Affiliation:
School of Education, University of Delaware, Newark, DE, USA
Elizabeth K. Allen
Affiliation:
Department of Human Development and Family Studies, The Pennsylvania State University, University Park, PA, USA
Anneke E. Olson
Affiliation:
Department of Human Development and Family Studies, The Pennsylvania State University, University Park, PA, USA
*
Author for Correspondence: Chad Shenk, Ph.D., 115 Health and Human Development Building, University Park, PA 16802; Email: ces140@psu.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Contamination, when members of a comparison or control condition are exposed to the event or intervention under scientific investigation, is a methodological phenomenon that downwardly biases the magnitude of effect size estimates. This study tested a novel approach for controlling contamination in observational child maltreatment research. Data from The Longitudinal Studies of Child Abuse and Neglect (LONGSCAN; N = 1354) were obtained to estimate the risk of confirmed child maltreatment on trajectories of internalizing and externalizing behaviors before and after controlling contamination. Baseline models, where contamination was uncontrolled, demonstrated a risk for greater internalizing (b = .29, p < .001, d = .40) and externalizing (b = .14, p = .040, d = .19) behavior trajectories. Final models, where contamination was controlled by separating the comparison condition into subgroups that did or did not self-report maltreatment, also demonstrated risks for greater internalizing (b = .37, p < .001, d = .51) and externalizing (b = .22, p = .028, d = .29) behavior trajectories. However, effect size estimates in final models were 27.5%–52.6% larger compared to baseline models. Controlling contamination in child maltreatment research can strengthen effect size estimates for child behavior problems, aiding future child maltreatment research design and analysis.

Keywords

child maltreatmentcontaminationexternalizing behaviorsinternalizing behaviors
Type
Regular Article
Information
Development and Psychopathology , Volume 34 , Issue 4 , October 2022 , pp. 1287 - 1299
Copyright
© The Author(s), 2021. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Achenbach, T. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington, VT: University of Vermont.Google Scholar
Achenbach, T. M., Dumenci, L., & Rescorla, L. A. (2002). Ten-year comparisons of problems and competencies for national samples of youth: Self, parent and teacher reports. Journal of Emotional and Behavioral Disorders, 10, 194–203. doi:10.1177/10634266020100040101CrossRefGoogle Scholar
Baldwin, J. R., Reuben, A., Newbury, J. B., & Danese, A. (2019). Agreement between prospective and retrospective measures of childhood maltreatment: A systematic review and meta-analysis. JAMA Psychiatry, 76, 584–593 doi:10.1001/jamapsychiatry.2019.0097CrossRefGoogle ScholarPubMed
Barnett, D., Manly, J. T., & Cicchetti, D. (1993). Defining child maltreatment: The interface between policy and research. In Cicchetti, D. & Toth, S. L. (Eds.), Advances in applied developmental psychology: Child abuse, child development and social policy (pp. 7–74). Norwood, NJ: Ablex.Google Scholar
Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., … Moffitt, T. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2, 119–137. doi:10.1177/2167702613497473Google Scholar
Cicchetti, D., & Handley, E. D. (2017). Methylation of the glucocorticoid receptor gene, nuclear receptor subfamily 3, group C, member 1 (NR3C1), in maltreated and nonmaltreated children: Associations with behavioral undercontrol, emotional lability/negativity, and externalizing and internalizing symptoms. Development and Psychopathology, 29, 1795–1806. doi:10.1017/s0954579417001407CrossRefGoogle Scholar
Craven, R. G., Marsh, H. W., Debus, R. L., & Jayasinghe, U. (2001). Diffusion effects: Control group contamination threats to the validity of teacher-administered interventions. Journal of Educational Psychology, 93, 639–645. doi:10.1037/0022-0663.93.3.639CrossRefGoogle Scholar
Cuzick, J., Edwards, R., & Segnan, N. (1997). Adjusting for non-compliance and contamination in randomized clinical trials. Statistics in Medicine, 16, 1017–1029.3.0.CO;2-V>CrossRefGoogle ScholarPubMed
Danese, A., & Tan, M. (2014). Childhood maltreatment and obesity: Systematic review and meta-analysis. Molecular Psychiatry, 19, 544–554. doi:10.1038/mp.2013.54CrossRefGoogle ScholarPubMed
Danese, A., & Widom, C. S. (2020). Objective and subjective experiences of child maltreatment and their relationships with psychopathology. Nature Human Behavior, 4, 811–818.CrossRefGoogle ScholarPubMed
Dubowitz, H., Thompson, R., Arria, A. M., English, D., Metzger, R., & Kotch, J. B. (2016). Characteristics of child maltreatment and adolescent marijuana use: A prospective study. Child Maltreatment, 21, 16–25. doi:10.1177/1077559515620853CrossRefGoogle ScholarPubMed
Dubowitz, H., Villodas, M. T., Litrownik, A. J., Pitts, S. C., Hussey, J. M., Thompson, R., … Runyan, D. (2011). Psychometric properties of a youth self-report measure of neglectful behavior by parents. Child Abuse & Neglect, 35, 414–424. doi:10.1016/j.chiabu.2011.02.004CrossRefGoogle ScholarPubMed
English, D. J., Bangdiwala, S. I., & Runyan, D. K. (2005). The dimensions of maltreatment: Introduction. Child Abuse & Neglect, 29, 441–460. doi:10.1016/j.chiabu.2003.09.023CrossRefGoogle ScholarPubMed
Everson, M. D., Smith, J. B., Hussey, J. M., English, D., Litrownik, A. J., Dubowitz, H., … Runyan, D. K. (2008). Concordance between adolescent reports of childhood abuse and child protective service determinations in an at-risk sample of young adolescents. Child Maltreatment, 13, 14–26. doi:10.1177/1077559507307837CrossRefGoogle Scholar
Feingold, A. (2015). Confidence interval estimation for standardized effect sizes in multilevel and latent growth modeling. Journal of Consulting and Clinical Psychology, 83, 157–168. doi:10.1037/a0037721CrossRefGoogle ScholarPubMed
Felitti, V. J., Anda, R. F., Nordenberg, D., Williamson, D. F., Spitz, A. M., Edwards, V., … Marks, J. S. (1998). Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults. The adverse childhood experiences (ACE) study. American Journal of Preventative Medicine, 14, 245–258.CrossRefGoogle ScholarPubMed
Finkelhor, D., Turner, H. A., Shattuck, A., & Hamby, S. L. (2015). Prevalence of childhood exposure to violence, crime, and abuse: Results from the national survey of children's exposure to violence. JAMA Pediatrics, 169, 746–754. doi:10.1001/jamapediatrics.2015.0676CrossRefGoogle ScholarPubMed
Garwood, S. K., Gerassi, L., Jonson-Reid, M., Plax, K., & Drake, B. (2015). More than poverty: The effect of child abuse and neglect on teen pregnancy risk. Journal of Adolescent Health, 57, 164–168.CrossRefGoogle ScholarPubMed
Gilbert, R., Widom, C. S., Browne, K., Fergusson, D., Webb, E., & Janson, S. (2009). Burden and consequences of child maltreatment in high-income countries. Lancet, 373, 68–81. doi:10.1016/s0140-6736(08)61706-7CrossRefGoogle ScholarPubMed
Hart, S. N., Brassard, M. R., & Karlson, H. C. (1996). Psychological maltreatment. In Briere, J., Berliner, L., Bulkley, J. A., Jenny, C. & Reid, T. (Eds.), The APSAC handbook on child maltreatment (pp. 72–89, Chapter xii). Thousand Oaks, CA: Sage Publications, Inc.Google Scholar
Hussey, J. M., Chang, J. J., & Kotch, J. B. (2006). Child maltreatment in the United States: Prevalence, risk factors, and adolescent health consequences. Pediatrics, 118, 933–942. doi:10.1542/peds.2005-2452CrossRefGoogle ScholarPubMed
Institute of Medicine. (2011). New directions in child abuse and neglect research. Washington, DC: National Academies Press.Google Scholar
Jonson-Reid, M., Kohl, P. L., & Drake, B. (2012). Child and adult outcomes of chronic child maltreatment. Pediatrics, 129, 839–845. doi:10.1542/peds.2011-2529CrossRefGoogle ScholarPubMed
Knight, E. D., Runyan, D. K., Dubowitz, H., Brandford, C., Kotch, J., Litrownik, A. J., & Hunter, W. M. (2000). Methodological and ethical challenges associated with child self-report of maltreatment: Solutions implemented by the LONGSCAN consortium. Journal of Interpersonal Violence, 15, 760–775.CrossRefGoogle Scholar
Lissau, I., & Sorensen, T. I. (1994). Parental neglect during childhood and increased risk of obesity in young adulthood. Lancet, 343, 324–327.CrossRefGoogle ScholarPubMed
LONGSCAN Investigators. (1998). About My parents. Chapel Hill, NC: University of North Carolina. Retrieved from http://www.unc.edu/depts/sph/longscan/.Google Scholar
Marfo, P., & Okyere, G. A. (2019). The accuracy of effect-size estimates under normals and contaminated normals in meta-analysis. Heliyon, 5, e01838. doi:10.1016/j.heliyon.2019.e01838CrossRefGoogle ScholarPubMed
Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015). Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? American Psychologist 70, 487–498. doi:10.1037/a0039400CrossRefGoogle ScholarPubMed
Morgan, S. L., Winship, C., & Vanderweele, T. J. (2009). Counterfactuals and causal inference: Methods and principles for social research. Journal of the American Statistical Association, 104, 1715–1716.Google Scholar
Noll, J. G., Trickett, P. K., & Putnam, F. W. (2003). A prospective investigation of the impact of childhood sexual abuse on the development of sexuality. Journal of Consulting and Clinical Psychology, 71, 575–586. http://www.ncbi.nlm.nih.gov/pubmed/12795580CrossRefGoogle ScholarPubMed
Oh, D. L., Jerman, P., Silverio Marques, S., Koita, K., Purewal Boparai, S. K., Burke Harris, N., & Bucci, M. (2018). Systematic review of pediatric health outcomes associated with childhood adversity. BMC Pediatrics, 18, 83. doi:10.1186/s12887-018-1037-7CrossRefGoogle ScholarPubMed
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716. doi:10.1126/science.aac4716CrossRefGoogle Scholar
Reef, J., van Meurs, I., Verhulst, F. C., & van der Ende, J. (2010). Children's problems predict adults’ DSM-IV disorders across 24 years. Journal of the American Academy of Child and Adolescent Psychiatry, 49, 1117–1124. doi:10.1016/j.jaac.2010.08.002Google ScholarPubMed
Rubin, D. B. (1973). Matching to remove bias in observational studies. Biometrics, 29, 159–183.CrossRefGoogle Scholar
Runyan, D. K., Cox, C. E., Dubowitz, H., Newton, R. R., Upadhyaya, M., Kotch, J. B., … Knight, E. D. (2005). Describing maltreatment: Do child protective service reports and research definitions agree? Child Abuse & Neglect, 29, 461–477. doi:10.1016/j.chiabu.2004.06.015CrossRefGoogle ScholarPubMed
Runyan, D. K., Hunter, W. M., Socolar, R. R., Amaya-Jackson, L., English, D., Landsverk, J., … Mathew, R. M. (1998). Children who prosper in unfavorable environments: The relationship to social capital. Pediatrics, 101, 12–18.CrossRefGoogle ScholarPubMed
Scott, K. M., Smith, D. R., & Ellis, P. M. (2010). Prospectively ascertained child maltreatment and its association with DSM-IV mental disorders in young adults. Archives of General Psychiatry, 67, 712–719. doi:10.1001/archgenpsychiatry.2010.71CrossRefGoogle ScholarPubMed
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton, Mifflin and Company.Google Scholar
Shaffer, A., Huston, L., & Egeland, B. (2008). Identification of child maltreatment using prospective and self-report methodologies: A comparison of maltreatment incidence and relation to later psychopathology. Child Abuse & Neglect, 32, 682–692. doi:10.1016/j.chiabu.2007.09.010CrossRefGoogle ScholarPubMed
Shenk, C. E., Noll, J. G., Peugh, J. L., Griffin, A. M., & Bensman, H. E. (2016). Contamination in the prospective study of child maltreatment and female adolescent health. Journal of Pediatric Psychology, 41, 37–45. doi:10.1093/jpepsy/jsv017CrossRefGoogle ScholarPubMed
Swahn, M. H., Whitaker, D. J., Pippen, C. B., Leeb, R. T., Teplin, L. A., Abram, K. M., & McClelland, G. M. (2006). Concordance between self-reported maltreatment and court records of abuse or neglect among high-risk youths. American Journal of Public Health, 96, 1849–1853. doi:10.2105/ajph.2004.058230CrossRefGoogle ScholarPubMed
Thomas, C., Hypponen, E., & Power, C. (2008). Obesity and type 2 diabetes risk in midadult life: The role of childhood adversity. Pediatrics, 121, e1240–e1249. doi:10.1542/peds.2007-2403CrossRefGoogle ScholarPubMed
Thornberry, T. P., Ireland, T. O., & Smith, C. A. (2001). The importance of timing: The varying impact of childhood and adolescent maltreatment on multiple problem outcomes. Development and Psychopathology, 13, 957–979.CrossRefGoogle ScholarPubMed
Timmer, S. G., Urquiza, A. J., Zebell, N. M., & McGrath, J. M. (2005). Parent-child interaction therapy: Application to maltreating parent-child dyads. Child Abuse & Neglect, 29, 825–842. doi:10.1016/j.chiabu.2005.01.003CrossRefGoogle ScholarPubMed
Tryon, W. (2016). Replication is about effect size: Comment on Maxwell. Lau, and Howard. American Psychologist, 71, 236–237.CrossRefGoogle ScholarPubMed
U.S. Department of Health and Human Services. (2019). Administration for Children and Families, Administration on Children, Youth, and Families, Children's Bureau. Child Maltreatment 2017. Retrieved from https://www.acf.hhs.gov/cb/research-data-technology/statistics-research/child-maltreatment.Google Scholar
Vachon, D. D., Krueger, R. F., Rogosch, F. A., & Cicchetti, D. (2015). Assessment of the harmful psychiatric and behavioral effects of different forms of child maltreatment. JAMA Psychiatry, 72, 1135–1142. doi:10.1001/jamapsychiatry.2015.1792CrossRefGoogle ScholarPubMed
Walsh, K., McLaughlin, K. A., Hamilton, A., & Keyes, K. M. (2017). Trauma exposure, incident psychiatric disorders, and disorder transitions in a longitudinal population representative sample. Journal of Psychiatric Research, 92, 212–218. doi:10.1016/j.jpsychires.2017.05.001CrossRefGoogle Scholar
Widom, C. S. (1989). Child abuse, neglect, and adult behavior: Research design and findings on criminality, violence, and child abuse. American Journal of Orthopsychiatry, 59, 355–367. http://www.ncbi.nlm.nih.gov/pubmed/2764070CrossRefGoogle ScholarPubMed
Widom, C. S., & Kuhns, J. B. (1996). Childhood victimization and subsequent risk for promiscuity, prostitution, and teenage pregnancy: A prospective study. American Journal of Public Health, 86, 1607–1612.CrossRefGoogle ScholarPubMed
Widom, C. S., Raphael, K. G., & DuMont, K. A. (2004). The case for prospective longitudinal studies in child maltreatment research: Commentary on Dube, Williamson, Thompson, Felitti, and Anda (2004). Child Abuse & Neglect, 28, 715–722.CrossRefGoogle Scholar
Widom, C. S., & Shepard, R. L. (1996). Accuracy of adult recollections of childhood victimization: Part I: Childhood physical abuse. Psychological Assessment, 8, 412–421.CrossRefGoogle Scholar
World Health Organization. (2014, September 15-18, 2014). Investing in Children: The European Child and Adolescent Health Strategy 2015-2020 and the European Child Maltreatment Prevention Action Plan 2015-2020. Regional Committee for Europe, 64th Session, Copenhagen, Denmark.Google Scholar