Hostname: page-component-848d4c4894-x24gv Total loading time: 0 Render date: 2024-05-27T19:57:37.131Z Has data issue: false hasContentIssue false

Efficacy of cognitive remediation in bipolar disorder: systematic review and meta-analysis of randomized controlled trials

Published online by Cambridge University Press:  24 July 2023

Cecilia Samamé*
Affiliation:
Universidad Católica del Uruguay, Montevideo, Uruguay Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina
Paula Durante
Affiliation:
Universidad Favaloro, Buenos Aires, Argentina
Brenda Cattaneo
Affiliation:
Universidad Favaloro, Buenos Aires, Argentina
Ivan Aprahamian
Affiliation:
Faculdade de Medicina de Jundiaí, Departamento de Medicina Interna, Divisão de Geriatria, Grupo de Investigação sobre Multimorbidade e Saúde Mental no Envelhecimento, Jundiaí SP, Brasil Department of Psychiatry, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
Sergio Strejilevich
Affiliation:
ÁREA, Asistencia e Investigación en Trastornos del Ánimo, Buenos Aires, Argentina
*
Corresponding author: Cecilia Samamé; Email: ceciliasamame@gmail.com

Abstract

A significant percentage of people with bipolar disorder (BD) exhibit suboptimal functional adjustment, even when appropriately treated and after symptomatic recovery is achieved. Given that cognitive impairment is one of the strongest correlates of socio-occupational outcomes and quality of life in BD, cognitive remediation (CR) is currently acknowledged as a promising treatment that could help bridge the gap between symptomatic and full functional recovery. The aim of this review was to explore the efficacy of CR approaches in improving cognitive and functional outcomes in BD patients. PubMed, PsycINFO, and CENTRAL were searched from inception to November 2022. Randomized controlled trials exploring the effects of CR on cognition and/or functional adjustment in adult BD patients were eligible. Ten studies based on seven independent trials (n = 586) were included. Change-score effect sizes (Hedges' g) were obtained for efficacy outcome measures and combined by means of meta-analytic procedures. Small but significant overall effects were observed for working memory (g = 0.32, 95% CI 0.11–0.52), planning (g = 0.30, 95% CI 0.03–0.56), and verbal learning (g = 0.40, 95% CI 0.15–0.66). However, CR was not found to exert any significant effects on functional outcomes at treatment completion or at follow-up assessment. Although CR may modestly enhance the cognitive performance of BD patients, this effect does not translate into an improvement at the functional level. The current data do not support the inclusion of CR as a treatment recommendation in clinical practice guidelines for the management of BD.

Type
Review Article
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bellani, M., Biagianti, B., Zovetti, N., Rossetti, M. G., Bressi, C., Perlini, C., & Brambilla, P. (2019). The effects of cognitive remediation on cognitive abilities and real-world functioning among people with bipolar disorder: A systematic review: Special section on “Translational and Neuroscience Studies in Affective Disorders”. Section Editor, Maria Nobile MD, PhD. This Section of JAD focuses on the relevance of translational and neuroscience studies in providing a better understanding of the neural basis of affective disorders. The main aim is to briefly summaries relevant research findings in clinical neuroscience with particular regards to specific innovative topics in mood and anxiety disorders. Journal of Affective Disorders, 257, 691697. doi: 10.1016/j.jad.2019.07.059CrossRefGoogle Scholar
Bonnin, C. M., Reinares, M., Martínez-Arán, A., Balanzá-Martínez, V., Sole, B., Torrent, C., … CIBERSAM Functional Remediation Group (2016a). Effects of functional remediation on neurocognitively impaired bipolar patients: Enhancement of verbal memory. Psychological Medicine, 46(2), 291301. doi: 10.1017/S0033291715001713CrossRefGoogle ScholarPubMed
Bonnin, C. M., Torrent, C., Arango, C., Amann, B. L., Solé, B., González-Pinto, A., … CIBERSAM Functional Remediation Group (2016b). Functional remediation in bipolar disorder: 1-year follow-up of neurocognitive and functional outcome. The British Journal of Psychiatry: the Journal of Mental Science, 208(1), 8793. doi: 10.1192/bjp.bp.114.162123CrossRefGoogle ScholarPubMed
Borenstein, M. (2022). In a meta-analysis, the I-squared statistic does not tell us how much the effect size varies. Journal of Clinical Epidemiology, 152, 281284. doi: 10.1016/j.jclinepi.2022.10.003CrossRefGoogle Scholar
Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2022). Comprehensive meta-analysis, version 4. Englewood, NJ: Biostat.Google Scholar
Burdick, K. E., Millett, C. E., Russo, M., Alda, M., Alliey-Rodriguez, N., Anand, A., … Kelsoe, J. R. (2020). The association between lithium use and neurocognitive performance in patients with bipolar disorder. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology, 45(10), 17431749. doi: 10.1038/s41386-020-0683-2CrossRefGoogle ScholarPubMed
Burdick, K. E., Russo, M., Frangou, S., Mahon, K., Braga, R. J., Shanahan, M., & Malhotra, A. K. (2014). Empirical evidence for discrete neurocognitive subgroups in bipolar disorder: Clinical implications. Psychological Medicine, 44(14), 30833096. doi: 10.1017/S0033291714000439CrossRefGoogle ScholarPubMed
Crump, C., Sundquist, K., Winkleby, M. A., & Sundquist, J. (2013). Comorbidities and mortality in bipolar disorder: A Swedish national cohort study. JAMA Psychiatry, 70(9), 931939. doi: 10.1001/jamapsychiatry.2013.1394CrossRefGoogle ScholarPubMed
Demant, K. M., Vinberg, M., Kessing, L. V., & Miskowiak, K. W. (2015). Effects of short-term cognitive remediation on cognitive dysfunction in partially or fully remitted individuals with bipolar disorder: Results of a randomised controlled trial. PloS One, 10(6), e0127955. doi: 10.1371/journal.pone.0127955CrossRefGoogle ScholarPubMed
Douglas, K. M., Groves, S., Crowe, M. T., Inder, M. L., Jordan, J., Carlyle, D., … Porter, R. J. (2022). A randomised controlled trial of psychotherapy and cognitive remediation to target cognition in mood disorders. Acta Psychiatrica Scandinavica, 145(3), 278292. doi: 10.1111/acps.13387CrossRefGoogle ScholarPubMed
Ehrlich, T. J., Ryan, K. A., Burdick, K. E., Langenecker, S. A., McInnis, M. G., & Marshall, D. F. (2022). Cognitive subgroups and their longitudinal trajectories in bipolar disorder. Acta Psychiatrica Scandinavica, 146(3), 240250. doi: 10.1111/acps.13460CrossRefGoogle ScholarPubMed
Ehrminger, M., Brunet-Gouet, E., Cannavo, A. S., Aouizerate, B., Cussac, I., Azorin, J. M., … Roux, P. (2021). Longitudinal relationships between cognition and functioning over 2 years in euthymic patients with bipolar disorder: A cross-lagged panel model approach with the FACE-BD cohort. The British Journal of Psychiatry: the Journal of Mental Science, 218(2), 8087. doi: 10.1192/bjp.2019.180CrossRefGoogle ScholarPubMed
Fett, A. K., Viechtbauer, W., Dominguez, M. D., Penn, D. L., van Os, J., & Krabbendam, L. (2011). The relationship between neurocognition and social cognition with functional outcomes in schizophrenia: A meta-analysis. Neuroscience and Biobehavioral Reviews, 35(3), 573588. doi: 10.1016/j.neubiorev.2010.07.001CrossRefGoogle ScholarPubMed
Frangou, S., Donaldson, S., Hadjulis, M., Landau, S., & Goldstein, L. H. (2005). The Maudsley bipolar disorder project: Executive dysfunction in bipolar disorder I and its clinical correlates. Biological Psychiatry, 58(11), 859864. doi: 10.1016/j.biopsych.2005.04.056CrossRefGoogle ScholarPubMed
Gao, K., Kemp, D. E., Ganocy, S. J., Gajwani, P., Xia, G., & Calabrese, J. R. (2008). Antipsychotic-induced extrapyramidal side effects in bipolar disorder and schizophrenia: A systematic review. Journal of Clinical Psychopharmacology, 28(2), 203209. doi: 10.1097/JCP.0b013e318166c4d5CrossRefGoogle ScholarPubMed
Gitlin, M. J., & Miklowitz, D. J. (2017). The difficult lives of individuals with bipolar disorder: A review of functional outcomes and their implications for treatment. Journal of Affective Disorders, 209, 147154. doi: 10.1016/j.jad.2016.11.021CrossRefGoogle ScholarPubMed
Gomes, B. C., Rocca, C. C., Belizario, G. O., de B F Fernandes, F., Valois, I., Olmo, G. C., … Lafer, B. (2019). Cognitive behavioral rehabilitation for bipolar disorder patients: A randomized controlled trial. Bipolar Disorders, 21(7), 621633. doi: 10.1111/bdi.12784CrossRefGoogle ScholarPubMed
Ho, B. C., Andreasen, N. C., Ziebell, S., Pierson, R., & Magnotta, V. (2011). Long-term antipsychotic treatment and brain volumes: A longitudinal study of first-episode schizophrenia. Archives of General Psychiatry, 68(2), 128137. doi: 10.1001/archgenpsychiatry.2010.199CrossRefGoogle ScholarPubMed
Jones, B. D. M., Fernandes, B. S., Husain, M. I., Ortiz, A., Rajji, T. K., Blumberger, D. M., … Mulsant, B. H. (2022). A cross-sectional study of cognitive performance in bipolar disorder across the lifespan: The cog-BD project. Psychological Medicine, 19. Advance online publication. doi: 10.1017/S0033291722003622Google ScholarPubMed
Kambeitz-Ilankovic, L., Betz, L. T., Dominke, C., Haas, S. S., Subramaniam, K., Fisher, M., … Kambeitz, J. (2019). Multi-outcome meta-analysis (MOMA) of cognitive remediation in schizophrenia: Revisiting the relevance of human coaching and elucidating interplay between multiple outcomes. Neuroscience and Biobehavioral Reviews, 107, 828845. doi: 10.1016/j.neubiorev.2019.09.031CrossRefGoogle ScholarPubMed
Kanahara, N., Yamanaka, H., Shiko, Y., Kawasaki, Y., & Iyo, M. (2022). The effects of cumulative antipsychotic dose on brain structures in patients with schizophrenia: Observational study of multiple CT scans over a long-term clinical course. Psychiatry Research. Neuroimaging, 319, 111422. doi: 10.1016/j.pscychresns.2021.111422CrossRefGoogle Scholar
Keramatian, K., Torres, I. J., & Yatham, L. N. (2022). Neurocognitive functioning in bipolar disorder: What we know and what we don't. Dialogues in Clinical Neuroscience, 23(1), 2938. doi: 10.1080/19585969.2022.2042164CrossRefGoogle ScholarPubMed
Lejeune, J. A., Northrop, A., & Kurtz, M. M. (2021). A meta-analysis of cognitive remediation for schizophrenia: Efficacy and the role of participant and treatment factors. Schizophrenia Bulletin, 47(4), 9971006. doi: 10.1093/schbul/sbab022CrossRefGoogle ScholarPubMed
Lewandowski, K. E., Sperry, S. H., Cohen, B. M., Norris, L. A., Fitzmaurice, G. M., Ongur, D., & Keshavan, M. S. (2017). Treatment to Enhance Cognition in Bipolar Disorder (TREC-BD): Efficacy of a randomized controlled trial of cognitive remediation versus active control. The Journal of Clinical Psychiatry, 78(9), e1242e1249. doi: 10.4088/JCP.17m11476CrossRefGoogle ScholarPubMed
Malhi, G. S., & Bell, E. (2021). Questions in Psychiatry (QuiP): Is staging bipolar disorder possible? If so, where to begin? Bipolar Disorders, 23(5), 517520. doi: 10.1111/bdi.13103CrossRefGoogle ScholarPubMed
Malhi, G. S., Bell, E., Boyce, P., Bassett, D., Berk, M., Bryant, R., … Murray, G. (2020). The 2020 Royal Australian and New Zealand College of psychiatrists clinical practice guidelines for mood disorders: Bipolar disorder summary. Bipolar Disorders, 22(8), 805821. doi: 10.1111/bdi.13036CrossRefGoogle ScholarPubMed
Martino, D. J., Samamé, C., & Strejilevich, S. A. (2017). Social cognition in schizophrenia and bipolar disorder: Just quantitative differences..?. Schizophrenia Research, 183, 164165. doi: 10.1016/j.schres.2016.11.023CrossRefGoogle ScholarPubMed
Mignogna, K. M., & Goes, F. S. (2022). Characterizing the longitudinal course of symptoms and functioning in bipolar disorder. Psychological Medicine, 111. Advance online publication. doi: 10.1017/S0033291722001489CrossRefGoogle ScholarPubMed
Miskowiak, K. W., Burdick, K. E., Martinez-Aran, A., Bonnin, C. M., Bowie, C. R., Carvalho, A. F., … Vieta, E. (2018). Assessing and addressing cognitive impairment in bipolar disorder: The international society for bipolar disorders targeting cognition task force recommendations for clinicians. Bipolar Disorders, 20(3), 184194. doi: 10.1111/bdi.12595CrossRefGoogle ScholarPubMed
Miskowiak, K. W., Carvalho, A. F., Vieta, E., & Kessing, L. V. (2016). Cognitive enhancement treatments for bipolar disorder: A systematic review and methodological recommendations. European Neuropsychopharmacology: the Journal of the European College of Neuropsychopharmacology, 26(10), 15411561. doi: 10.1016/j.euroneuro.2016.08.011CrossRefGoogle ScholarPubMed
Miskowiak, K. W., Seeberg, I., Jensen, M. B., Balanzá-Martínez, V., Del Mar Bonnin, C., Bowie, C. R., … Vieta, E. (2022). Randomised controlled cognition trials in remitted patients with mood disorders published between 2015 and 2021: A systematic review by the international society for bipolar disorders targeting cognition task force. Bipolar Disorders, 24(4), 354374. doi: 10.1111/bdi.13193CrossRefGoogle ScholarPubMed
Montejo, L., Torrent, C., Jiménez, E., Martínez-Arán, A., Blumberg, H. P., Burdick, K. E., … International Society for Bipolar Disorders (ISBD) Older Adults with Bipolar Disorder (OABD) Task Force. (2022). Cognition in older adults with bipolar disorder: An ISBD task force systematic review and meta-analysis based on a comprehensive neuropsychological assessment. Bipolar Disorders, 24(2), 115136. doi: 10.1111/bdi.13175CrossRefGoogle ScholarPubMed
Ott, C. V., Macoveanu, J., Bowie, C. R., Fisher, P. M., Knudsen, G. M., Kessing, L. V., & Miskowiak, K. W. (2021a). Change in prefrontal activity and executive functions after action-based cognitive remediation in bipolar disorder: A randomized controlled trial. Neuropsychopharmacology: official publication of the American College of Neuropsychopharmacology, 46(6), 11131121. doi: 10.1038/s41386-020-00901-7CrossRefGoogle ScholarPubMed
Ott, C. V., Vinberg, M., Kessing, L. V., Bowie, C. R., Forman, J. L., & Miskowiak, K. W. (2021b). Effect of action-based cognitive remediation on cognitive impairment in patients with remitted bipolar disorder: A randomized controlled trial. Bipolar Disorders, 23(5), 487499. doi: 10.1111/bdi.13021CrossRefGoogle ScholarPubMed
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ (Clinical Research ed.), 372, n71. doi: 10.1136/bmj.n71Google ScholarPubMed
Robinson, L. J., Thompson, J. M., Gallagher, P., Goswami, U., Young, A. H., Ferrier, I. N., & Moore, P. B. (2006). A meta-analysis of cognitive deficits in euthymic patients with bipolar disorder. Journal of Affective Disorders, 93(1-3), 105115. doi: 10.1016/j.jad.2006.02.016CrossRefGoogle ScholarPubMed
Rosa, A. R., Sánchez-Moreno, J., Martínez-Aran, A., Salamero, M., Torrent, C., Reinares, M., … Vieta, E. (2007). Validity and reliability of the Functioning Assessment Short Test (FAST) in bipolar disorder. Clinical Practice and Epidemiology in Mental Health: CP & EMH, 3, 5. doi: 10.1186/1745-0179-3-5CrossRefGoogle ScholarPubMed
Rossom, R. C., Hooker, S. A., O'Connor, P. J., Crain, A. L., & Sperl-Hillen, J. M. (2022). Cardiovascular risk for patients with and without schizophrenia, schizoaffective disorder, or bipolar disorder. Journal of the American Heart Association, 11(6), e021444. doi: 10.1161/JAHA.121.021444CrossRefGoogle ScholarPubMed
Samamé, C. (2019). The role of fluid intelligence in ascertaining neuropsychological and functional differences between bipolar disorder and primary psychotic disorders. Bipolar Disorders, 21(5), 462. doi: 10.1111/bdi.12791CrossRefGoogle ScholarPubMed
Samamé, C. (2021). The rise and fall of cognitive-behavioral approaches to the treatment of bipolar disorder: A critical overview from a quaternary prevention perspective. Bipolar Disorders, 23(8), 751753. doi: 10.1111/bdi.13146CrossRefGoogle Scholar
Samamé, C. (2023). Progressive cognitive impairment in bipolar disorder: An assumption that holds true no matter what. Bipolar Disorders, 25(1), 82. doi: 10.1111/bdi.13289CrossRefGoogle Scholar
Samamé, C., Cattaneo, B. L., Richaud, M. C., Strejilevich, S., & Aprahamian, I. (2022). The long-term course of cognition in bipolar disorder: A systematic review and meta-analysis of patient-control differences in test-score changes. Psychological Medicine, 52(2), 217228. doi: 10.1017/S0033291721004517CrossRefGoogle ScholarPubMed
Samamé, C., Martino, D. J., & Strejilevich, S. A. (2013). A quantitative review of neurocognition in euthymic late-life bipolar disorder. Bipolar Disorders, 15(6), 633644. doi: 10.1111/bdi.12077CrossRefGoogle ScholarPubMed
Sanchez-Moreno, J., Bonnín, C., González-Pinto, A., Amann, B. L., Solé, B., Balanzá-Martínez, V., … CIBERSAM Functional Remediation Group. (2017). Do patients with bipolar disorder and subsyndromal symptoms benefit from functional remediation? A 12-month follow-up study. European Neuropsychopharmacology: the Journal of the European College of Neuropsychopharmacology, 27(4), 350359. doi: 10.1016/j.euroneuro.2017.01.010CrossRefGoogle ScholarPubMed
Solé, B., Bonnin, C. M., Mayoral, M., Amann, B. L., Torres, I., González-Pinto, A., … CIBERSAM Functional Remediation Group. (2015). Functional remediation for patients with bipolar II disorder: Improvement of functioning and subsyndromal symptoms. European Neuropsychopharmacology: the Journal of the European College of Neuropsychopharmacology, 25(2), 257264. doi: 10.1016/j.euroneuro.2014.05.010CrossRefGoogle ScholarPubMed
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., … Higgins, J. P. T. (2019). RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ (Clinical research ed.), 366, l4898. doi: 10.1136/bmj.l4898Google ScholarPubMed
Strawbridge, R., Tsapekos, D., Hodsoll, J., Mantingh, T., Yalin, N., McCrone, P., … Young, A. H. (2021). Cognitive remediation therapy for patients with bipolar disorder: A randomised proof-of-concept trial. Bipolar Disorders, 23(2), 196208. doi: 10.1111/bdi.12968CrossRefGoogle ScholarPubMed
Strejilevich, S. A., Samamé, C., & Martino, D. J. (2015). The trajectory of neuropsychological dysfunctions in bipolar disorders: A critical examination of a hypothesis. Journal of Affective Disorders, 175, 396402. doi: 10.1016/j.jad.2015.01.018CrossRefGoogle ScholarPubMed
Tamura, J. K., Carvalho, I. P., Leanna, L. M. W., Feng, J. N., Rosenblat, J. D., Mansur, R., … McIntyre, R. S. (2021). Management of cognitive impairment in bipolar disorder: A systematic review of randomized controlled trials. CNS Spectrums, 122. Advance online publication. doi: 10.1017/S1092852921000092CrossRefGoogle ScholarPubMed
Torrent, C., Bonnin, C. d., Martínez-Arán, A., Valle, J., Amann, B. L., González-Pinto, A., … Vieta, E. (2013). Efficacy of functional remediation in bipolar disorder: A multicenter randomized controlled study. The American Journal of Psychiatry, 170(8), 852859. doi: 10.1176/appi.ajp.2012.12070971CrossRefGoogle ScholarPubMed
Tsapekos, D., Seccomandi, B., Mantingh, T., Cella, M., Wykes, T., & Young, A. H. (2020). Cognitive enhancement interventions for people with bipolar disorder: A systematic review of methodological quality, treatment approaches, and outcomes. Bipolar Disorders, 22(3), 216230. doi: 10.1111/bdi.12848CrossRefGoogle ScholarPubMed
Tsapekos, D., Strawbridge, R., Cella, M., Wykes, T., & Young, A. H. (2021). Predictors of psychosocial functioning in euthymic patients with bipolar disorder: A model selection approach. Journal of Psychiatric Research, 143, 6067. doi: 10.1016/j.jpsychires.2021.08.013CrossRefGoogle ScholarPubMed
Tsapekos, D., Strawbridge, R., Cella, M., Young, A. H., & Wykes, T. (2023). Does cognitive improvement translate into functional changes? Exploring the transfer mechanisms of cognitive remediation therapy for euthymic people with bipolar disorder. Psychological Medicine, 53(3), 936944. doi: 10.1017/S0033291721002336CrossRefGoogle ScholarPubMed
Vita, A., Barlati, S., Ceraso, A., Nibbio, G., Ariu, C., Deste, G., & Wykes, T. (2021). Effectiveness, core elements, and moderators of response of cognitive remediation for schizophrenia: A systematic review and meta-analysis of randomized clinical trials. JAMA Psychiatry, 78(8), 848858. doi: 10.1001/jamapsychiatry.2021.0620CrossRefGoogle ScholarPubMed
Voineskos, A. N., Mulsant, B. H., Dickie, E. W., Neufeld, N. H., Rothschild, A. J., Whyte, E. M., … Flint, A. J. (2020). Effects of antipsychotic medication on brain structure in patients with major depressive disorder and psychotic features: Neuroimaging findings in the context of a randomized placebo-controlled clinical trial. JAMA Psychiatry, 77(7), 674683. doi: 10.1001/jamapsychiatry.2020.0036CrossRefGoogle ScholarPubMed
Wykes, T., Huddy, V., Cellard, C., McGurk, S. R., & Czobor, P. (2011). A meta-analysis of cognitive remediation for schizophrenia: Methodology and effect sizes. The American Journal of Psychiatry, 168(5), 472485. doi: 10.1176/appi.ajp.2010.10060855CrossRefGoogle ScholarPubMed
Yatham, L. N., Kennedy, S. H., Parikh, S. V., Schaffer, A., Bond, D. J., Frey, B. N., … Berk, M. (2018). Canadian Network for Mood and Anxiety Treatments (CANMAT) and International Society for Bipolar Disorders (ISBD) 2018 guidelines for the management of patients with bipolar disorder. Bipolar Disorders, 20(2), 97170. doi: 10.1111/bdi.12609CrossRefGoogle Scholar
Supplementary material: File

Samamé et al. supplementary material 1

Samamé et al. supplementary material

Download Samamé et al. supplementary material 1(File)
File 534.7 KB
Supplementary material: File

Samamé et al. supplementary material

Samamé et al. supplementary material

Download Samamé et al. supplementary material(File)
File 599.4 KB
Supplementary material: File

Samamé et al. supplementary material 2

Samamé et al. supplementary material

Download Samamé et al. supplementary material 2(File)
File 23.8 KB
Supplementary material: File

Samamé et al. supplementary material 3

Samamé et al. supplementary material

Download Samamé et al. supplementary material 3(File)
File 17.4 KB
Supplementary material: File

Samamé et al. supplementary material 4

Samamé et al. supplementary material

Download Samamé et al. supplementary material 4(File)
File 19 KB
Supplementary material: File

Samamé et al. supplementary material 5

Samamé et al. supplementary material

Download Samamé et al. supplementary material 5(File)
File 18 KB
Supplementary material: File

Samamé et al. supplementary material 6

Samamé et al. supplementary material

Download Samamé et al. supplementary material 6(File)
File 18.1 KB
Supplementary material: File

Samamé et al. supplementary material 7

Samamé et al. supplementary material

Download Samamé et al. supplementary material 7(File)
File 14.3 KB