Hostname: page-component-848d4c4894-75dct Total loading time: 0 Render date: 2024-05-16T12:48:16.639Z Has data issue: false hasContentIssue false

A scoping review of the literature on the application and usefulness of the Problem Management Plus (PM+) intervention around the world

Published online by Cambridge University Press:  23 April 2024

Patrick N. Mwangala*
Affiliation:
Institute for Human Development, Aga Khan University, Kenya; Centre for Geographic Medicine Research Coast, Kenya Medical Research Institute (KEMRI), Kilifi, Kenya; and School of Public Health, University of the Witwatersrand, South Africa
Millicent Makandi
Affiliation:
Institute for Human Development, Aga Khan University, Kenya
Anita Kerubo
Affiliation:
Institute for Human Development, Aga Khan University, Kenya
Moses K. Nyongesa
Affiliation:
Institute for Human Development, Aga Khan University, Kenya
Amina Abubakar
Affiliation:
Institute for Human Development, Aga Khan University, Kenya; Centre for Geographic Medicine Research Coast, Kenya Medical Research Institute (KEMRI), Kilifi, Kenya; and Department of Psychiatry, University of Oxford, UK
*
Correspondence: Patrick N. Mwangala. Email: patrick.nzivo@aku.edu
Rights & Permissions [Opens in a new window]

Abstract

Background

Given the high rates of common mental disorders and limited resources, task-shifting psychosocial interventions are needed to provide adequate care. One such intervention developed by the World Health Organization is Problem Management Plus (PM+).

Aims

This review maps the evidence regarding the extent of application and usefulness of the PM+ intervention, i.e. adaptability, feasibility, effectiveness and scalability, since it was introduced in 2016.

Method

We conducted a scoping review of seven literature databases and grey literature from January 2015 to February 2024, to identify peer-reviewed and grey literature on PM+ around the world.

Results

Out of 6739 potential records, 42 met the inclusion criteria. About 60% of the included studies were from low- and middle-income countries. Findings from pilot/feasibility trials demonstrated that PM+ is feasible, acceptable and safe. Results from definitive randomised controlled trials at short-term follow-up also suggested that PM+ is effective, with overall moderate-to-large effect sizes, in improving symptoms of common mental health problems. Although PM+ was more effective in reducing symptoms of common mental disorders, it was found to be costlier compared to usual care in the only study that evaluated its cost-effectiveness.

Conclusions

Our findings indicate that PM+, in its individual and group formats, can be adapted and effectively delivered by trained helpers to target a wide range of common mental health concerns. More effectiveness and implementation evidence is required to understand the long-term impact of PM+, its cost-effectiveness and scalability, and moderators of treatment outcomes such as gender and delivery formats.

Type
Review
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Aga Khan University, 2024. Published by Cambridge University Press on behalf of Royal College of Psychiatrists

Mental health is a fundamental human right and a critical element in the sustainable development of societies worldwide, hence the need for increased investment in mental health services as part of universal health coverage.Reference Dybdahl and Lien1 Nevertheless, mental health problems, particularly common mental disorders (CMDs) like depression, anxiety, stress and prolonged grief, remain among the top leading causes of the global burden of disease, with no evidence of a global reduction in the burden since 1990.2 Although mental illnesses occur across all levels of socioeconomic status, most populations in low-resource settings do not have adequate access to effective psychological and pharmacological interventions, with up to a 90% mental health treatment gap reported.Reference Patel, Maj, Flisher, De Silva, Koschorke and Prince3 Evidence-informed interventions such as cognitive–behavioural therapy have been found effective in some low- and middle-income countries (LMICs).Reference Singla, Kohrt, Murray, Anand, Chorpita and Patel4,Reference Barbui, Purgato, Abdulmalik, Acarturk, Eaton and Gastaldon5 Nonetheless, there are significant barriers to the sustainable delivery of such psychological interventions in LMICs, including limited mental health funding and infrastructure, inadequate psychological treatments adapted to the local context and challenges associated with their implementation, e.g. limited availability of mental health specialists.Reference Esponda, Hartman, Qureshi, Sadler, Cohen and Kakuma6,Reference Troup, Fuhr, Woodward, Sondorp and Roberts7

An overview of the Problem Management Plus

Implementation of low-intensity psychological therapies by non-mental health specialists is one potential solution to these challenges, which is receiving significant attention globally.Reference Bennett-Levy, Richards, Farrand, Christensen, Griffiths and Kavanagh8,Reference Patel, Chowdhary, Rahman and Verdeli9 Problem Management Plus (PM+), developed by the World Health Organization (WHO), is a brief, low-intensity, five-session transdiagnostic psychological intervention that may be delivered by trained non-mental health specialists to address mental health treatment gaps in LMICs.Reference World Health Organization10 The intervention can be delivered in individual or group format.Reference World Health Organization10,Reference World Health Organization11 Each PM+ session usually lasts 90 min. PM+ aims to alleviate symptoms of CMDs, including depression, anxiety and distress, regardless of whether exposure to adversity has caused these problems. The intervention also seeks to address self-identified practical problems (e.g. unemployment, interpersonal conflict) among adults. Over the five PM+ sessions, clients are taught four main strategies: (a) managing stress, (b) managing problems, (c) ‘get going keep doing’ and (d) strengthening social support. Within the first session, PM+ clients receive psychoeducation around common reactions to adversities. The last session focuses on relapse prevention. Although PM+ has often been delivered face to face, it has also recently been adapted to allow for remote delivery via videoconferencing tools,Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Morina, Weilenmann, Dawson, Ernst, Zanitti and von Känel13 mobile telephonesReference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14 or online platforms.Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15

The intervention was initially developed for and successfully evaluated in LMICs, where mental health resources are often limited.Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16Reference Nemiro, Van't Hof and Constant21 Recently, it has also been investigated among refugees in high-income countries (HICs).Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26 Thus, the current study carries out a comprehensive scoping review to synthesise the evidence on PM+ intervention to date, regarding its adaptations (including local contextualisation process) and implementation (including testing for feasibility, acceptability, effectiveness and scalability) around the world. The results of this review will inform evidence-based decision-making regarding the adaptation and implementation of PM+, guide future research efforts and promote the delivery of cost-effective, high-quality mental health interventions for individuals and communities experiencing CMD symptoms in different parts of the world.

Method

The methods for this scoping review were informed by the methodological framework outlined by Arksey and O'MalleyReference Arksey and O'Malley27 and further advanced by Levac et al.Reference Levac, Colquhoun and O'Brien28 We report our results based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews (PRISMA-ScR).Reference Tricco, Lillie, Zarin, O'Brien, Colquhoun and Levac29

Review aims and research questions

This scoping review aims to describe the evidence base for the PM+ intervention and distil key information pertaining to the targeted populations, adaptations made, format/mode of delivery, characteristics of PM+ helpers, acceptability, feasibility, effectiveness and scalability around the world. The overarching research question guiding the review was: What is the extent of application and usefulness of the PM+ intervention worldwide? Specific research questions included:

  1. (a) Which settings/contexts/populations has the PM+ intervention been implemented in?

  2. (b) What are the formats/modes of delivery of the PM+ intervention in these settings?

  3. (c) What are the characteristics of the PM+ helpers, and what is the nature of their training and supervision in delivering the intervention?

  4. (d) What are the common adaptations of the PM+ intervention from the original intervention?

  5. (e) How feasible, acceptable, safe and scalable is the PM+ intervention?

  6. (f) What is the clinical effectiveness and cost-effectiveness of the PM+ intervention?

  7. (g) What are the barriers and facilitators to effectively implementing the PM+ intervention?

Identification of relevant studies

We considered both peer-reviewed and grey literature for inclusion of articles to capture the full extent of application of the PM+ intervention across the world. Since the intervention was first introduced in 2016, we limited our search to start from January 2015 up to February 2024, and studies conducted in adult populations. There were no other applied limits (e.g. language restriction) during the search.

Search strategy

We searched five electronic databases: PubMed, PsycINFO, Scopus, CINAHL and Web of Science. Additionally, we searched Cochrane and the WHO clinical trials registry platforms. We also searched the following grey literature sources: Open Gray, NGO search engine, the Mental Health Innovation Network database, the International Federation of the Red Cross and Red Crescent database, the Mental Health and Psychosocial Support Network database and the Scaling up psychological interventions with Syrian refugees (STRENGTHS) project database. The electronic literature search followed the three-step procedure proposed by the Joanna Briggs Institute.Reference Peters, Godfrey, McInerney, Soares, Khalil and Parker30 In the initial step, we conducted a preliminary search in PubMed. The search terms ‘problem management plus’ and ‘intervention’ were used. P.N.M., M.M. and A.K. analysed the keywords used in the titles and abstracts of the identified abstracts. In the subsequent step, relevant keywords were reviewed to compile a list of terms to guide the detailed literature search in all databases. The improved final search strategy was developed in consultation with A.A. and M.K.N., and applied to fit the specifications of each database. The search results from individual databases were retrieved and uploaded to Endnote library version X9 (Endnote Team, Clarivate Company, Philadelphia USA; see https://endnote.com/downloads/). Lastly, we also searched the references of included articles and reports to identify potentially relevant literature meeting our eligibility criteria. Details of the search strategy are highlighted in Supplementary File 1 available at https://doi.org/10.1192/bjo.2024.55.

Study selection

Duplicate articles/reports were then removed before starting the two-stage selection process. Study titles and abstracts were reviewed for eligibility based on the inclusion and exclusion criteria highlighted below. The screening was done independently by two authors (P.N.M. and A.K.). The subsequent results were reviewed by the team. Full-text articles were retrieved and thereafter assessed for eligibility by P.N.M. and A.K.

Inclusion criteria

The comprehensive inclusion criteria included the following:

  1. (a) Study population: we considered a broad range of participants based on age. Studies were included if they reported outcomes for youth/young adults, adults or older adults.

  2. (b) Outcome measures: articles were included if they reported findings on the PM+ intervention only, e.g. adaptation, acceptability, feasibility, clinical effectiveness and cost-effectiveness data.

  3. (c) Geographic location: studies conducted anywhere in the world.

  4. (d) Study design: any type of original empirical intervention research, including pilot and definitive randomised controlled trials (RCTs), quasi-experimental designs, pre–post evaluations, open trials, mixed method studies or other applicable study designs reporting on PM+, e.g. field experience reports on implementing PM+. Articles where PM+ was significantly adapted, thus deviating from the original PM+ strategies, were not considered PM+ and hence excluded.

Exclusion criteria

Non-empirical studies, including scoping reviews, literature reviews, systematic reviews, meta-analyses and intervention protocols, were excluded. Studies reporting mental health interventions other than PM+ were also excluded.

Data charting

The data extraction form was developed by P.N.M. in Microsoft Excel 365 (Microsoft Corporation, Redmond, USA; https://office.microsoft.com/excel), and reviewed by the study team. It was then piloted by P.N.M. and A.K., who independently extracted the data from a sample of 10% of the included studies. Differences were compared and discussed, and a final data extraction tool was developed. For the remaining articles, data extraction was independently conducted by P.N.M., M.M., M.K.N. and A.K. In cases of disagreements, the two reviewers re-evaluated the same article and reached a consensus. Categories included in the data extraction sheet included: (a) study and sample characteristics such as author, publication year, country of the study, study design and follow-up time (for RCTs), sample size, study population, inclusion and exclusion criteria, participants’ age and proportion of female participants; (b) intervention details such as group-based or individual, number of sessions delivered and duration for each, format/mode of delivery, PM+ helpers and their characteristics (e.g. education), PM+ training and supervision procedures, control details, study outcomes, the impact of intervention if evaluated, barriers and facilitators during the implementation of the intervention, and details of intervention adaptations.

Collating, summarising and reporting of the results

We collated the findings based on the review questions to create a summary of the included studies by using a narrative synthesis approach. Articles were tabulated and grouped by study outcomes and study characteristics. Patterns were identified and translated to themes and further refined with an iterative process. The evidence was synthesised according to key review outcomes, i.e. PM+ adaptation, characteristics of PM+ helpers, PM+ feasibility, effectiveness, cost-effectiveness, and barriers and facilitators to PM+ implementation. Evidence was synthesised to provide a meaningful narrative relevant to the review questions.

Results

Search results

Figure 1 is the PRISMA flowchart highlighting the study identification and selection process. Our electronic database literature search identified 6502 records, and a further 237 were identified from the Cochrane database and WHO clinical trials registry. After excluding 969 duplicate records, we screened the titles and abstracts of 5770 records, of which 5656 were excluded. We then screened the full texts of the remaining 114 records, yielding 42 eligible articles. The reasons for exclusions are highlighted in Fig. 1.

Fig. 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow chart illustrating the study selection process. WHO, World Health Organization.

Characteristics of included studies

The characteristics of the 42 included studies published between 2016 and 2023 are presented in Supplementary File 2. The 42 studies originated from 19 countries across the world: PakistanReference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33 (n = 5), Jordan (n = 4),Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference Woodward, Sondorp, Barry, Dieleman, Fuhr and Broerse34Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36 Kenya (n = 4),Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Van't Hof, Dawson, Schafer, Chiumento, Shehadeh and Sijbrandij37,Reference Sijbrandij, Bryant, Schafer, Dawson, Anjuri and Ndogoni38 Nepal (n = 3),Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Sangraula, Kohrt, Ghimire, Shrestha, Luitel and van't Hof40 The Netherlands (n = 3),Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Woodward, de Graaff, Dieleman, Roberts, Fuhr and Broerse41 Turkey (n = 2),Reference Fuhr, Acarturk, Uygun, McGrath, Ilkkursun and Kaykha42,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43 Austria (n = 2),Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer44,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45 China (n = 2),Reference Zhang, Zhang, Lin and Huang46,Reference Qi, Wang and Cao47 Switzerland (n = 2)Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22,Reference Spaaij, Fuhr, Akhtar, Casanova, Klein and Schick48 Australia (n = 1),Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12 the UK (n = 1),Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26 Colombia (n = 1),Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49 Central African Republic (n = 1),Reference Dozio, Dill and Bizouerne50 Ethiopia (n = 1),Reference Gebrekristos, Eloul and Golden51 the USA (n = 1),Reference Galea, Sanabria, Greene, Thompson, Doering and Fuchs52 Spain (n = 1),Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15 Iraq (n = 1),Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 Venezuela (n = 1)Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49 and Malaysia (n = 1).Reference Tay, Mung, Miah, Balasundaram, Ventevogel and Badrudduza54 Five studies were conducted in multiple countries.Reference Nemiro, Van't Hof and Constant21,Reference McBride, Harrison, Mahata, Pfeffer, Cardamone and Ngigi55Reference Akhtar, Engels, Bawaneh, Bird, Bryant and Cuijpers58 Most of the included studies, about 60%, originated from LMICs.

Twenty-five (60%) of the studies were RCTs.Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45Reference Qi, Wang and Cao47,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Tay, Mung, Miah, Balasundaram, Ventevogel and Badrudduza54,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 Ten (40%) of these were feasibility or pilot RCTs documenting the feasibility, acceptability, safety and potential effectiveness of the PM+ intervention.Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22,Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 The remaining 15 RCTs were definitive trials: 14 assessed clinical effectiveness and one evaluated cost-effectiveness. Apart from RCTs, two studies utilised a pre–post design.Reference Dozio, Dill and Bizouerne50,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 Eight studies used qualitative approaches to explore the cultural adaptation and/or report on feasibility, acceptability and scalability of the PM+ intervention.Reference Woodward, Sondorp, Barry, Dieleman, Fuhr and Broerse34,Reference Van't Hof, Dawson, Schafer, Chiumento, Shehadeh and Sijbrandij37,Reference Sangraula, Kohrt, Ghimire, Shrestha, Luitel and van't Hof40,Reference Woodward, de Graaff, Dieleman, Roberts, Fuhr and Broerse41,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer44,Reference Spaaij, Fuhr, Akhtar, Casanova, Klein and Schick48,Reference Galea, Sanabria, Greene, Thompson, Doering and Fuchs52,Reference Akhtar, Engels, Bawaneh, Bird, Bryant and Cuijpers58 Five other studies were field case reports on the adaptation/implementation process and feasibility of the PM+ intervention.Reference Nemiro, Van't Hof and Constant21,Reference Gebrekristos, Eloul and Golden51,Reference McBride, Harrison, Mahata, Pfeffer, Cardamone and Ngigi55,Reference Coleman, Mukasakindi, Rose, Galea, Nyirandagijimana and Hakizimana57,Reference Perera, Salamanca-Sanabria, Caballero-Bernal, Feldman, Hansen and Bird60 The remaining two studies used a theory of change (ToC) workshop to explore context-specific pathways of scaling up PM+, including the potential barriers and facilitators to scaling up the intervention.Reference Fuhr, Acarturk, Uygun, McGrath, Ilkkursun and Kaykha42,Reference Fuhr, Acarturk, Sijbrandij, Brown, Jordans and Woodward56

Supplementary File 3 highlights the primary and secondary outcomes targeted by experimental studies (n = 27). Twenty-five of the studies evaluated psychological distress as the main primary outcome, predominantly symptoms of depression and/or anxiety. Different measures of psychological distress were employed, including (a) the Hospital Anxiety and Depression Scale (HADSReference Zigmond and Snaith61), used in eight studies;Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Zhang, Zhang, Lin and Huang46 (b) the Hopkins Symptom Checklist-25 (HSCL-25Reference Derogatis, Lipman, Rickels, Uhlenhuth and Covi62), used in six studies;Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43 (c) the 12- and 28-item General Health Questionnaires,Reference Goldberg and Williams63 used in four studies;Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 (d) the nine-item Patient Health Questionnaire (PHQ-9Reference Kroenke, Spitzer and Williams64), used in three studies;Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 (e) the seven-item Generalised Anxiety Disorder Scale (GAD-7Reference Spitzer, Kroenke, Williams and Löwe65), used in one study;Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14 (f) the Kessler Psychological Distress Scale (K10Reference Kessler, Andrews, Colpe, Hiripi, Mroczek and Normand66), used in one study;Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22 (g) the Social Anxiety Scale for Children,Reference Li, Su and Jin67 used in one study;Reference Qi, Wang and Cao47 and (h) the Patient Health Questionnaire-Anxiety and Depression Scale (PHQ-ADSReference Kroenke, Wu, Yu, Bair, Kean and Stump68), used in one study.Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15

In addition to psychological distress, three studiesReference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 assessed daily functioning as a primary outcome, using the WHO Disability Assessment Schedule (WHODAS 2.0).Reference Üstün, Chatterji, Kostanjsek, Rehm, Kennedy and Epping-Jordan69 Two studiesReference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Dozio, Dill and Bizouerne50 assessed general well-being as a separate primary outcome, using the WHO Well-Being Index (WHO-5).Reference Topp, Østergaard, Søndergaard and Bech70 Two other studiesReference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 assessed participant self-identified problems as a primary outcome of interest, using the Psychological Outcomes Profiles Scale (PSYCHLOPS).Reference Ashworth, Christey, Matthews, Wright, Parmentier and Robinson71 Perera et alReference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49 additionally included quality-of-life assessment with the WHO Quality of Life measure (WHOQOL-BREF).72

Three secondary outcomes were frequently assessed across studies implementing PM+. First, post-traumatic stress disorder (PTSD) symptoms were evaluated in 19 studies using various tools, including the International Trauma Questionnaire (ITQ) and PTSD Symptoms Checklist (PCL), which had variations such as PCL for DSM-5Reference Blevins, Weathers, Davis, Witte and Domino73 and PCL-C.Reference Khalily, Gul, Mushtaq and Jahangir74 Second, participant self-identified problems were assessed with the PSYCHLOPS in 15 studies. Lastly, in 14 studies, participants’ daily functioning was evaluated with the WHODAS 2.0. Nine studiesReference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15,Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31-Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33 that assessed psychological distress as a primary outcome concurrently evaluated mental health as a separate secondary outcome, mostly depressive disorder symptoms with the PHQ-9 (seven studies). Other secondary outcomes evaluated included perceived social support, self-reported health service utilisation, prolonged grief, prodromal psychotic symptoms, quality of life, prior exposure to stressful or traumatic life events, gender-based violence and post-migration stressors.

Population targeted

Among the 27 experimental studies, 3879 clients from diverse populations and varying sample sizes ranging from 7 to 969, were recruited and received the PM+ intervention. Four of the 27 studies were exclusively conducted among women.Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 Overall, 70% of the PM+ clients were women. All the experimental studies enrolled adults with moderate levels of common mental health problems, including psychological distress, anxiety, depression and impaired psychosocial functioning. Potential clients having significant cognitive or neurological impairment, acute medical conditions, severe mental disorders and imminent risk of suicide were excluded from the experimental studies. Various at-risk populations were targeted, including refugees/asylum seekers/internally displaced persons/migrants (n = 14),Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Dozio, Dill and Bizouerne50,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53,Reference Tay, Mung, Miah, Balasundaram, Ventevogel and Badrudduza54 adult primary care attendees (n = 4),Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33 women with a history of gender-based violence (n = 2),Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 adults from earthquake affected regions (n = 2),Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39 young adults living with HIV (n = 1),Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14 adults living with multiple myeloma (n = 1),Reference Zhang, Zhang, Lin and Huang46 adults affected by the COVID-19 pandemic (n = 1),Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12 parents of children living with autism spectrum disorder (n = 1)Reference Qi, Wang and Cao47 and healthcare workers working in COVID-19 pandemic hotspots (n = 1).Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15

Format/mode of delivery of the intervention

Most of the included studies implemented all PM+ strategies. In studies where adaptations of PM+ was empirically evaluated (n = 26),Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45Reference Qi, Wang and Cao47,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Tay, Mung, Miah, Balasundaram, Ventevogel and Badrudduza54,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 it was mostly delivered to individual clients in 16 studiesReference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14-Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22-Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45-Reference Qi, Wang and Cao47,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53,Reference Tay, Mung, Miah, Balasundaram, Ventevogel and Badrudduza54,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 and with a group-based delivery approach in ten other studies.Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Dozio, Dill and Bizouerne50 In the study by Dowrick et al,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26 PM+ was delivered both individually and in groups. Group-based sessions comprised four (minimum) to ten (maximum) individuals.

The majority of the studies (n = 13) evaluated PM+ using its original format of five weekly face-to-face sessions, each lasting 90 min. Nine studiesReference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45,Reference Dozio, Dill and Bizouerne50 had similar formats, with the exception that either sessions were extended to between 2 and 3 h or sessions were done over 6 weeks.Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45 In some studies, PM+ was delivered online either through videoconferencing or live streaming, with session duration lasting 40 minReference Qi, Wang and Cao47 or 60 min.Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15 de Graaf et alReference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24 applied a hybrid approach of face to face and video calls, to deliver five weekly sessions of PM+, each for 90 min, whereas Nyongesa et alReference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14 delivered PM+ strategies via mobile telephone calls for ten sessions, each lasting 45 min on average. In nine studies,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 PM+ helpers were gender-matched with PM+ clients. Supplementary File 4 provides further details.

PM+ helpers and their training and supervision

Nearly all studies used PM+ helpers, largely from the community and with no prior training in mental health, for delivery of the PM+ strategies, except in three studiesReference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45 where mental health specialists (psychologists) were used as PM+ helpers. The non-specialist PM+ helpers included peer refugees or those with lived experience of the asylum process,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43 lay healthcare workers or those in health-related disciplines, e.g. counsellors, nurses, social workers, community-based psychosocial workers, community health workers and Red Cross volunteers;Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Zhang, Zhang, Lin and Huang46,Reference Dozio, Dill and Bizouerne50,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 PM+ helpersReference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32 and local staff of the implementing non-governmental organisations.Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19 In 15 studies,Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 the PM+ helpers underwent 8 days of training, usually from local trainers such as mental health specialists, mostly psychologists, trained as PM+ trainers or international master trainers from the WHO involved in the development of PM+. In the remaining studies, the longest training of the PM+ helpers was 20 days.Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39 Often, the training involved education about CMDs, basic helping skills, delivery of intervention strategies, facilitation/supervision skills, self-care and psychological first aid. The classroom training was subsequently followed by practice cycles of varied length under close supervision. In a few of the studies,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 the PM+ helpers had to complete competency assessments before offering PM+. Supervision was mostly cascaded from an international PM+ specialist to local mental health specialists and onward, to PM+ helpers. Most of the PM+ helpers received weekly face-to-face group supervision sessions (about 2 h) from local supervisors, who in turn received weekly to fortnightly supervision (1 to 2 h) from international trainers/supervisors, mostly via video conference software, e.g. Skype. Two studies did not report the details of PM+ helpers’ training/supervision.Reference Zhang, Zhang, Lin and Huang46,Reference Qi, Wang and Cao47

PM+ adaptations reported

All of the 27 experimental studies included in the review reported adaptations of the PM+ intervention. The adaptation process varied among the studies, but generally included literature reviews, stakeholder engagements, qualitative explorations, literal translations, cognitive interviews and adaptation workshops. A few studies used established frameworks for their adaptation process, including the eight-element framework for the adaptation of psychological interventionsReference Bernal and Sáez-Santiago75 and the ten-step mental health cultural adaptation and contextualisation for implementation (mhCACI) procedure.Reference Sangraula, Kohrt, Ghimire, Shrestha, Luitel and van't Hof40 The first framework encompasses eight elements: language, therapeutic relationship, metaphors, intervention content, concept of illness, treatment goal, delivery methods and context. The mhCACI framework is a ten-step process: identifying mechanisms of action; conducting a literature desk review for the culture and context; conducting a training of trainers; translating intervention materials; conducting an expert read through all the materials; qualitative assessment of intervention population and site; conducting practice rounds; conducting an adaptation workshop with specialists and implementers; pilot testing the training, supervision and implementation; and reviewing through the process evaluation.

The core PM+ components and application/teaching of the main strategies were retained among the included studies. However, several changes were proposed across the intervention manual, training, supervision and implementation protocols. Generally, changes ranged from minor adjustments to terminology, broader changes and how metaphors, stories and illustrations were presented during the interventions. Some of the substantial adaptations included translation to local languages, addition or splitting of sessions, mode of delivery (e.g. face to face versus online, over the telephone or video conferencing) and session duration.Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45,Reference Akhtar, Engels, Bawaneh, Bird, Bryant and Cuijpers58,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59

Feasibility, effectiveness and scalability of the PM+ intervention

Feasibility

Testing the feasibility of mental health interventions in local contexts is crucial in evidence translation.Reference Bird, Le Boutillier, Leamy, Williams, Bradstreet and Slade76,Reference Skivington, Matthews, Simpson, Craig, Baird and Blazeby77 Several elements of intervention feasibility have been documented in the literature, including recruitment capability, data collection procedures, design procedures, retention of clients, optimal content and delivery, acceptability, adherence, the likelihood of cost-effectiveness, the capacity of providers to deliver the intervention and safety.Reference Bird, Le Boutillier, Leamy, Williams, Bradstreet and Slade76Reference Gadke, Kratochwill and Gettinger78 In the current review, PM+ feasibility was reported in ten pilot RCTs,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22,Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 and qualitative and case studies.Reference Nemiro, Van't Hof and Constant21,Reference Van't Hof, Dawson, Schafer, Chiumento, Shehadeh and Sijbrandij37,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer44,Reference Gebrekristos, Eloul and Golden51,Reference Galea, Sanabria, Greene, Thompson, Doering and Fuchs52,Reference McBride, Harrison, Mahata, Pfeffer, Cardamone and Ngigi55 The frequently reported feasibility elements in these studies included recruitment and retention of PM+ clients, training and supervision of PM+ helpers, intervention fidelity, intervention safety, acceptability (by PM+ helpers and clients) and potential effectiveness of PM+ intervention. All except one of the pilot RCTsReference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26 reported maximum recruitment of intended clients and reported high retention rates of their clients, usually more than 75% in most of the studies. Most of the studies utilised locally contextualised outcome measures and demonstrated the delivery of PM+ by trained helpers who were regularly supervised. PM+ was also found to be safe. Intervention safety was assessed by the extent of adverse events directly related to the intervention, e.g. a marked increase in suicidal thoughts or the presence of any serious adverse event. Some of the studies adopted a cut-off of ≥10% adverse events to delineate intervention safety. PM+ acceptability was largely assessed with qualitative studies where PM+ clients and helpers and other stakeholders (e.g. project staff and policy makers) reported a positive view of the intervention content, implementation and format. The only feasibility RCT with inconclusive findings had to be stopped because of prolonged governance issues following the onset of the COVID-19 pandemic; thus, the authors could not sufficiently provide clear conclusions regarding the feasibility of PM+ intervention.Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26 Although the feasibility trials were not statistically powered to detect statistically significant differences, significant differences in favour of PM+ clients were found for anxiety,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32 depressionReference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32 and PTSD symptoms;Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23 functional impairment;Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32 self-identified problemsReference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23 and quality of life,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14 suggesting the potential effectiveness of PM+ on these studied outcomes.

Effectiveness

The clinical effectiveness of PM+ was examined in 14 definitive RCTsReference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45Reference Qi, Wang and Cao47 and two pre–post trialsReference Dozio, Dill and Bizouerne50,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 (Supplementary File 5). Among studies evaluating effectiveness, all except oneReference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26 found a positive significant effect, with overall moderate-to-large effect sizes, in favour of PM+ for several primary outcomes, including depressive symptoms,Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15,Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Zhang, Zhang, Lin and Huang46,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 anxiety symptoms,Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15,Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Zhang, Zhang, Lin and Huang46,Reference Qi, Wang and Cao47 psychological distress,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45,Reference Zhang, Zhang, Lin and Huang46 functional impairmentReference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Dozio, Dill and Bizouerne50,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 and PTSD.Reference Dozio, Dill and Bizouerne50 All of these studies except oneReference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35 fixed their primary end points between 1 week and 6 months. Only one study evaluated the long-term effects of the PM+ intervention at 12 months’ follow-up, and the authors found no significant differences between treatment arms for depression and anxiety at this time point.Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35 Several studies also reported positive significant effects in favour of PM+ for a range of secondary outcomes, including self-identified problems,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45 PTSD,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45 depressive symptomsReference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15,Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33 and anxiety symptoms.Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24 Improvements in functional impairment were also reported,Reference Bryant, Schafer, Dawson, Anjuri, Mulili and Ndogoni16,Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17 as well as increases in positive parenting (e.g. a reduction in inconsistent disciplinary parenting that was associated with reductions in attentional and internalising problems in children),Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18 parenting stress,Reference Qi, Wang and Cao47 anhedonia, COVID-19-related fears and contaminationReference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12 and number of days off,Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53 and improvements in parent–child interaction,Reference Qi, Wang and Cao47social support,Reference Qi, Wang and Cao47 quality of life and emotion regulation,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45 and ability to carry out usual activities.Reference Musotsi, Koyiet, Khoshaba, Ali, Elias and Abdulmaleek53

Among the frequently assessed outcomes (symptoms of anxiety, depression, post-traumatic stress, functional impairment and personally identified problems), there was no clear pattern of effect size superiority. Based on the delivery format, individual-based PM+ appeared to have superior effect sizes compared with group-based PM+ among primary outcomes. However, no clear patterns were observed based on remote versus face-to-face delivery formats. Virtually, all of the studies reporting effect sizes were delivered by lay helpers; hence, little comparison could be made based on this aspect. Relatedly, most of the PM+ clients in the review were women, and none of the studies evaluated gender-specific effects; hence, we cannot make gender-specific conclusions about effectiveness.

Cost-effectiveness

Cost-effectiveness of the PM+ intervention was examined in only one study.Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20 The cost of delivering PM+ per participant was estimated at US$163 (using an international trainer and supervisor) and US$35 (employing a local trainer). In addition, the mean cost per unit score improvement in anxiety and depressive symptoms on the HADS was US$28 with an international trainer/supervisor and US$6 with a local trainer/supervisor. The mean incremental cost-effectiveness ratio to successfully treat a case of depression (PHQ-9 score ≥10) was US$517 with an international supervisor compared with US$103 with a local supervisor. Additional cost-effectiveness data from different organisations, including the STRENGTHS Consortium, is expected in the coming months.79

Scalability

None of the included studies described the scale-up of the PM+ intervention empirically. However, scalability potential was examined by five studies, three qualitative studiesReference Woodward, Sondorp, Barry, Dieleman, Fuhr and Broerse34,Reference Woodward, de Graaff, Dieleman, Roberts, Fuhr and Broerse41,Reference Spaaij, Fuhr, Akhtar, Casanova, Klein and Schick48 and two ToC workshop reports.Reference Fuhr, Acarturk, Uygun, McGrath, Ilkkursun and Kaykha42,Reference Fuhr, Acarturk, Sijbrandij, Brown, Jordans and Woodward56 The qualitative studies sought to identify the factors that may influence the process of the large-scale implementation of PM+ and to develop recommendations to guide the implementation process. In one of these studies,Reference Spaaij, Fuhr, Akhtar, Casanova, Klein and Schick48 the authors documented three significant themes likely to affect the longer-term implementation of PM+: preconditions for successful integration in the health system before scaling up, e.g. sustainable funding and introducing a stepped care approach; PM+ requirements to support scale-up (e.g. quality control during its delivery, modality, time and setting being offered) and the perceived benefits of scaling up. Similarly, the second qualitative studyReference Woodward, Sondorp, Barry, Dieleman, Fuhr and Broerse34 recommended sustainable funding to be made available for staff, training, supervision, infrastructure, coordination, expansion and evaluation of the scaling up of the PM+ intervention. The findings of the last qualitative studyReference Woodward, de Graaff, Dieleman, Roberts, Fuhr and Broerse41 suggested that the wider implementation of PM+ would largely depend on addressing essential barriers such as stigma, attrition, fragmentation, legal and financial challenges. Also noteworthy was the formalisation of non-specialist PM+ helpers, with accompanying structures for accreditation and supervision.Reference Woodward, de Graaff, Dieleman, Roberts, Fuhr and Broerse41

The two ToC workshop articles documented the practical steps of scaling up the PM+ intervention to help understand the change process of the intervention and map out causal pathways through which it has an effect. The results highlight that the scaling up of PM+ requires careful planning and investment from different stakeholders at the national level. Two distinct causal pathways for scale-up were reported: a policy and financing pathway and a health services pathway, which are interdependent.

Barriers and facilitators to effective implementation of the PM+ intervention

The 12-month follow-up duration of the intervention posed a limitation, lacking long-term benefits and sometimes worsening symptoms of mental health issues.Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35 The COVID-19 pandemic introduced additional challenges, causing delays in implementation because of governance issues and supply shortages.Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26 Structural barriers included PM+ clients’ engagement in income-generating activities or household chores, leading to session delays and limited attendance.Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Akhtar, Giardinelli, Bawaneh, Awwad, Al-Hayek and Whitney36 Attitudinal barriers driven by mismatched expectations complicated implementation, influenced by a prior non-governmental organisation.Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Van't Hof, Dawson, Schafer, Chiumento, Shehadeh and Sijbrandij37,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39 High implementation costs,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 security threatsReference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17 and transportation issues further hindered progress. Confidentiality within group interventions affected participation,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32 whereas challenges accessing referral services limited additional mental health treatment.Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39 Complexity of strategiesReference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49 and psychological barriers posed challenges, along with general job dissatisfaction among PM+ helpers. Sociocultural barriers, such as cultural explanations of mental health issues, were identified as important barriers in one of the studies.Reference Dozio, Dill and Bizouerne50 Low mental health literacy and lack of trust contributed to high attrition in PM+ implementation in another study.Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45

Competent PM+ helpers, supported by comprehensive training, live supervision, self-care strategies and organisational commitment, ensured safe and effective intervention delivery.Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49Reference Gebrekristos, Eloul and Golden51 Cultural adaptation, that is, adapting the intervention to specific contexts, was essential.Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney18,Reference Jordans, Kohrt, Sangraula, Turner, Wang and Shrestha19,Reference Spaaij, Kiselev, Berger, Bryant, Cuijpers and De Graaff22,Reference de Graaff, Cuijpers, McDaid, Park, Woodward and Bryant23,Reference Khan, Hamdani, Chiumento, Dawson, Bryant and Sijbrandij32,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Knefel, Kantor, Weindl, Schiess-Jokanovic, Nicholson and Verginer45,Reference Akhtar, Engels, Bawaneh, Bird, Bryant and Cuijpers58,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 Gender-matched assessors alleviated fears in settings where perceptions mattered.Reference Rahman, Khan, Hamdani, Chiumento, Akhtar and Nazir31,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39 Early stakeholder engagement, partnering with non-governmental organisations and local government, maximised resources and accessibility.Reference Acarturk, Uygun, Ilkkursun, Yurtbakan, Kurt and Adam-Troian43,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49 PM+ programmes delivered by culturally sensitive non-mental health specialists provided scalable solutions,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24,Reference Hamdani, Huma, Masood, Zhou, Ahmed and Nazir33,Reference Akhtar, Engels, Bawaneh, Bird, Bryant and Cuijpers58 supported by task-shifting approaches.Reference Rahman, Hamdani, Awan, Bryant, Dawson and Khan17,Reference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20,Reference Dawson, Schafer, Anjuri, Ndogoni, Musyoki and Sijbrandij59 Community engagement through sensitisation events built trust,Reference Perera, Aldamman, Hansen, Haahr-Pedersen, Caballero-Bernal and Caldas-Castaneda49 and the group format fostered acceptance and motivation, especially among women.Reference Van't Hof, Dawson, Schafer, Chiumento, Shehadeh and Sijbrandij37,Reference Sangraua, Turner, Luitel, Van‘t Hof, Shrestha and Ghimire39 Amid the pandemic, videoconferencing facilitated PM+ delivery and addressed mental health issues.Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12

Discussion

The current review provides a reflection on the current state of the literature on PM+ intervention regarding its application and usefulness worldwide. We identified 42 studies, including 25 RCTs and two pre–post studies, with 3879 PM+ clients, most of whom were women. Our results show that PM+ has been adapted and implemented in various settings and populations in both HICs and LMICs, with most evidence, about 60% of included studies, coming from LMICs. The PM+ intervention underwent adaptation in all the included experimental studies, which essentially guided how it was delivered, e.g. group-based versus individual formats; face to face versus online, over the telephone or videoconferencing; number and duration of sessions. The vast majority of PM+ helpers, almost exclusively, are non-mental health specialists, largely from the community and with no prior training in mental health. Findings from the pilot/feasibility RCTs generally indicated that PM+ in group or individual formats is a feasible, acceptable and safe psychological intervention. Results from definitive RCTs at short-term follow-up also suggest that PM+ is efficacious, with overall moderate-to-large effect sizes, in improving symptoms of depression, anxiety, psychological distress, PTSD and functional impairment. Although PM+ was more effective in reducing symptoms of CMDs, it was found to be costlier compared with usual care alone in the only study that evaluated its cost-effectiveness at 3 months. None of the included studies described the scaling up of the PM+ intervention; however, potential scalability was examined, identifying the factors/pathways of scaling up the intervention.

Our findings on PM+ effectiveness are consistent with those of a recent global meta-analysis of scalable psychological interventions including PM+,Reference Schäfer, Thomas, Lindner and Lieb80 confirming that PM+ is effective in reducing distress and promoting positive mental health in people exposed to adversities. Nonetheless, there is still a need for larger high-quality evidence including research on participant-level moderators of the effects of these interventions, and studies that evaluate cost-effectiveness and how to best integrate PM+ into stepped care programmes.Reference Schäfer, Thomas, Lindner and Lieb80 Efforts are already underway, and such research is being prepared.Reference Melchior, Figueiredo, Roversi, Dubanchet, Bui and Vadell-Martínez81Reference Falgas-Bague, Melero-Dominguez, de Vernisy-Romero, Tembo, Chembe and Lubozha86

Our observation that most of the existing research on PM+ is concentrated in LMICs is expected. The mental health treatment gap is often more pronounced in these areas; therefore, the case for testing scalable psychological interventions would be significantly stronger.Reference Patel, Maj, Flisher, De Silva, Koschorke and Prince3 This is very encouraging and aligns with the WHO's Mental Health Gap Action Programme (mhGAP),Reference World Health Organization87 which aims to scale-up services for mental, neurological and substance use disorders for countries, especially within LMICs.Reference Alonso, Liu, Evans-Lacko, Sadikova, Sampson and Chatterji88,Reference Thornicroft, Chatterji, Evans-Lacko, Gruber, Sampson and Aguilar-Gaxiola89 Our results also add to the growing interest in low-intensity interventions in a few HICs as part of a stepped care model to address the mental health needs of communities affected by adversity as they use fewer resources, making them more scalable. A growing body of evidence indicates that the adapted forms of therapy, such as cognitive–behavioural therapy and interpersonal therapy, can be effective in different cultures around the world when they are culturally adapted. Our review found that PM+ research was frequently conducted in populations affected by humanitarian crises, including refugees/asylum seekers/internally displaced, residents of earthquake-prone areas and COVID-19 pandemic hotspots, in about two-thirds of the experimental studies. Other populations included women with a history of gender-based violence, emerging adults living with HIV, adults in primary care settings, adults living with multiple myeloma and parents of children living with autism spectrum disorder. As it is established in the literature,Reference Too, Abubakar, Nasambu, Koot, Cuijpers and Newton90Reference Gu, Shan, Wang, Gao and Liu93 people in the abovementioned population groups have an increased risk of developing CMDs and could thus benefit from PM+.

Noteworthily, almost three-quarters of PM+ clients in the included experimental studies were women. It is possible that existing mental health treatments are not engaging or accessible to men.Reference Bilsker, Fogarty and Wakefield94,Reference Seidler, Rice, Ogrodniczuk, Oliffe and Dhillon95 Past research has shown that men are less likely than women to seek help for mental health problems, including CMDs.Reference Liddon, Kingerlee and Barry96,Reference Rice, Aucote, Parker, Alvarez-Jimenez, Filia and Amminger97 This difference could be a result of stigma associated with mental illness or cultural attitudes, e.g. where men are ‘allowed’ to express their distress through alcohol and substance misuse, whereas it is more ‘accepted’ for women to express their distress.Reference Uy, Massoth and Gottdiener98 Some men view mental health problems and help-seeking as a sign of weakness.Reference Lynch, Long and Moorhead99 Frequently reported barriers to male participation include stigma of mental illness, illness severity, confidentiality concerns, inconvenience, transport challenges and lack of financial reward.Reference Woodall, Morgan, Sloan and Howard100 The underrepresentation of men in PM+ is significant. More research should be conducted to understand why this is the case, and encourage approaches that are engaging and appealing for men to enhance access.

Cultural adaptation of content and implementation strategies are needed for effective scale-up of psychological interventions, and different frameworks exist to guide this process.Reference Sangraula, Kohrt, Ghimire, Shrestha, Luitel and van't Hof40,Reference Bernal and Sáez-Santiago75,Reference Chambers and Norton101,Reference Heim and Kohrt102 Meta-analytic evidence indicates that culturally adapted psychological interventions are effective when compared with a variety of control conditions,Reference Griner and Smith103 and more effective than unadapted versions of the same interventions in direct comparison.Reference Hall, Ibaraki, Huang, Marti and Stice104 In our review, all of the experimental studies reported PM+ adaptation using different methods or frameworks. This led to changes in the intervention manual, training, supervision and implementation/delivery protocols. Expectedly, all except one of the pilot/feasibility trials found PM+, both group and individual formats, feasible, acceptable and safe, evidenced by high retention rates and implementation by trained and supervised non-specialist PM+ helpers.

The intersection of technology and mental health services has brought revolutionary changes in confronting mental health challenges for the past two decades. Digital technologies have enhanced mental health services by offering effective and timely solutions that scale-up and decentralise mental healthcare across several platforms, e.g. mobile health applications, teletherapy and web-based interventions.Reference Li105,Reference Bond, Mulvenna, Potts, O'Neill, Ennis and Torous106 These advancements provide innovative solutions and make mental health services accessible and affordable. The COVID-19 pandemic placed a tremendous strain on research activities, e.g. the halting of research studies, as shown in one of the studies included in this review.Reference Dowrick, Rosala-Hallas, Rawlinson, Khan, Winrow and Chiumento26However, it also created a unique opportunity for greater application of these technologies in mitigating the pandemic-driven spike in mental health problems.Reference Li105,Reference Wind, Rijkeboer, Andersson and Riper107,108 In our review, five studies leveraged technology to implement PM+ through videoconferencing or live streaming,Reference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15,Reference Qi, Wang and Cao47 mobile telephone callsReference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14 and video calls.Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24 Four of these studiesReference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14,Reference Mediavilla, Felez-Nobrega, McGreevy, Monistrol-Mula, Bravo-Ortiz and Bayón15,Reference de Graaff, Cuijpers, Twisk, Kieft, Hunaidy and Elsawy24 were implemented during the COVID-19 pandemic period. Findings from some of these studiesReference Bryant, Dawson, Keyan, Azevedo, Yadav and Tran12,Reference Nyongesa, Mwangome, Mwangi, Nasambu, Mbuthia and Koot14 provide initial evidence of leveraging technology in implementing PM+ in addition to the face-to-face delivery formats, and may offer viable and scalable approaches to mitigating mental health problems during crises. Further research is needed to provide a nuanced understanding on the application of different digital technologies in the implementation of PM+.

Our review also found modest benefits of PM+ in the short term compared with control clients in improving symptoms of depression, anxiety and PTSD, psychological distress, and functional impairment, where all of these were studied as primary outcomes. These findings suggest that PM+ is efficacious, at least in the short term, and adds to the growing body of research on the effectiveness of brief, low-intensity psychological interventions that may be used to reduce the prevailing mental health treatment gap. Our finding on the effectiveness of PM+ in this review is limited only in the short term. Only one RCT evaluated the long-term impact of PM+ at 12 months;Reference Bryant, Bawaneh, Awwad, Al-Hayek, Giardinelli and Whitney35 however, additional data is expected from the STRENGTHS Consortium.79 In our review, PM+ did not show any benefit at the primary end point of 12 months, in contrast to the observation that at 3 months, the intervention led to higher reductions in depressive symptoms. This finding is consistent with previous evidence reporting that the benefits of psychological interventions do not consistently persist despite initial improvement in symptoms.Reference Brouwer, Williams, Kennis, Fu, Klein and Cuijpers109,Reference Paykel110 Given the limited research in this area, the findings point to the need for more evaluation of the long-term impact of PM+. As it stands, however, the challenge is in developing ongoing programmes that can sustain the initial gains of effective interventions. One way to address this issue is by delivering booster sessions or practice reminders for the PM+ strategies. The use of stepped care programmes might further triage people with severe distress to more intensive programmes, whereas those with moderate distress may still benefit from brief interventions. Booster sessions have been shown to be effective in preventing relapse for a range of mental health conditions, including CMDs.Reference Gearing, Schwalbe, Lee and Hoagwood111,Reference Bruijniks, Lemmens, Hollon, Peeters, Cuijpers and Arntz112 Booster sessions can also benefit clients who did not attend all the intervention sessions, giving them a chance to learn or reinforce these strategies. We also cannot make gender-specific conclusions about the effectiveness of PM+, as this was not reported in the included studies. Future studies could further consider a gender perspective through research and implementation practices.

PM+ was also associated with significant positive improvements in a range of secondary outcomes, including personally identified problems, quality of life, social support, COVID-19-related fears and contamination, parenting stress and reductions in inconsistent disciplinary parenting that resulted in reductions in attentional and internalising problems in children. These findings suggest that PM+ is positively associated with broader and multidimensional aspects across the health spectrum.

Significant progress has been made in terms of the availability of evidence-based mental health packages for populations affected by adversity, especially in LMICs. Nonetheless, the scalability and sustainability of such mental health interventions remain an important challenge in LMICs. None of the included studies described the scale-up of the PM+ intervention; however, a few studies examined the potential scale-up by describing the pathways and factors influencing scale-up. For PM+ to be successfully scaled up, it is critical for it to be effectively integrated into existing health systems, as well as assessing the perceived benefit among potential recipients and addressing any demand gaps. Additionally, factors that are likely to enhance the scale-up, such as quality and delivery methods, need to be examined and improved. Also important is addressing prevailing barriers, e.g. mental health stigma. Although none of the research papers described/examined the actual scale-up of PM+, we found several reports from grey literature search that reported on the routine implementation of PM+ in different settings. The Kenyan Ministry of Health created a service delivery framework for the implementation of PM+, outlining how the national and county Ministries of Health link together and support county-level centres of excellence for long-term sustainable training and support of PM+ helpers, who are then linked to primary and community health units.113 Between 2013 and 2018, 1697 PM+ helpers and 20 master trainers had been trained. Additionally, 70 representatives from eight community-based organisations have also been trained in leadership, governance and business planning to ensure sustainability. In 2021, a total of 608 people (social workers, refugee volunteers and psychologists) were also trained on PM+ in Cameroon, Egypt, Ethiopia, Greece, Kenya, Niger, Peru and Sudan.114,115 Another 351 PM+ helpers and supervisors have also been trained in Rwanda, Peru, Mexico and Malawi.Reference Coleman, Mukasakindi, Rose, Galea, Nyirandagijimana and Hakizimana57 Over 100 people have also been trained on group PM+ to facilitate national coverage of PM+ for refugees across Jordan.116 Additional data is expected for Venezuelan women refugees and migrants in Colombia.Reference Sangraula, Greene, Castellar, de la Hoz, Diaz and Merino117 From these reports, ownership of the programme by the local government, infrastructure investments and relevant training and supervision for PM+ helpers are critical for the transition to scale. More research is needed to assess the barriers and facilitators to routine PM+ implementation to inform further application.

One of the studiesReference Hamdani, Rahman, Wang, Chen, van Ommeren and Chisholm20 evaluated the cost-effectiveness of the PM+ intervention compared with enhanced usual care for CMDs in primary healthcare in Pakistan, to inform its potential scale-up. PM+ was found to be more effective, but also more costly, than enhanced usual care in reducing symptoms of depression and anxiety and improving functioning. This finding is consistent with evidence from LMICs on the cost-effectiveness of a task-shifting approach of delivering mental health interventions for treating CMDs delivered by primary care physicians.Reference Buttorff, Hock, Weiss, Naik, Araya and Kirkwood118,Reference Weobong, Weiss, McDaid, Singla, Hollon and Nadkarni119 With the current model of training and supervision by international trainers/supervisors, PM+ was five times more costly for treating a person with depression compared with the cost of training and supervision by local trainers. This emphasises the importance of building up local capacity, working with local communities and mobilising local resources, as recommended by the Inter-Agency Standing Committee guidelines in mental health and psychosocial support (MHPSS) interventions.Reference Murray, Dorsey, Bolton, Jordans, Rahman and Bass120 Additional cost-effectiveness is soon expected from the STRENGTHS Consortium.121,122 Preliminary evidence shows that at 3 months, PM+ is likely to have better outcomes, but at higher costs than usual care. The upcoming 12-month analysis will shed more light on this.

Task-shifting is a promising approach to addressing healthcare shortages, especially in LMICs. Accumulating evidence, especially from LMICs, shows that task-shifting can be a cost-effective approach to enhancing access to healthcare and improving patient outcomes for different health problems.Reference Barnett, Gonzalez, Miranda, Chavira and Lau123Reference Callaghan, Ford and Schneider126 However, there are few published reports on the cost-effectiveness of task-shifting psychological interventions in global mental health.Reference Buttorff, Hock, Weiss, Naik, Araya and Kirkwood118,Reference Weobong, Weiss, McDaid, Singla, Hollon and Nadkarni119,Reference Sikander, Ahmad, Atif, Zaidi, Vanobberghen and Weiss127Reference Levin and Chisholm129 Our finding that PM+ was more expensive compared with usual care alone in the only study that assessed its cost-effectiveness is consistent with previous studies involving other mental health interventions.Reference Sikander, Ahmad, Atif, Zaidi, Vanobberghen and Weiss127,Reference Araya, Flynn, Rojas, Fritsch and Simon128 Given the limited number of studies and mixed findings, more studies are needed to shed more light on this subject. Without appropriate design and planning, e.g. adapting models into local contexts and enabling policy environment, task-shifting may increase system costs or minimise efficiency, and not be as effective as envisaged.Reference Seidman and Atun124 In a review of reviews, Heller et al identified various health system barriers and facilitators of task-shifting regarding each of the WHO's health system building blocks.Reference Heller, Kumar, Kishore, Horowitz, Joshi and Vedanthan130 Findings consistently identified six important lessons for successful task-shifting, including careful staff recruitment, comprehensive training, authorisation to provide autonomous care, sufficient medications and supplies, reliable data systems and fair performance-based compensation.

Limitations

We did not appraise the quality of the included studies; however, this is a primary limitation of scoping reviews. Relatedly, we also did not pre-register the scoping review protocol. We also did not conduct a local consultation in regard to the Arksey and O'Malley scoping review framework, because of limited resources.

Future research

Most of the included RCTs measured effectiveness in the short term; thus, the long-term effects of PM+ are largely unknown. We recommend that future studies explore this area. Similarly, additional studies on the cost-effectiveness and scalability of the PM+ are needed. The majority of the PM+ clients in the review were women. Future studies need to assess the effectiveness of PM+ specifically for men, or include large enough sample sizes of men and provide gender-specific results. We were also unable to map specific roles, training infrastructure, supervision structures and remuneration models for the non-specialist PM+ providers, pointing to potential directions for future policy and research initiatives. It is not evident within the research who is making decisions about their qualifications outside the respective study authors and investigators.

In conclusion, since its introduction in 2016, the PM+ intervention has been adapted and implemented in various vulnerable populations, primarily in humanitarian populations in HICs and LMICs. Our scoping review has summarised PM+ evidence to date regarding its adaptation, feasibility, effectiveness and potential scale-up, subsequently identifying important implications for policy makers, practitioners and local communities. Our review found a large variation in PM+ implementation, e.g. in terms of delivery methods, training and supervision of PM+ helpers. Potential implementors of PM+ need to be aware of these issues as they select, adapt and implement the variants of PM+ to maximise positive intervention outcomes and sustainability. Our findings also emphasise the crucial need to build local capacity, which may further drive scale-up. There is also scope for a common framework for training, supervising and implementing PM+ among stakeholders.

Supplementary material

Supplementary material is available online at https://doi.org/10.1192/bjo.2024.55

Data availability

Data availability is not applicable to this article as no new data were created or analysed in this study. Additional data/information has been shared in the Supplementary Material.

Author contributions

A.A. conceptualised the study. P.N.M. developed the review protocol, which A.A. and M.K.N. then refined. P.N.M. did the database search. P.N.M., M.K.N., M.M. and A.K. reviewed titles, abstracts and full-text papers for eligibility and A.A. provided guidance throughout the process. M.M. wrote the first draft of the introduction. P.N.M. wrote the first draft of the methods and discussion. P.N.M., M.K.N., M.M. and A.K. contributed to writing the first draft of the results section. All authors read, reviewed and approved the final version of the manuscript.

Funding

This publication was produced with the financial support of Global Affairs Canada (grant number P_007597). Its contents are the sole responsibility of the authors and do not necessarily reflect the views of Global Affairs Canada. The funders had no role in the study's design, in the collection, analyses or interpretation of data, in the writing of the manuscript or in the decision to publish the results.

Declaration of interest

None.

References

Dybdahl, R, Lien, L. Mental health is an integral part of the sustainable development goals. Prev Med Commun Health 2017; 1(1): 13.Google Scholar
GBD 2019 Mental Disorders Collaborators. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990–2019: a systematic analysis for the global burden of disease study 2019. Lancet Psychiatry 2022; 9(2): 137–50.CrossRefGoogle Scholar
Patel, V, Maj, M, Flisher, AJ, De Silva, MJ, Koschorke, M, Prince, M, et al. Reducing the treatment gap for mental disorders: a WPA survey. World Psychiatry 2010; 9(3): 169–76.CrossRefGoogle ScholarPubMed
Singla, DR, Kohrt, BA, Murray, LK, Anand, A, Chorpita, BF, Patel, V. Psychological treatments for the world: lessons from low-and middle-income countries. Ann Rev Clin Psychol 2017; 13: 149–81.CrossRefGoogle ScholarPubMed
Barbui, C, Purgato, M, Abdulmalik, J, Acarturk, C, Eaton, J, Gastaldon, C, et al. Efficacy of psychosocial interventions for mental health outcomes in low-income and middle-income countries: an umbrella review. Lancet Psychiatry 2020; 7(2): 162–72.CrossRefGoogle ScholarPubMed
Esponda, GM, Hartman, S, Qureshi, O, Sadler, E, Cohen, A, Kakuma, R. Barriers and facilitators for the implementation of mental health programmes in primary care in low-and middle-income countries: a systematic review. Lancet Psychiatry 2020; 7(1): 7892.CrossRefGoogle Scholar
Troup, J, Fuhr, DC, Woodward, A, Sondorp, E, Roberts, B. Barriers and facilitators for scaling up mental health and psychosocial support interventions in low-and middle-income countries for populations affected by humanitarian crises: a systematic review. Int J Ment Health Syst 2021; 15: 5.CrossRefGoogle ScholarPubMed
Bennett-Levy, J, Richards, D, Farrand, P, Christensen, H, Griffiths, K, Kavanagh, D, et al. Oxford Guide to Low Intensity CBT Interventions. Oxford University Press, 2010.Google Scholar
Patel, V, Chowdhary, N, Rahman, A, Verdeli, H. Improving access to psychological treatments: lessons from developing countries. Behav Res Ther 2011; 49(9): 523–8.CrossRefGoogle ScholarPubMed
World Health Organization, . Problem Management Plus (PM+): Individual Psychological Help for Adults Impaired by Distress in Communities Exposed to Adversity. WHO, 2016 (https://iris.who.int/bitstream/handle/10665/206417/WHO_?sequence=1).Google Scholar
World Health Organization, . Group Problem Management Plus (Group PM+): Group Psychological Help for Adults Impaired by Distress in Communities Exposed to Adversity. WHO, 2020 (https://iris.who.int/bitstream/handle/10665/334055/9789240008106-eng.pdf).Google Scholar
Bryant, RA, Dawson, KS, Keyan, D, Azevedo, S, Yadav, S, Tran, J, et al. Effectiveness of a videoconferencing-delivered psychological intervention for mental health problems during COVID-19: a proof-of-concept randomized clinical trial. Psychother Psychosom 2022; 91(1): 6372.CrossRefGoogle ScholarPubMed
Morina, N, Weilenmann, S, Dawson, KS, Ernst, J, Zanitti, Z, von Känel, R, et al. Efficacy of a brief psychological intervention to reduce distress in healthcare workers during the COVID-19 pandemic: a randomised controlled trial. Psychological trauma: theory, research. Pract Policy 2023; 15(S2): S371.Google Scholar
Nyongesa, MK, Mwangome, E, Mwangi, P, Nasambu, C, Mbuthia, JW, Koot, HM, et al. Adaptation, acceptability and feasibility of problem management plus (PM+) intervention to promote the mental health of young people living with HIV in Kenya: formative mixed-methods research. BJPsych Open 2022; 8(5): e161.CrossRefGoogle ScholarPubMed
Mediavilla, R, Felez-Nobrega, M, McGreevy, KR, Monistrol-Mula, A, Bravo-Ortiz, M-F, Bayón, C, et al. Effectiveness of a mental health stepped-care programme for healthcare workers with psychological distress in crisis settings: a multicentre randomised controlled trial. BMJ Ment Health 2023; 26(1): e300697.CrossRefGoogle ScholarPubMed
Bryant, RA, Schafer, A, Dawson, KS, Anjuri, D, Mulili, C, Ndogoni, L, et al. Effectiveness of a brief behavioural intervention on psychological distress among women with a history of gender-based violence in urban Kenya: a randomised clinical trial. PLoS Med 2017; 14(8): e1002371.CrossRefGoogle Scholar
Rahman, A, Hamdani, SU, Awan, NR, Bryant, RA, Dawson, KS, Khan, MF, et al. Effect of a multicomponent behavioral intervention in adults impaired by psychological distress in a conflict-affected area of Pakistan: a randomized clinical trial. JAMA 2016; 316(24): 2609–17.CrossRefGoogle Scholar
Bryant, RA, Bawaneh, A, Awwad, M, Al-Hayek, H, Giardinelli, L, Whitney, C, et al. Effectiveness of a brief group behavioral intervention for common mental disorders in Syrian refugees in Jordan: a randomized controlled trial. PLoS Med 2022; 19(3): e1003949.CrossRefGoogle ScholarPubMed
Jordans, MJ, Kohrt, BA, Sangraula, M, Turner, EL, Wang, X, Shrestha, P, et al. Effectiveness of group problem management plus, a brief psychological intervention for adults affected by humanitarian disasters in Nepal: a cluster randomized controlled trial. PLoS Med 2021; 18(6): e1003621.Google Scholar
Hamdani, SU, Rahman, A, Wang, D, Chen, T, van Ommeren, M, Chisholm, D, et al. Cost-effectiveness of WHO problem management plus for adults with mood and anxiety disorders in a post-conflict area of Pakistan: randomised controlled trial. Br J Psychiatry 2020; 217(5): 623–9.CrossRefGoogle Scholar
Nemiro, A, Van't Hof, E, Constant, S. After the randomised controlled trial: implementing problem management plus through humanitarian agencies: three case studies from Ethiopia, Syria and Honduras. Intervention 2021; 19(1): 84.CrossRefGoogle Scholar
Spaaij, J, Kiselev, N, Berger, C, Bryant, RA, Cuijpers, P, De Graaff, AM, et al. Feasibility and acceptability of problem management plus (PM+) among Syrian refugees and asylum seekers in Switzerland: a mixed-method pilot randomized controlled trial. Eur J Psychotraumatol 2022; 13(1): 2002027.CrossRefGoogle ScholarPubMed
de Graaff, AM, Cuijpers, P, McDaid, D, Park, A, Woodward, A, Bryant, RA, et al. Peer-provided problem management plus (PM+) for adult Syrian refugees: a pilot randomised controlled trial on effectiveness and cost-effectiveness. Epidemiol Psychiatr Sci 2020; 29: e162.CrossRefGoogle Scholar
de Graaff, AM, Cuijpers, P, Twisk, JW, Kieft, B, Hunaidy, S, Elsawy, M, et al. Peer-provided psychological intervention for Syrian refugees: results of a randomised controlled trial on the effectiveness of problem management plus. BMJ Ment Health 2023; 26(1): e300637.CrossRefGoogle ScholarPubMed
Sijbrandij, M, Acarturk, C, Bird, M, Bryant, RA, Burchert, S, Carswell, K, et al. Strengthening mental health care systems for Syrian refugees in Europe and the Middle East: integrating scalable psychological interventions in eight countries. Eur J Psychotraumatol 2017; 8(Suppl 2): 1388102.CrossRefGoogle ScholarPubMed
Dowrick, C, Rosala-Hallas, A, Rawlinson, R, Khan, N, Winrow, E, Chiumento, A, et al. The problem management plus psychosocial intervention for distressed and functionally impaired asylum seekers and refugees: the PROSPER feasibility RCT. Public Health Res 2022; 10: 10.CrossRefGoogle Scholar
Arksey, H, O'Malley, L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005; 8(1): 1932.CrossRefGoogle Scholar
Levac, D, Colquhoun, H, O'Brien, KK. Scoping studies: advancing the methodology. Implement Sci 2010; 5: 19.CrossRefGoogle ScholarPubMed
Tricco, AC, Lillie, E, Zarin, W, O'Brien, KK, Colquhoun, H, Levac, D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018; 169(7): 467–73.CrossRefGoogle ScholarPubMed
Peters, MD, Godfrey, CM, McInerney, P, Soares, CB, Khalil, H, Parker, D. The Joanna Briggs Institute reviewers’ manual 2015: Methodology for JBI Scoping Reviews. Joanna Briggs Institute, 2015 (https://reben.com.br/revista/wp-content/uploads/2020/10/Scoping.pdf).Google Scholar
Rahman, A, Khan, MN, Hamdani, SU, Chiumento, A, Akhtar, P, Nazir, H, et al. Effectiveness of a brief group psychological intervention for women in a post-conflict setting in Pakistan: a single-blind, cluster, randomised controlled trial. Lancet 2019; 393(10182): 1733–44.CrossRefGoogle Scholar
Khan, M, Hamdani, S, Chiumento, A, Dawson, K, Bryant, R, Sijbrandij, M, et al. Evaluating feasibility and acceptability of a group WHO trans-diagnostic intervention for women with common mental disorders in rural Pakistan: a cluster randomised controlled feasibility trial. Epidemiol Psychiatr Sci 2019; 28(1): 7787.CrossRefGoogle ScholarPubMed
Hamdani, SU, Huma, Z-e, Masood, A, Zhou, K, Ahmed, Z, Nazir, H, et al. Effect of adding a psychological intervention to routine care of common mental disorders in a specialized mental healthcare facility in Pakistan: a randomized controlled trial. Int J Ment Health Syst 2021; 15(1): 11.CrossRefGoogle Scholar
Woodward, A, Sondorp, E, Barry, AS, Dieleman, MA, Fuhr, DC, Broerse, JE, et al. Scaling up task-sharing psychological interventions for refugees in Jordan: a qualitative study on the potential barriers and facilitators. Health Policy Plann 2023; 38(3): 310–20.CrossRefGoogle Scholar
Bryant, RA, Bawaneh, A, Awwad, M, Al-Hayek, H, Giardinelli, L, Whitney, C, et al. Twelve-month follow-up of a randomised clinical trial of a brief group psychological intervention for common mental disorders in Syrian refugees in Jordan. Epidemiol Psychiatr Sci 2022; 31: e81.CrossRefGoogle ScholarPubMed
Akhtar, A, Giardinelli, L, Bawaneh, A, Awwad, M, Al-Hayek, H, Whitney, C, et al. Feasibility trial of a scalable transdiagnostic group psychological intervention for Syrians residing in a refugee camp. Eur J Psychotraumatol 2021; 12(1): 1932295.CrossRefGoogle Scholar
Van't Hof, E, Dawson, KS, Schafer, A, Chiumento, A, Shehadeh, MH, Sijbrandij, M, et al. A qualitative evaluation of a brief multicomponent intervention provided by lay health workers for women affected by adversity in urban Kenya. Glob Ment Health 2018; 5: e6.CrossRefGoogle ScholarPubMed
Sijbrandij, M, Bryant, RA, Schafer, A, Dawson, KS, Anjuri, D, Ndogoni, L, et al. Problem management plus (PM+) in the treatment of common mental disorders in women affected by gender-based violence and urban adversity in Kenya; study protocol for a randomized controlled trial. Int J Ment Health Syst 2016; 10: 44.CrossRefGoogle Scholar
Sangraua, M, Turner, E, Luitel, N, Van‘t Hof, E, Shrestha, P, Ghimire, R, et al. Feasibility of group problem management plus (PM+) to improve mental health and functioning of adults in earthquake-affected communities in Nepal. Epidemiol Psychiatr Sci 2020; 29: e130.CrossRefGoogle Scholar
Sangraula, M, Kohrt, BA, Ghimire, R, Shrestha, P, Luitel, NP, van't Hof, E, et al. Development of the mental health cultural adaptation and contextualization for implementation (mhCACI) procedure: a systematic framework to prepare evidence-based psychological interventions for scaling. Glob Ment Health 2021; 8: e6.CrossRefGoogle ScholarPubMed
Woodward, A, de Graaff, AM, Dieleman, MA, Roberts, B, Fuhr, DC, Broerse, JE, et al. Scalability of a task-sharing psychological intervention for refugees: a qualitative study in The Netherlands. SSM Ment Health 2022; 2: 100171.CrossRefGoogle Scholar
Fuhr, DC, Acarturk, C, Uygun, E, McGrath, M, Ilkkursun, Z, Kaykha, S, et al. Pathways towards scaling up problem management plus in Turkey: a theory of change workshop. Confl Health 2020; 14: 22.CrossRefGoogle Scholar
Acarturk, C, Uygun, E, Ilkkursun, Z, Yurtbakan, T, Kurt, G, Adam-Troian, J, et al. Group problem management plus (PM+) to decrease psychological distress among Syrian refugees in Turkey: a pilot randomised controlled trial. BMC Psychiatry 2022; 22: 8.CrossRefGoogle Scholar
Knefel, M, Kantor, V, Weindl, D, Schiess-Jokanovic, J, Nicholson, AA, Verginer, L, et al. Mental health professionals’ perspective on a brief transdiagnostic psychological intervention for Afghan asylum seekers and refugees. Eur J Psychotraumatol 2022; 13(1): 2068913.CrossRefGoogle ScholarPubMed
Knefel, M, Kantor, V, Weindl, D, Schiess-Jokanovic, J, Nicholson, AA, Verginer, L, et al. A brief transdiagnostic psychological intervention for Afghan asylum seekers and refugees in Austria: a randomized controlled trial. Eur J Psychotraumatol 2022; 13(1): 2068911.CrossRefGoogle ScholarPubMed
Zhang, H, Zhang, D, Lin, H, Huang, L. Problem management plus in the treatment of mental disorders in patients with multiple myeloma. Support Care Cancer 2020; 28: 4721–7.CrossRefGoogle ScholarPubMed
Qi, A, Wang, F, Cao, T. Effect of psychological counseling based on problem management plus on social anxiety in parents of children with autism Spectrum disorder. Iran J Public Health 2023; 52(2): 325.Google ScholarPubMed
Spaaij, J, Fuhr, DC, Akhtar, A, Casanova, L, Klein, T, Schick, M, et al. Scaling-up problem management plus for refugees in Switzerland-a qualitative study. BMC Health Serv Res 2023; 23(1): 488.CrossRefGoogle ScholarPubMed
Perera, C, Aldamman, K, Hansen, M, Haahr-Pedersen, I, Caballero-Bernal, J, Caldas-Castaneda, ON, et al. A brief psychological intervention for improving the mental health of Venezuelan migrants and refugees: a mixed-methods study. SSM Ment Health 2022; 2: 100109.CrossRefGoogle Scholar
Dozio, E, Dill, AS, Bizouerne, C. Problem management plus adapted for group use to improve mental health in a war-affected population in the Central African Republic. Intervention 2021; 19(1): 91.CrossRefGoogle Scholar
Gebrekristos, F, Eloul, L, Golden, S. A field report on the pilot implementation of problem management plus with Lay providers in an Eritrean refugee setting in Ethiopia. Intervention 2021; 19(1): 101.Google Scholar
Galea, JT, Sanabria, G, Greene, KY, Thompson, M, Doering, T, Fuchs, D, et al. MSW students’ perspectives on learning and delivering a protocolized, low-intensity transdiagnostic psychological intervention: implications for experiential learning. Commun Ment Health J 2023; 59(4): 812–7.CrossRefGoogle ScholarPubMed
Musotsi, P, Koyiet, P, Khoshaba, NB, Ali, AH, Elias, F, Abdulmaleek, MW, et al. Highlighting complementary benefits of problem management plus (PM+) and doing what matters in times of stress (DWM) interventions delivered alongside broader community MHPSS programming in Zummar, Ninewa governorate of Iraq. Intervention 2022; 20(2): 139.CrossRefGoogle Scholar
Tay, AK, Mung, HK, Miah, MAA, Balasundaram, S, Ventevogel, P, Badrudduza, M, et al. An integrative adapt therapy for common mental health symptoms and adaptive stress amongst Rohingya, Chin, and Kachin refugees living in Malaysia: a randomized controlled trial. PLoS Med 2020; 17(3): e1003073.CrossRefGoogle Scholar
McBride, KA, Harrison, S, Mahata, S, Pfeffer, K, Cardamone, F, Ngigi, T, et al. Building mental health and psychosocial support capacity during a pandemic: the process of adapting problem management plus for remote training and implementation during COVID-19 in New York city, Europe and East Africa. Intervention 2021; 19(1): 37.Google Scholar
Fuhr, DC, Acarturk, C, Sijbrandij, M, Brown, FL, Jordans, MJ, Woodward, A, et al. Planning the scale up of brief psychological interventions using theory of change. BMC Health Serv Res 2020; 20: 801.CrossRefGoogle ScholarPubMed
Coleman, SF, Mukasakindi, H, Rose, AL, Galea, JT, Nyirandagijimana, B, Hakizimana, J, et al. Adapting problem management plus for implementation: lessons learned from public sector settings across Rwanda, Peru, Mexico and Malawi. Intervention 2021; 19(1): 58.CrossRefGoogle ScholarPubMed
Akhtar, A, Engels, MH, Bawaneh, A, Bird, M, Bryant, R, Cuijpers, P, et al. Cultural adaptation of a low-intensity group psychological intervention for Syrian refugees. Intervention 2021; 19(1): 48.CrossRefGoogle Scholar
Dawson, KS, Schafer, A, Anjuri, D, Ndogoni, L, Musyoki, C, Sijbrandij, M, et al. Feasibility trial of a scalable psychological intervention for women affected by urban adversity and gender-based violence in Nairobi. BMC Psychiatry 2016; 16(1): 410.CrossRefGoogle ScholarPubMed
Perera, C, Salamanca-Sanabria, A, Caballero-Bernal, J, Feldman, L, Hansen, M, Bird, M, et al. No implementation without cultural adaptation: a process for culturally adapting low-intensity psychological interventions in humanitarian settings. Confl Health 2020; 14: 46.CrossRefGoogle ScholarPubMed
Zigmond, AS, Snaith, RP. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand 1983; 67(6): 361–70.CrossRefGoogle ScholarPubMed
Derogatis, LR, Lipman, RS, Rickels, K, Uhlenhuth, EH, Covi, L. The Hopkins Symptom Checklist (HSCL): a self-report symptom inventory. Behav Sci 1974; 19(1): 115.CrossRefGoogle ScholarPubMed
Goldberg, DP, Williams, P. A User's Guide to the General Health Questionnaire. NferNelson, 1988.Google Scholar
Kroenke, K, Spitzer, RL, Williams, JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001; 16(9): 606–13.CrossRefGoogle ScholarPubMed
Spitzer, RL, Kroenke, K, Williams, JB, Löwe, B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006; 166(10): 1092–7.CrossRefGoogle ScholarPubMed
Kessler, RC, Andrews, G, Colpe, LJ, Hiripi, E, Mroczek, DK, Normand, S-L, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 2002; 32(6): 959–76.CrossRefGoogle ScholarPubMed
Li, F, Su, L, Jin, Y. Norm of the screen for child social anxiety related emotional disorders in Chinese urban children. Chin J Child Health Care 2006; 14(4): 335–7.Google Scholar
Kroenke, K, Wu, J, Yu, Z, Bair, MJ, Kean, J, Stump, T, et al. The Patient Health Questionnaire Anxiety and Depression Scale (PHQ-ADS): initial validation in three clinical trials. Psychosom Med 2016; 78(6): 716.CrossRefGoogle ScholarPubMed
Üstün, TB, Chatterji, S, Kostanjsek, N, Rehm, J, Kennedy, C, Epping-Jordan, J, et al. Developing the World Health Organization Disability Assessment Schedule 2.0. Bull World Health Organ 2010; 88: 815–23.CrossRefGoogle ScholarPubMed
Topp, CW, Østergaard, SD, Søndergaard, S, Bech, P. The WHO-5 Well-Being Index: a systematic review of the literature. Psychother Psychosom 2015; 84(3): 167–76.CrossRefGoogle ScholarPubMed
Ashworth, MM, Christey, J, Matthews, V, Wright, K, Parmentier, H, Robinson, S, et al. A client-generated psychometric instrument: the development of ‘PSYCHLOPS’. Couns Psychother Res 2013; 4(4): 2731.CrossRefGoogle Scholar
WHOQOL Group. Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med 1998; 28(3): 551–8.CrossRefGoogle Scholar
Blevins, CA, Weathers, FW, Davis, MT, Witte, TK, Domino, JL. The Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J Trauma Stress 2015; 28(6): 489–98.CrossRefGoogle ScholarPubMed
Khalily, MT, Gul, S, Mushtaq, R, Jahangir, SF. To examine delayed PTSD symptomatology over time among trauma survivors in Pakistan. Online J Couns Educ 2012; 1(1): 111.Google Scholar
Bernal, G, Sáez-Santiago, E. Culturally centered psychosocial interventions. J Commun Psychol 2006; 34(2): 121–32.CrossRefGoogle Scholar
Bird, VJ, Le Boutillier, C, Leamy, M, Williams, J, Bradstreet, S, Slade, M. Evaluating the feasibility of complex interventions in mental health services: standardised measure and reporting guidelines. Br J Psychiatry 2014; 204(4): 316–21.CrossRefGoogle ScholarPubMed
Skivington, K, Matthews, L, Simpson, SA, Craig, P, Baird, J, Blazeby, JM, et al. A new framework for developing and evaluating complex interventions: update of medical research council guidance. BMJ 2021; 374: n2061.Google ScholarPubMed
Gadke, DL, Kratochwill, TR, Gettinger, M. Incorporating feasibility protocols in intervention research. J Sch Psychol 2021; 84: 118.CrossRefGoogle ScholarPubMed
STRENGTHS Research Consortium. Documents 2024. STRENGTHS Project, 2024 (http://strengths-project.eu/en/documents/).Google Scholar
Schäfer, SK, Thomas, LM, Lindner, S, Lieb, K. World Health Organization's low-intensity psychosocial interventions: a systematic review and meta-analysis of the effects of problem management plus and step-by-step. World Psychiatry 2023; 22(3): 449–62.CrossRefGoogle ScholarPubMed
Melchior, M, Figueiredo, N, Roversi, A, Dubanchet, A, Bui, E, Vadell-Martínez, J, et al. Addressing mental health problems among persons without stable housing in the context of the COVID-19 pandemic: study protocol for a randomised trial. RESPOND–France. BMC Public Health 2023; 23(1): 2275.CrossRefGoogle Scholar
Pfeffer, K, Brown, A, Kohrt, B, Sangraula, M, Bakke, S. Remote delivered psychosocial support to improve the wellbeing and functioning of adults affected by COVID-19 in New York city: remote problem management plus (PM+). Popul Med 2023; 5(Suppl): A1293.CrossRefGoogle Scholar
Roos, R, Witteveen, AB, Ayuso-Mateos, JL, Barbui, C, Bryant, RA, Felez-Nobrega, M, et al. Correction: effectiveness of a scalable, remotely delivered stepped-care intervention to reduce symptoms of psychological distress among Polish migrant workers in The Netherlands: study protocol for the RESPOND randomised controlled trial. BMC Psychiatry 2024; 24: 24.CrossRefGoogle ScholarPubMed
van der Boor, CF, Taban, D, Tol, WA, Akellot, J, Neuman, M, Weiss, HA, et al. Effectiveness and cost-effectiveness of a transdiagnostic intervention for alcohol misuse and psychological distress in humanitarian settings: study protocol for a randomised controlled trial in Uganda. Trials 2024; 25(1): 148.CrossRefGoogle ScholarPubMed
Keyan, D, Habashneh, R, Akhtar, A, El-Dardery, H, Faroun, M, Abualhaija, A, et al. Evaluating a stepped care model of psychological support for adults affected by adversity: study protocol for a randomised controlled trial in Jordan. BMJ Open 2024; 14(2): e078091.CrossRefGoogle ScholarPubMed
Falgas-Bague, I, Melero-Dominguez, M, de Vernisy-Romero, D, Tembo, T, Chembe, M, Lubozha, T, et al. Testing the feasibility, acceptability, and exploring trends on efficacy of the problem management plus for moms: protocol of a pilot randomized control trial. PLoS One 2024; 19(1): e0287269.CrossRefGoogle ScholarPubMed
World Health Organization, . mhGAP Intervention Guide for Mental, Neurological and Substance Use Disorders in Non-Specialized Health Settings: Mental Health Gap Action Programme (mhGAP). WHO, 2016 (https://www.who.int/publications-detail-redirect/9789241549790).Google Scholar
Alonso, J, Liu, Z, Evans-Lacko, S, Sadikova, E, Sampson, N, Chatterji, S, et al. Treatment gap for anxiety disorders is global: results of the world mental health surveys in 21 countries. Depress Anxiety 2018; 35(3): 195208.CrossRefGoogle ScholarPubMed
Thornicroft, G, Chatterji, S, Evans-Lacko, S, Gruber, M, Sampson, N, Aguilar-Gaxiola, S, et al. Undertreatment of people with major depressive disorder in 21 countries. Br J Psychiatry 2017; 210(2): 119–24.CrossRefGoogle ScholarPubMed
Too, EK, Abubakar, A, Nasambu, C, Koot, HM, Cuijpers, P, Newton, CR, et al. Prevalence and factors associated with common mental disorders in young people living with HIV in Sub-Saharan Africa: a systematic review. J Int AIDS Soc 2021; 24: e25705.CrossRefGoogle ScholarPubMed
Roca, M, Gili, M, Garcia-Garcia, M, Salva, J, Vives, M, Campayo, JG, et al. Prevalence and comorbidity of common mental disorders in primary care. J Affect Disord 2009; 119(1–3): 52–8.CrossRefGoogle ScholarPubMed
Rees, S, Silove, D, Chey, T, Ivancic, L, Steel, Z, Creamer, M, et al. Lifetime prevalence of gender-based violence in women and the relationship with mental disorders and psychosocial function. JAMA 2011; 306(5): 513–21.Google ScholarPubMed
Gu, X, Shan, X, Wang, L, Gao, W-Y, Liu, X-Q. Prevalence of psychological problems among caregivers of children and adolescents with neurodevelopmental disorders during the COVID-19 pandemic: a meta-analysis and systematic review. Res Dev Disabil 2023; 143: 104632.CrossRefGoogle ScholarPubMed
Bilsker, D, Fogarty, AS, Wakefield, MA. Critical issues in men's mental health. Can J Psychiatry 2018; 63(9): 590–6.CrossRefGoogle ScholarPubMed
Seidler, ZE, Rice, SM, Ogrodniczuk, JS, Oliffe, JL, Dhillon, HM. Engaging men in psychological treatment: a scoping review. Am J Mens Health 2018; 12(6): 1882–900.CrossRefGoogle ScholarPubMed
Liddon, L, Kingerlee, R, Barry, JA. Gender differences in preferences for psychological treatment, coping strategies, and triggers to help-seeking. Br J Clin Psychol 2018; 57(1): 4258.CrossRefGoogle ScholarPubMed
Rice, SM, Aucote, HM, Parker, AG, Alvarez-Jimenez, M, Filia, KM, Amminger, GP. Men's perceived barriers to help seeking for depression: longitudinal findings relative to symptom onset and duration. J Health Psychol 2017; 22(5): 529–36.CrossRefGoogle ScholarPubMed
Uy, PJ, Massoth, NA, Gottdiener, WH. Rethinking male drinking: traditional masculine ideologies, gender-role conflict, and drinking motives. Psychol Men Mascul 2014; 15(2): 121.CrossRefGoogle Scholar
Lynch, L, Long, M, Moorhead, A. Young men, help-seeking, and mental health services: exploring barriers and solutions. Am J Mens Health 2018; 12(1): 138–49.CrossRefGoogle ScholarPubMed
Woodall, A, Morgan, C, Sloan, C, Howard, L. Barriers to participation in mental health research: are there specific gender, ethnicity and age related barriers? BMC Psychiatry 2010; 10: 103.CrossRefGoogle ScholarPubMed
Chambers, DA, Norton, WE. The adaptome: advancing the science of intervention adaptation. Am J Prev Med 2016; 51(4): S124–31.CrossRefGoogle ScholarPubMed
Heim, E, Kohrt, BA. Cultural adaptation of scalable psychological interventions. Clin Psychol Eur 2019; 1(4): 122.CrossRefGoogle Scholar
Griner, D, Smith, TB. Culturally adapted mental health intervention: a meta-analytic review. Psychotherapy (Chic) 2006; 43(4): 531–48.CrossRefGoogle ScholarPubMed
Hall, GCN, Ibaraki, AY, Huang, ER, Marti, CN, Stice, E. A meta-analysis of cultural adaptations of psychological interventions. Behav Ther 2016; 47(6): 9931014.CrossRefGoogle ScholarPubMed
Li, J. Digital technologies for mental health improvements in the COVID-19 pandemic: a scoping review. BMC Public Health 2023; 23(1): 413.CrossRefGoogle ScholarPubMed
Bond, RR, Mulvenna, MD, Potts, C, O'Neill, S, Ennis, E, Torous, J. Digital transformation of mental health services. NPJ Ment Health Res 2023; 2(1): 13.CrossRefGoogle ScholarPubMed
Wind, TR, Rijkeboer, M, Andersson, G, Riper, H. The COVID-19 pandemic: the ‘black swan’ for mental health care and a turning point for e-health. Internet Interv 2020; 20: 100317.CrossRefGoogle Scholar
World Health Organization. Mental Health and COVID-19: Early Evidence of the Pandemic's Impact: Scientific Brief. WHO, 2022 (https://www.who.int/publications/i/item/WHO-2019-nCoV-Sci_Brief-Mental_health-2022.1).Google Scholar
Brouwer, ME, Williams, AD, Kennis, M, Fu, Z, Klein, NS, Cuijpers, P, et al. Psychological theories of depressive relapse and recurrence: a systematic review and meta-analysis of prospective studies. Clin Psychol Rev 2019; 74: 101773.CrossRefGoogle ScholarPubMed
Paykel, ES. Cognitive therapy in relapse prevention in depression. Int J Neuropsychopharmacol 2007; 10(1): 131–6.CrossRefGoogle ScholarPubMed
Gearing, RE, Schwalbe, CS, Lee, R, Hoagwood, KE. The effectiveness of booster sessions in CBT treatment for child and adolescent mood and anxiety disorders. Depress Anxiety 2013; 30(9): 800–8.CrossRefGoogle ScholarPubMed
Bruijniks, SJ, Lemmens, LH, Hollon, SD, Peeters, FP, Cuijpers, P, Arntz, A, et al. The effects of once-versus twice-weekly sessions on psychotherapy outcomes in depressed patients. Br J Psychiatry 2020; 216(4): 222–30.CrossRefGoogle ScholarPubMed
World Vision. Improving Mental Health for Kenyan Women Affected by Violence. World Vision, 2018 (https://www.wvi.org/sites/default/files/2022-03/PM%2B%20Mental%20Health%20Kenya%20Impact%20Report%20Final_0.pdf).Google Scholar
United Nations High Commissioner for Refugees. Strengthening Mental Health and Psychosocial Support in UNHCR - Achievements in 2021 and Priorities for 2022 and beyond 2023. UNHCR, 2022 (https://www.unhcr.org/fr-fr/en/media/strengthening-mental-health-and-psychosocial-support-unhcr-achievements-2021-and-priorities).Google Scholar
United Nations High Commissioner for Refugees. Strengthening Mental Health and Psychosocial Support in UNHCR – Annual Report. UNHCR, 2022 (https://www.unhcr.org/media/65872).Google Scholar
STRENGTHS Research Consortium. End Report on Process and Outcomes of PM+ Implementation in Jordan. STRENGTHS Project, 2022 (http://strengths-project.eu/wp-content/uploads/2023/03/D4.2_-D4.3-End-report-Jordan.pdf).Google Scholar
Sangraula, M, Greene, MC, Castellar, D, de la Hoz, JCF, Diaz, J, Merino, V, et al. Protocol for a randomized hybrid type 2 trial on the implementation of group problem management plus (PM+) for Venezuelan women refugees and migrants in Colombia. Interv J Ment Health Psychosoc Support Confl Affect Areas 2023; 21(2): 154–69.Google Scholar
Buttorff, C, Hock, RS, Weiss, HA, Naik, S, Araya, R, Kirkwood, BR, et al. Economic evaluation of a task-shifting intervention for common mental disorders in India. Bull World Health Organ 2012; 90: 813–21.CrossRefGoogle ScholarPubMed
Weobong, B, Weiss, HA, McDaid, D, Singla, DR, Hollon, SD, Nadkarni, A, et al. Sustained effectiveness and cost-effectiveness of the healthy activity programme, a brief psychological treatment for depression delivered by lay counsellors in primary care: 12-month follow-up of a randomised controlled trial. PLoS Med 2017; 14(9): e1002385.CrossRefGoogle ScholarPubMed
Murray, LK, Dorsey, S, Bolton, P, Jordans, MJ, Rahman, A, Bass, J, et al. Building capacity in mental health interventions in low resource countries: an apprenticeship model for training local providers. Int J Ment Health Syst 2011; 5: 30.CrossRefGoogle ScholarPubMed
STRENGTHS Research Consortium. A Policy Brief on WHO's Problem Management Plus, EASE, and Step-by-Step Interventions in Addressing Mental Health Concerns among Syrian Refugees. STRENGTHS Project, 2022 (http://strengths-project.eu/wp-content/uploads/2023/03/STRENGTHS-Policy-Brief.pdf).Google Scholar
STRENGTHS Research Consortium. Economic Evaluation of Implementation: PM+, SbS and EASE. STRENGTHS Project, 2022 (http://strengths-project.eu/wp-content/uploads/2023/03/D7.2-Economic-evaluation-of-Implementation.pdf).Google Scholar
Barnett, ML, Gonzalez, A, Miranda, J, Chavira, DA, Lau, AS. Mobilizing community health workers to address mental health disparities for underserved populations: a systematic review. Adm Policy Ment Health Ment Health Serv Res 2018; 45: 195211.CrossRefGoogle ScholarPubMed
Seidman, G, Atun, R. Does task shifting yield cost savings and improve efficiency for health systems? a systematic review of evidence from low-income and middle-income countries. Hum Resour Health 2017; 15: 29.CrossRefGoogle ScholarPubMed
Grant, KL, Simmons, MB, Davey, CG. Three nontraditional approaches to improving the capacity, accessibility, and quality of mental health services: an overview. Psychiatr Serv 2018; 69(5): 508–16.CrossRefGoogle ScholarPubMed
Callaghan, M, Ford, N, Schneider, H. A systematic review of task-shifting for HIV treatment and care in Africa. Hum Resour Health 2010; 8: 8.CrossRefGoogle ScholarPubMed
Sikander, S, Ahmad, I, Atif, N, Zaidi, A, Vanobberghen, F, Weiss, HA, et al. Delivering the thinking healthy programme for perinatal depression through volunteer peers: a cluster randomised controlled trial in Pakistan. Lancet Psychiatry 2019; 6(2): 128–39.CrossRefGoogle Scholar
Araya, R, Flynn, T, Rojas, G, Fritsch, R, Simon, G. Cost-effectiveness of a primary care treatment program for depression in low-income women in Santiago, Chile. Am J Psychiatry 2006; 163(8): 1379–87.CrossRefGoogle ScholarPubMed
Levin, C, Chisholm, D. Cost-effectiveness and affordability of interventions, policies, and platforms for the prevention and treatment of mental, neurological, and substance use disorders. Ment Neurol Subst Disord 2016; 4(3): 219–36.Google Scholar
Heller, DJ, Kumar, A, Kishore, SP, Horowitz, CR, Joshi, R, Vedanthan, R. Assessment of barriers and facilitators to the delivery of care for noncommunicable diseases by nonphysician health workers in low-and middle-income countries: a systematic review and qualitative analysis. JAMA Netwk Open 2019; 2(12): e1916545.CrossRefGoogle Scholar
Figure 0

Fig. 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow chart illustrating the study selection process. WHO, World Health Organization.

Supplementary material: File

Mwangala et al. supplementary material 1

Mwangala et al. supplementary material
Download Mwangala et al. supplementary material 1(File)
File 15.5 KB
Supplementary material: File

Mwangala et al. supplementary material 2

Mwangala et al. supplementary material
Download Mwangala et al. supplementary material 2(File)
File 65 KB
Supplementary material: File

Mwangala et al. supplementary material 3

Mwangala et al. supplementary material
Download Mwangala et al. supplementary material 3(File)
File 21.1 KB
Supplementary material: File

Mwangala et al. supplementary material 4

Mwangala et al. supplementary material
Download Mwangala et al. supplementary material 4(File)
File 27.1 KB
Supplementary material: File

Mwangala et al. supplementary material 5

Mwangala et al. supplementary material
Download Mwangala et al. supplementary material 5(File)
File 20.3 KB
Submit a response

eLetters

No eLetters have been published for this article.