Hostname: page-component-cd9895bd7-lnqnp Total loading time: 0 Render date: 2024-12-22T12:19:11.195Z Has data issue: false hasContentIssue false

Patients’ and staff members’ experiences of restrictive practices in acute mental health in-patient settings: systematic review and thematic synthesis

Published online by Cambridge University Press:  06 October 2022

Hannah Butterworth
Affiliation:
Division of Psychiatry, University College London, UK
Lisa Wood*
Affiliation:
Division of Psychiatry, University College London, UK; and North East London Foundation Trust, Acute and Rehabilitation Directorate, Goodmayes Hospital, London, UK
Sarah Rowe
Affiliation:
Division of Psychiatry, University College London, UK
*
Correspondence: Lisa Wood. Email: l.wood@ucl.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Background

Recent guidance has called for the reduction of restrictive practice use owing to growing concerns over the harmful physical and psychological effects for both patients and staff. Despite concerns and efforts, these measures continue to be used regularly to manage challenging behaviour in psychiatric in-patient settings.

Aims

To undertake a systematic review of patients’ and staff members’ experiences of restrictive practices in acute psychiatric in-patient settings.

Method

A systematic review and thematic synthesis was conducted using data from 21 qualitative papers identified from a systematic search across three electronic databases (PsycInfo, Embase and MEDLINE) and citation searching. The protocol for the review was pre-registered on PROSPERO (CRD42020176859). The quality of included papers was examined using the Critical Appraisal Skills Programme (CASP).

Results

Four overarching themes emerged from the experiences of patients: the psychological effects, staff communication, loss of human rights and making changes. Likewise, the analysis of staff data produced four themes: the need for restrictive practices, the psychological impact, decision-making and making changes. Patient and staff experiences of restrictive practices were overwhelmingly negative, and their use carried harmful physical and psychological consequences. Lack of support following restraint events was a problem for both groups.

Conclusions

Future programmes seeking to improve or reduce restrictive practices should consider the provision of staff training covering behaviour management and de-escalation techniques, offering psychological support to both patients and staff, the importance of effective staff–patient communication and the availability of alternatives.

Type
Review
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists

When it comes to acute psychiatric care, patients should be treated in the least restrictive environment possible.1 Internationally, in-patient psychiatric settings are reserved for high-risk individuals with the most severe and complex mental health problems, including schizophrenia and personality disorder.Reference Bowers, Simpson, Alexander, Hackney, Nijman and Grange2Reference Zaami, Rinaldi, Bersani and Marinello4 There is general consensus worldwide that the aim of psychiatric in-patient care should be to provide a safe, humane and therapeutic environment during acute episodes of mental illness.Reference Crisp5,Reference Smith6 The rise in detainment rates under mental health legislation has meant that a larger proportion of in-patients are receiving care against their will, rather than agreeing to their admission.Reference Glover-Thomas7,Reference Kmietowicz8 Under these circumstances, behaviours such as self-harm, suicide, violence and aggression can be common in acute psychiatric in-patient settings.Reference Foster, Bowers and Nijman9

In the management of high-risk behaviours, clinical guidelines recommend that staff employ a non-coercive method to de-escalate a situation.10,Reference Gooding, McSherry and Roper11 These may include verbal techniques, constant monitoring or reducing environmental risks.Reference Vedana, da Silva, Ventura, Giacon, Zanetti and Miasso12 If these are ineffective, or if the situation calls for more urgent de-escalation, restrictive interventions may be implemented. Restrictive practices refer to a range of measures. Physical and chemical restraint (e.g. rapid tranquillisation) aim to restrict movement or control behaviour in an emergency,Reference Vedana, da Silva, Ventura, Giacon, Zanetti and Miasso12 and seclusion is intended to isolate and reduce sensory stimulation to calm the patient and ensure everyone is safe from harm.Reference Meehan, Bergen and Fjeldsoe13 In a wider sense, a patient's liberty may be restricted; for example, disallowing access to outdoor space.14 Restrictive practices should only be employed as a last resort.1 However, research suggests that these measures are still commonly used, sometimes excessively or unnecessarily.1,15 This is a problem worldwide despite a lack of evidence to back up their effectiveness.Reference Zaami, Rinaldi, Bersani and Marinello4 Over-reliance on restrictive techniques has been attributed to several challenges and pressures facing staff working in psychiatric in-patient settings, including a lack of effective alternatives,Reference Vedana, da Silva, Ventura, Giacon, Zanetti and Miasso12,Reference Sequeira and Halstead16 significant staff shortages and an insufficient number of professionals on in-patient teams who are trained in the de-escalation of challenging behaviour.Reference Vedana, da Silva, Ventura, Giacon, Zanetti and Miasso12,Reference Marangos-Frost and Wells17 As a consequence, reducing restrictive practices is a priority at international levels and a number of initiatives have been outlined to achieve this.Reference Gooding, McSherry and Roper11 In the UK, the Royal College of Psychiatrists has described a reducing restrictive practices programme that includes de-escalation strategies, whole service interventions and improving staff competence.15 However, despite such initiatives, restrictive practices continue to be an area of concern.

There is growing concern over the detrimental physical and psychological effects of restrictive practices.Reference Chieze, Hurst, Sentissi and Kaiser18 Current qualitative research suggests that restraint events can produce high levels of distress, fear and anxiety in both patients and staff.Reference Vedana, da Silva, Ventura, Giacon, Zanetti and Miasso12,Reference Faschingbauer, Peden-McAlpine and Tempel19 Restraint and seclusion can also cause re-traumatisation for those who have experienced physical or sexual abuse.Reference Wynn20 Concerningly, a 2019 systematic review reported a post-traumatic stress disorder (PTSD) rate of 25–47% among psychiatric in-patients following restraint,Reference Chieze, Hurst, Sentissi and Kaiser18 demonstrating detrimental psychological impacts. Considering the harmful psychological impact of restrictive practices, it is unsurprising that they have been found to hinder patient recovery and increase the length of hospital stay.15,Reference Bloom21 Likewise, members of staff who have used restrictive methods report predominantly negative psychological consequences, including guilt, self-doubt and feeling that they have failed at their job.Reference Bigwood and Crowe22,Reference Moran, Cocoman, Scott, Matthews, Staniuliene and Valimaki23 Both groups agree that the use of restrictive practices damages the staff–patient relationship.Reference Haugom, Ruud and Hynnekleiv24Reference Muir-Cochrane, Baird and McCann26 Although qualitative research investigating patients’ and staffs’ experiences of restrictive practices is reasonably well-established, there has yet to be a systematic review of this evidence. The aforementioned systematic review published in 2019 did not examine qualitative literature and subjective experiences of restraint.Reference Chieze, Hurst, Sentissi and Kaiser18 Thus, the aim of the present study is to examine patients’ and staff members’ experiences of restrictive practices in acute psychiatric in-patient settings. To understand the idiosyncrasies of the experience between groups and thus make important recommendations, patients’ and staff members’ experiences of restrictive practices will be explored separately, allowing for comparisons to be made.

Method

A thematic synthesis of the current qualitative literature on patient and staff experiences of restrictive practices in acute mental health in-patient settings was conducted following the method proposed by Thomas & Harden.Reference Thomas and Harden27 The protocol for the current review was pre-registered on PROSPERO (CRD42020176859) and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidance was followed.Reference Page, McKenzie, Bossuyt, Boutron, Hoffmann and Mulrow28

Study eligibility criteria

Studies were included if they (a) had the primary aim of exploring patients’ or staff members’ experiences of restrictive practices in acute psychiatric in-patient settings, (b) adopted a qualitative methodology (e.g. interviews and focus groups) and (c) recruited patients and/or staff members aged 18 years or over who had experience of restrictive practices. Although the motivation is to understand experiences of restrictive practice to inform UK practice, as this review is the first of its kind, an international perspective is warranted. Therefore, no restrictions were placed on location of study. Studies not published in English were excluded to ensure that the studies were fully accessible to the reviewer. No publication date limitations were applied to the search because of concerns about the potential paucity of literature.

Search strategy and study extraction

The systematic search of three electronic databases (PsycInfo, Embase and MEDLINE) was conducted independently by H.B. in May 2020 and updated in September 2021. These databases were chosen as they are recommended for the identification of nursing journals, as well as allowing the search to extend across the psychological and medical literature. After identifying relevant studies from the initial search, citation searching of key papers was carried out to ensure the maximum number of relevant studies were captured by the review.

The search terms were determined using the SPIDER frameworkReference Cooke, Smith and Booth29 to ensure that they captured the concepts within the review question. The search terms were developed by drawing on existing reviews’ search terms and the keywords of potential papers of interest. The final list of search terms was developed with assistance from a health librarian and terms were grouped into in-patient terms, staff and patient terms, qualitative terms and restraint terms. The full search strategy can be found in the supplementary material, available at https://doi.org/10.1192/bjo.2022.574. Titles and abstracts were initially searched by H.B. From these, potentially eligible full texts were identified and screened by H.B. Any uncertainties were discussed in supervision with L.W. until a final list of full texts was decided upon.

Quality assessment

Quality of the studies was assessed using the Critical Appraisal Skills Programme (CASP) tool, which examines the validity, results and relevance of findings. This was to ensure that the studies included were sufficiently rigorous and trustworthy. We chose to use the CASP checklist as it is the most commonly used tool in assessing quality in qualitative literature. The checklist examines whether the data collection processes are reliable and valid, whether the analysis process is robust and whether ethical issues have been fully considered.

Data extraction and synthesis

Overall, the analysis was led by H.B. and any uncertainties were discussed in supervision with L.W. and S.R. Study characteristics were initially extracted into a pre-defined table by H.B. The data extracted included study characteristics (location, data collection method, method of restraint investigated, sample population) and participant characteristics (gender, ethnicity and, if applicable, diagnosis). The full ‘results’ or ‘findings’ section of the paper were also extracted for analysis.

Guided by the method adopted by Thomas & Harden,Reference Thomas and Harden27 any parts of the studies labelled as ‘results’ or ‘findings’ were included in the analysis. Analysis was conducted using QSR's NVivo 12 software30 on macOS, and each included full text was imported into the software. Although the interpretations of study authors contributed to the analysis, direct quotes from patients and staff were prioritised to ensure that the review accurately captured their experiences in the way they were originally reported. Data pertaining to patients and staff members were analysed separately. A critical realist position was taken, which explains that psychological and social constructs exist but the way they are understood is subjective and dependent on the individual's personal experience.Reference Haugom, Ruud and Hynnekleiv24 Data were also analysed from an inductive approach. The first step of the analysis involved the free coding of text containing information relevant to the research question. To do this H.B. read and re-read the transcript to ensure familiarisation with the data. Line by line coding was then undertaken and codes were highlighted if they were thought to represent patient or staff experiences of restrictive practices. A code was often represented by a single word or short phrase. Related codes were then organised into descriptive themes, some of which were similar to the themes identified in the original studies. Finally, a second grouping process reorganised descriptive themes into analytical themes and subthemes. These aimed to capture the meaning patients and staff gave to restrictive practices.

Results

Study selection

After duplicates were removed, 2278 studies were identified. After screening the titles and abstracts against the inclusion criteria, 125 full-text articles were identified and these were subsequently screened to determine their inclusion in the current review. A further 104 studies were excluded as they did not meet the inclusion criteria, resulting in 21 studies being included in the synthesis. The study selection process is outlined in Fig. 1.

Fig. 1 PRISMA diagram.

Quality assessment

The outcome of the quality assessment using the CASP tool can be found supplementary Table 1. The majority of studies were moderate to high quality and were considered to be sufficiently rigorous in terms of their methodology, design and analysis. There has been much debate about whether it is meaningful to exclude qualitative studies based on assessments of their quality.Reference Carroll and Booth31 In the current review, the synthesis would not have been improved by the exclusion of weaker studies, as their findings were consistent with those from the higher-quality studies.Reference Garside32 Therefore, no studies were excluded on the basis of the quality assessment as they were all considered to capture the experiences of patients and staff effectively.

Study characteristics

The study characteristics for the 21 included papers are summarised in Table 1. The studies had been conducted across 11 countries and were published between 1996 and 2019. They used a range of qualitative data collection methods, including focus groups, interviews, reflective writing and debrief forms. Ten studies focused solely on the experiences of patients, nine investigated the experiences of staff members and two examined the experiences of both groups. The papers covered a range of restrictive practices, including physical restraint, chemical/pharmacological restraint, mechanical restraint, seclusion and deprivation of liberty.

Table 1 Summary of study characteristics

n.r., not reported; PTSD, post-traumatic stress disorder.

Patient synthesis

The four overarching themes (‘the psychological effects’, ‘staff communication’, ‘loss of autonomy’ and ‘making changes’) and their subthemes that emerged from the 12 qualitative studies that explored patients’ experiences are listed in Appendix 1 The studies that contributed to each theme and subtheme relating to patients are outlined supplementary Table 2.

Theme 1: The psychological effects

The theme of psychological effects was present in all 12 studies. Patients’ descriptions were predominantly negative. Three subthemes were identified: ‘a distressing experience’, ‘re-traumatisation’ and ‘the aftermath’.

A distressing experience

The majority of patients experienced restraint as a psychologically distressing event. Being restrained immediately induced intense emotions of anxiety and fear, which persisted throughout the whole restraint. In 5 of the 12 studies, patients reported that they became so distressed during their experience that they feared for their own life (although in 7 studies, some participants described how restraint made them feel comforted and safe):

‘I was afraid that someone might hurt me suddenly while I was being restrained … I was scared … nobody seemed willing to help me calm this fear and I was afraid the staff were never going to take the restraint off.’Reference Chien, Chan, Lam and Kam33

‘I thought they were going to kill me.’Reference Bonner, Lowe, Rawcliffe and Wellman34

Re-traumatisation

Some of the patients described how being restrained reawakened personal traumatic memories of past abuse, such as rape or other violent incidents, suggesting that restraint may cause psychological damage and re-traumatisation. Participants described a wide array of trauma-related psychological experiences:

‘It's scary, and like if they're restraining you to give you an injection, they're undoing your trousers or pulling your skirt off. It kind of reminds me of like my past when I was abused and it really gets to you.’Reference Sequeira and Halstead35

The aftermath

Patients described the persistent psychological impact of restrictive practices as wholly negative. They described persistent post-traumatic-type experiences following a restraint, such as nightmares, intrusive memories and emotional distress:

‘Sometimes me keep dreaming things, having nightmares. Don't know why, I do worry about it.’Reference Sequeira and Halstead35

Theme 2: Staff communication

Patients reported that the quality of staff communication could determine whether a situation escalated to the point of restraint. Communication quality was also described as fundamental in helping them understand why they were being restrained or secluded. The two sub-themes identified within this theme were: ‘inadequate communication’ and ‘effective communication’.

Inadequate communication

Patients perceived poor staff communication skills to be one of the most common causes of their behaviour escalating to the point of restraint. Participants described, for example, staff not being responsive, actively listening or being clear about their expectations of the patient. Patients in eight of the studies described the absence of communication during and after the restraint event, for example the lack of a debrief. This led to unresolved emotions and unanswered questions following the event, and feelings that the restraint was unjust:

‘  I didn't understand why they put me into the seclusion room and I never got information on this. The staff was reluctant to provide information on why and how long, what next  ’Reference Kontio, Joffe, Putkonen, Kuosmanen, Hane and Holi36

Effective communication

Just 1 of the 12 studies described instances of effective staff communication during restraint. Effective communication was characterised by a calm, clear and transparent approach that explained the restraint process. It is evident from the account how effective staff communication can improve the patient's experience:

‘ … They approached me in a caring and calm manner and explained to me what was happening to me. When I was being restrained, I felt relieved and clearly remembered the moment that the nursing officer explained to my parents in front of me … about why the restraint had been applied and what had been done to me.’Reference Chien, Chan, Lam and Kam33

Theme 3: Loss of human rights

The experience of losing human rights was reflected in all 12 of the studies. Patients described feeling powerless and helpless, which was frequently perceived to be a consequence of staff actions. Three subthemes emerged: ‘power struggle’, ‘imprisonment’ and ‘dehumanisation’.

Power struggle

Patients felt that staff abused their powers by using restrictive practices too readily, leading to a ward culture of ‘them versus us’. Several patients recalled restraint situations where they felt staff were laughing at them, which resulted in the perception that staff were ridiculing them and ultimately against them. Patients’ perception that staff abused their power exacerbated feelings of powerlessness; powerlessness was reported particularly frequently by female patients who were restrained by male members of staff:

‘That almost set me off again, because, you know, these are your nurses, they are supposed to be taking care of you, and you don't feel like you are being taken care of when someone is making fun or laughing at your situation.’Reference Faschingbauer, Peden-McAlpine and Tempel19

Imprisonment

In 10 of the 12 studies, patients likened their experiences of being admitted to hospital to being imprisoned. Participants felt that the hospital procedures were restrictive and unwelcoming rather than caring and compassionate. In particular, they felt that seclusion rooms resembled a prison as their freedom of movement was restricted:

‘The staff wouldn't release me, even for a while, so that I could use the washroom. They brought me a bedpan but did not change the bed sheets for me, even though they were contaminated. They only un-cuffed one hand for me to eat … I couldn't do anything. It was just like being chained up in a prison.’Reference Chien, Chan, Lam and Kam33

Dehumanisation

For some patients, being restrained or secluded felt dehumanising and like they were being treated like animals. Others described feeling like a slave being controlled by ward staff. It was the loss of freedom and autonomy that particularly contributed to the feeling of dehumanisation. Moreover, accounts of restraint and seclusion highlighted distinct care failures and some patients felt that their basic needs were neglected by staff:

‘I felt very uncomfortable. Like I was an animal being chained up. Only difference was, wasn't chains around my neck … I felt dirty … Not being funny, but, my mind went back to stories my grandma told me about slavery days. I felt like I was a slave. I was chained up; I couldn't do anything. I was under somebody else's command … ’Reference Johnson37

Theme 4: Making changes

The theme of making changes emerged from the negative experiences reported by patients, the inadequacies and faults they identified and the suggestions they put forward to remedy these. Three subthemes describe these: ‘preventing restrictive practices’, ‘improving restrictive practices’ and ‘alternatives to restrictive practices’.

Preventing restrictive practices

Patients frequently attributed their behaviour escalation and subsequent restraint to lack of communication from staff, for example about ward processes and procedures and what was expected of them. Patients reported that staff also did not talk to them in a compassionate or calm manner, which they explained further aggravated the situation. They suggested that staff should be given training on how to communicate in a way that may prevent behaviour escalating:

‘ … if staff would have talked to me and say ah … you are not supposed to do that … instead of yelling at me like a child … the staff should listen before responding … they need to learn how to talk to patients with respect … learn how to communicate with us all over again … ’Reference Ezeobele, Malecha, Mock, Mackey-Godine and Hughes38

Patients believed that they would be able to use their own coping strategies to avoid restraint if staff prompted them to do so before their behaviour escalated to a certain level. Being allowed to talk to peers on the ward and strategies learned from anger management classes were identified as potential coping mechanisms.

One patient expressed how gaining an understanding of why they were restrained may prevent them from being restrained in the future:

‘The nurses have sat down with me and gone through my records with me. It feels better to look back with a better insight. You can see where you were going wrong. You can see where to make changes … ’Reference Bonner, Lowe, Rawcliffe and Wellman34

Improving restrictive practices

Many patients viewed their treatment while in restraint or seclusion as dehumanising and a violation of their rights. Three papers reported patients’ views of how restrictive practices could be improved. One patient called for more humane treatment:

‘ … I hope that I am a human being in a psychiatric hospital and in the seclusion room too. I want polite, humane behaviour from the staff … ’Reference Kontio, Joffe, Putkonen, Kuosmanen, Hane and Holi36

Patients also suggested that the introduction of colour, soft furniture and relaxing music in the seclusion rooms could make seclusion a less unpleasant experience.

Alternatives to restrictive practices

Patients offered several alternatives to the use of restrictive practices, including one-to-one observation, medication, being left alone in their room, time-out programmes, psychiatric intensive care units and being provided with an activity such as a book to read. The most common suggestion was that open communication and discussion would be the most effective alternative:

‘ … It is essential to try to solve the difficult situation by discussion instead of using coercion (e.g. seclusion room) … ’Reference Kontio, Joffe, Putkonen, Kuosmanen, Hane and Holi36

Staff synthesis

The four primary themes (‘the need for restrictive practices’, ‘the psychological impact’, ‘decision-making’ and ‘making changes’) and their subthemes that emerged from the 11 qualitative studies exploring staff experiences are listed in Appendix 2. The studies that contributed to each theme and subtheme relating to staff are outlined supplementary Table 3.

Theme 1: The need for restrictive practices

This theme was identified in 9 of the 11 studies. The most common attitudes towards whether restrictive practices are necessary are reflected in the three subthemes: staff members perceived the use of restrictive practices to be ‘the last resort’ after trying alternatives with the aim of ‘avoiding restraint’. However, the most apparent view was that ‘restraint is unavoidable’.

The last resort

It was evident that the majority of staff members dreaded having to use restraint and were aware of the power they had and did not want to abuse this power. They described their willingness to try several less restrictive alternatives before resorting to restraint:

‘Restraint and seclusion … is the last resort option; we make a lot of decisions about options before we seclude.’Reference Muir-Cochrane, Baird and McCann26

‘We are aware that we have some power in our job and it is absolutely necessary that we do not abuse it.’Reference Haugom, Ruud and Hynnekleiv24

Avoiding restraint

Staff described the less restrictive methods they attempted to use before employing restrictive options. These included moving patients to low-stimulus areas, reducing risk, giving them a choice about how the situation was managed, talking through their emotions and medication. Staff were pleased if they were able to successfully avoid using restraint:

‘ … we have good experience avoiding the use of mechanical restraint with this patient, using female staff, spending enough time and being patient.’Reference Haugom, Ruud and Hynnekleiv24

‘I do enjoy getting the opportunity to use skills to de-escalate a situation and the majority of times you do.’Reference Bigwood and Crowe22

Restraint is unavoidable

Despite the majority of staff endorsing the use of less restrictive alternatives, the most prevalent attitude was that restrictive practices were unavoidable. The studies suggested that staff believed restrictive practices were the only guaranteed way of preventing harm on the ward, and many accepted it as an essential part of the job:

‘It is necessary in controlling them [patients] … for the time being, it's the only thing to protect the staff and other clients.’Reference Muir-Cochrane, Baird and McCann26

‘I can't see any way around it … I just don't know what else we could do.’Reference Bigwood and Crowe22

Theme 2: The psychological impact

The psychological impact of restraint use was explored in every study. Administering restrictive measures was a predominantly negative experience for staff, and many described the psychological consequences. Three subthemes emerged: ‘distress’, ‘mental conflict’ and ‘nobody to talk to’.

Distress

Staff disliked using restrictive practices as they considered them to be distressing and unpleasant for everyone involved. Staff frequently reported anxiety, fear and sadness when asked about their experiences. These feelings persisted post-restraint:

‘Well, it [restraining a patient] certainly would not have a good feeling; nobody likes to restrain another person. Anyway, he/she is a human being, restraining someone else or any living creature does not have a good feeling; definitely it doesn't create a good effect.’Reference Fereidooni Moghadam, Fallahi Khoshknab and Pazargadi25

‘ … you go home with a horrible feeling. You have to really work hard at turning off all these horrible feelings.’Reference Sequeira and Halstead16

Mental conflict

Staff members felt that using restraint did not fit with their job role. This was particularly true for nursing staff, who felt conflicted when employing methods that they did not perceive to be caring or therapeutic. This often resulted in feelings of guilt:

‘I wanted to be a nurse . . . but seclusion . . . it's against your nursing principles, it's against your caring attitude … ’Reference Moran, Cocoman, Scott, Matthews, Staniuliene and Valimaki23

‘I felt instantly like a bully. I felt instantly like, I am awful, you know, look what I have done to this man … ’Reference Bigwood and Crowe22

Nobody to talk to

Staff reported a distinct lack of support from management following their involvement in a restraint event. One individual described the difficulty in finding someone to talk to who would understand:

‘And the other thing of course about this kind of situation [restraint] is that there is nobody you can talk to about that apart from other psychiatric nurses. This essential part of your job you cannot discuss with anyone else because they just can't understand it.’Reference Bigwood and Crowe22

Theme 3: Decision-making

Several factors that contributed to staff members’ decisions to employ restrictive practices were identified in the studies. The three main factors were: ‘risk assessment’, ‘availability of staff’ and ‘availability of alternatives’.

Risk assessment

If staff deemed the situation to be high risk to the patient, others in the vicinity or themselves, restrictive practices more likely to be used:

‘Physical restraints are necessary at some point, but they are really to prevent harm to self or others.’Reference McCain and Kornegay39

Availability of staff

The studies suggested that the availability and competency of staff was the second most important factor considered when deciding whether to use restrictive measures. A number of staff members experienced stress and frustration when having someone restrained on the ward because it often left them understaffed:

‘Patients in restraints go on constant observation and we lose a staff off the floor until we can call and get somebody to come in. But we are still losing someone for an hour or an hour and a half. And sometimes there is nobody available to come in, and in that case we just kind of rotate through. So it makes for a lot heavier workload for everybody when we put someone in restraints.’Reference Marangos-Frost and Wells17

Availability of alternatives

Members of staff reported restraint to be reasonably uncommon owing to successful preventive measures:

‘You probably only have to restrain, I don't know, 1 in 20 incidents that you actually go to … The vast majority of times we talk the person down, you know.’Reference Bigwood and Crowe22

However, some believed that there were often no other alternatives available that would have adequately protected everyone from harm in the way that restraint could:

‘ … it needs to be here unless you replace restraint with something that is truly effective.’Reference Vedana, da Silva, Ventura, Giacon, Zanetti and Miasso12

Theme 4: Making changes

Members of staff voiced dissatisfaction towards employing restrictive practices and worried about the psychological and physical harm that may be caused to the patient, others in the vicinity and staff themselves. Two subthemes were identified from staff suggestions regarding how to improve and reduce restrictive practices: ‘somebody to talk to’ and ‘a safer alternative’.

Somebody to talk to

Being involved in the use of restrictive practices was unpleasant and distressing for most staff members. They felt they were inadequately supported following a restraint, and those who were able to talk to someone following the event found it to be unhelpful. One member of staff described how having a supportive person to talk to after an incident was beneficial:

‘You are always thinking “Could I have done something before the event or caught it before we had to do that?”, and I think that once you can sit down and talk that reassures you when you've had that chance. Debriefing, even if it's only in the form of a cup of tea. Nothing major, but still useful. You never know how it's going to go and it's helpful to look back over it to see if you have done everything that you should. After support. I have very strong feelings about this … ’Reference Bonner, Lowe, Rawcliffe and Wellman34

Some proposed that patients should also have access to support following the event and felt that this could help repair any damage to the staff–patient relationship:

‘They want to talk about things afterwards and I think it can damage the relationship if you don't. Patients don't want someone just to come along, shout orders or whatever, or grab them without then going back and explaining or talking it through. You can end up with a lot of resentment.’Reference Bonner, Lowe, Rawcliffe and Wellman34

A safer alternative

Members of staff called for an effective and safer alternative to restrictive methods. Some preferred the use of relaxation techniques, counselling or constant monitoring. However, this was very much dependent on availability and staffing levels. The studies also suggested that staff perceived restraint to be the only effective option when trying to control high-risk behaviour:

‘It is necessary in controlling them [patients] … for the time being, it's the only thing to protect the staff and other clients.’Reference Muir-Cochrane, Baird and McCann26

Discussion

The experiences of restrictive practices in psychiatric in-patient settings were overwhelmingly negative for both patients and staff, according to the 21 papers included in this thematic synthesis. Patients described experiencing intense feelings of fear, powerlessness and humiliation while being restrained or secluded. Moreover, patients who had past experiences of physical or sexual abuse described being re-traumatised. Although this arose in only 4 of the 12 studies exploring patients’ experiences, it has important implications considering that a large proportion of female patients in psychiatric hospitals have reported being victims of severe physical or sexual abuse.Reference Firsten40 The psychological consequences reported by patients appear to be entirely conflictual with the safe, humane and therapeutic environment that is supposed to be provided by in-patient care.41 Psychological distress was also a dominant theme within staff experiences of restrictive practices. Importantly, for both patients and staff, the negative emotional consequences persisted after the restraint event was over, suggesting that experiencing or implementing restrictive practices may have long-term psychological consequences. The long-term psychological consequences of experiencing or implementing restrictive practices is something that future research should address.

Patients and staff offered several suggestions for improving restrictive measures (Appendix 3). Similarly, both patients and staff identified the importance of support following the use of a restrictive measure such as restraint or seclusion. Patients felt ignored and neglected during restraint or seclusion, which intensified the distress experienced during the event. Following the event, patients reported receiving no emotional support or explanation and were left with resentment towards staff, which damaged the patient–staff relationship. A recent report from the UK Care Quality Commission highlighted that staffing and time pressures are a hindrance to staff being able to spend time building relationships with patients.42 Interestingly, where staff were unable to spend time providing emotional support to patients, patients perceived this as being ignored, leading to increased tensions and a disconnect between patients and staff. The tensions in the staff–patient therapeutic relationship and the importance of having an appropriate ratio of patients to staff has been identified in other international in-patient contexts.Reference Bak, Zoffman, Sestoft, Almvik, Siersma and Brandt-Christensen43 This disconnect could be addressed through strategies such as the application of the Safewards model, which has been successful in decreasing conflict by 15% and containment by 26.4% on a number of psychiatric wards.Reference Bowers, James, Quirk, Simpson, Stewart and Hodsoll44 Safewards is an organisational approach to delivering in-patient services that aims to minimise the use of restrictive practices through the use of a variety of interventions that promote a therapeutic response, minimise conflict and increase patient safety.Reference Bowers, James, Quirk, Simpson, Stewart and Hodsoll44 Another potential model is the Six Core Strategies to Reduce the Use of Seclusion and Restraint, a US model that focuses on organisational and leadership change, workforce development, having patient roles such as peer support workers in the in-patient setting, and improving debrief techniques, which has also been shown to reduce restrictive practices.45

For staff, both occupational and emotional support was lacking. Future programmes seeking to reduce the use of restrictive practices should consider the provision of training covering these, such as in the ReSTRAIN YOURSELF programme.Reference Duxbury, Baker, Downe, Jones, Greenwood and Thygesen46 The ReSTRAIN YOURSELF programme aims to improve patient safety and avoid unnecessary harm by using restraint-reducing approaches.42 The absence of support was also apparent in staff members’ accounts of the time following an event. Worryingly, there is a significant relationship between a lack of support and high level of burnout, which has been found to increase depersonalisation, reduce the quality of care provided and increase staff turnover rates.Reference Joseph47Reference Perlman and Hartman49 This has problematic implications for psychiatric in-patient care, as these factors may increase the likelihood that restrictive practices will be used and exacerbate the understaffing pressures that in-patient teams already face.Reference Marangos-Frost and Wells17,Reference Muir-Cochrane50 It is imperative that staff are adequately debriefed following their involvement in the implementation of restrictive practices, as research suggests that appropriate support measures have the potential to buffer the negative impact of psychological stress for healthcare professionals.Reference Sutherland and Cooper51

It was apparent that both patients and staff would prefer the use of less restrictive alternatives. Patients pictured this to be in the form of a strong therapeutic relationship, improved open communication, transparency and responsiveness. De-escalation strategies and the provision of therapeutic environments are some examples of interventions that have been implemented.Reference Bowers, James, Quirk, Simpson, Stewart and Hodsoll44 However, they have not eliminated the need for restrictive practices and further work needs to be undertaken. It is interesting that several patients internalised the cause of the restraint or seclusion after they understood why it had happened. Their accounts suggest that once they gained this understanding, they were able to take responsibility for their actions and think about how they could change their behaviour to avoid the situation happening again. Staff should aim to be transparent with patients about why they were restrained or secluded, as this in itself may be effective in preventing the need for restrictive practices. However, it must be acknowledged that staff believed there were no other alternatives that were as effective at keeping everyone safe from harm once situations had escalated and become risky. In light of this, there must be a continued effort towards making the implementation of restrictive measures safer by ensuring that all members of staff have the skills to use these methods safely. To further minimise the negative effects of restrictive measures, we must shift some of our focus to improving the quality of the support provided to patients before, during and after restraint or seclusion.

Strengths and limitations

This review is the first thematic synthesis of qualitative research investigating patient and staff experiences of restrictive practices in psychiatric in-patient settings. Synthesising this qualitative research allowed us to present the complex experiences of patients and staff in a way that is truly representative of their original accounts.Reference Thomas and Harden27,Reference Crowe, Inder and Porter52 We also included studies from a variety of geographical regions. Although this is a strength, as it gives our review an international perspective, it is also drawing together literature from quite diverse contexts. For example, medication regimes vary to a large extent across countries, as do the laws determining their use, and therefore some of the qualitative findings may not be fully relevant in the UK. Another example is that one study examined the use of leather restraints,Reference Johnson37 which is not current practice in the UK. Therefore, overall results should be interpreted tentatively. It is important to note that 18 of the 21 studies did not report the ethnicity of the participants. Individuals from Black and minority ethnic (BME) communities are more likely to be detained under the Mental Health Act 1983, as well as being more likely to be restrained and secluded, and are significantly underrepresented in mental health research.Reference Hui53 Future research should prioritise investigating the experiences of BME communities, as well as ensuring that they consider how ethnicity may affect the subjective experience of restrictive practices. The use of three databases and citation searching ensured that the search was adequately comprehensive.Reference Khan, Kunz, Kleijnen and Antes54 However, only one reviewer screened the studies identified by the search, which may have introduced systematic or random errors to the process of identifying relevant studies.Reference Waffenschmidt, Knelangen, Sieben, Bühn and Pieper55 The validity of this review may also be affected by the 23-year gap between the earliest and most recent study. The use of restrictive practices has changed over this period, with the reduction of restrictive practices becoming a priority.14 The experiences of those in the earlier studies may be significantly different from those in more recent studies. Future reviews should limit the search to ensure that only contemporary research relevant to the current in-patient context is included.

Relevance for clinical practice

This review has identified that both staff and patients find restrictive practices a negative and distressing experience. There is a need to find alternative options to prevent the use of restrictive practices. Existing interventions such as ReSTRAIN YOURSELF may be helpful in addressing these issues, but consistent implementation is a challenge. Both parties acknowledged a need for restrictive practices, and further specialist training and supervision are required to ensure these are implemented safely. Psychological distress was also a dominant theme within patient and staff experiences of restrictive practices. There is a need to provide appropriate reflective and emotional support for patients and staff to manage the effects of restrictive practices.

Supplementary material

Supplementary material is available online at https://doi.org/10.1192/bjo.2022.574.

Data availability

Data availability is not applicable to this article as no new data were created or analysed in this study.

Author contributions

H.B. led on this project and undertook the review. S.R. and L.W. supervised H.B. and contributed to the design and write-up of the manuscript.

Funding

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Declaration of interest

None.

Appendices

Appendix 1 Patient themes and subthemes

Theme 1: The psychological effects

  1. (a) A distressing experience

  2. (b) Re-traumatisation

  3. (c) The aftermath

Theme 2: Staff communication

  1. (a) Inadequate communication

  2. (b) Effective communication

Theme 3: Loss of human rights

  1. (a) Power struggle

  2. (b) Imprisonment

  3. (c) Dehumanisation

Theme 4: Making changes

  1. (a) Communication and debrief

  2. (b) Preventing restrictive practices

  3. (c) Improving restrictive practices

  4. (d) Alternatives to restrictive practices

Appendix 2 Staff themes and subthemes

Theme 1: The need for restrictive practices

  1. (a) The last resort

  2. (b) Avoiding restraint

  3. (c) Restraint is unavoidable

Theme 2: The psychological impact

  1. (a) Distress

  2. (b) Mental conflict

  3. (c) Nobody to talk to

Theme 3: Decision-making

  1. (a) Risk assessment

  2. (b) Availability of staff

  3. (c) Availability of alternatives

Theme 4: Making changes

  1. (a) Somebody to talk to

  2. (b) A safer alternative

Appendix 3 Summary of suggested improvements made by patients and staff

Patients’ suggestions

Before:

  1. (a) More clarity from staff on their expectations of patients, including ward procedures and rules

  2. (b) More training in de-escalation techniques for staff

  3. (c) Anger management classes for patients

During:

  1. (a) Open communication about the restraint or seclusion process

  2. (b) Colour, soft furniture and relaxing music in seclusion

After:

  1. (a) Debrief/support post-incident

Staff members’ suggestions

Before:

  1. (a) Training in the safe implementation of restrictive measures

After:

  1. (a) Debrief/support post-incident

References

Social Care, Local Government and Care Partnership Directorate. Positive and Proactive Care: Reducing the Need for Restrictive Interventions. Department of Health, 2014.Google Scholar
Bowers, L, Simpson, A, Alexander, J, Hackney, D, Nijman, H, Grange, A, et al. The nature and purpose of acute psychiatric wards: the Tompkins acute ward study. J Ment Health 2005; 14: 625–35.CrossRefGoogle Scholar
Wykes, T, Csipke, E, Williams, P, Koeser, L, Nash, S, Rose, D, et al. Improving patient experiences of mental health inpatient care: a randomised controlled trial. Psychol Med 2018; 48: 488–97.CrossRefGoogle ScholarPubMed
Zaami, S, Rinaldi, R, Bersani, G, Marinello, E. Restraints and seclusion in psychiatry: striking a balance between protection and coercion. critical overview of international regulations and rulings. Riv Psichiatr 2020; 55: 1623.Google ScholarPubMed
Crisp, N. Improving Acute Inpatient Psychiatric Care for Adults in England: Interim Report. Commission on Acute Adult Psychiatric Care, 2015 (http://media.wix.com/ugd/0e662e_a93c62b2ba4449f48695ed36b3cb24ab.pdf).Google Scholar
Smith, T. The role of hospital inpatient mental health care in modern health care systems. Psychiatr Serv 2020; 71: 967–8.CrossRefGoogle ScholarPubMed
Glover-Thomas, N. Decision-making behaviour under the Mental Health Act 1983 and its impact on mental health tribunals: an English perspective. Laws 2018; 7(2): 12.CrossRefGoogle Scholar
Kmietowicz, Z. Admissions to hospital under the Mental Health Act rise by 30% over 10 years. BMJ 2004; 328: 854.CrossRefGoogle Scholar
Foster, C, Bowers, L, Nijman, H. Aggressive behaviour on acute psychiatric wards: prevalence, severity and management. J Adv Nurs 2007; 58: 140–9.CrossRefGoogle ScholarPubMed
National Institute for Health and Care Excellence. Violence and Aggression: Short-Term Management in Mental Health, Health and Community Settings (NICE Guideline NG10). NICE, 2015.Google Scholar
Gooding, P, McSherry, B, Roper, C. Restraints and seclusion in psychiatry: striking a balance between protection and coercion. Critical overview of international regulations and rulings. Acta Psychiatr Scand 2020; 142: 2739.CrossRefGoogle Scholar
Vedana, KGG, da Silva, DM, Ventura, CAA, Giacon, BCC, Zanetti, ACG, Miasso, AI, et al. Physical and mechanical restraint in psychiatric units: perceptions and experiences of nursing staff. Arch Psychiatr Nurs 2018; 32: 367–72.CrossRefGoogle ScholarPubMed
Meehan, T, Bergen, H, Fjeldsoe, K. Staff and patient perceptions of seclusion: has anything changed? J Adv Nurs 2004; 47: 33–8.CrossRefGoogle ScholarPubMed
Care Quality Commission. The State of Care in Mental Health Services 2014 to 2017. CQC, 2017.Google Scholar
National Collaborating Centre for Mental Health. Reducing Restrictive Practice: Learning from the Collaborative. Royal College of Psychiatrists, 2019.Google Scholar
Sequeira, H, Halstead, S. The psychological effects on nursing staff of administering physical restraint in a secure psychiatric hospital: ‘When I go home, it's then that I think about it. Br J Forens Pract 2004; 6: 315.CrossRefGoogle Scholar
Marangos-Frost, S, Wells, D. Psychiatric nurses’ thoughts and feelings about restraint use: a decision dilemma. J Adv Nurs 2000; 31: 362–9.CrossRefGoogle ScholarPubMed
Chieze, M, Hurst, S, Sentissi, O, Kaiser, S. Effects of seclusion and restraint in adult psychiatry: a systematic review. Front Psychiatry 2019; 10: 491.CrossRefGoogle ScholarPubMed
Faschingbauer, KM, Peden-McAlpine, C, Tempel, W. Use of seclusion: finding the voice of the patient to influence practice. J Psychosoc Nurs Ment Health Serv 2013; 51: 32–8.CrossRefGoogle ScholarPubMed
Wynn, R. Psychiatric inpatients’ experiences with restraint. J Forens Psychiatry Psychol 2004; 15: 124–44.CrossRefGoogle Scholar
Bloom, SL. Creating Sanctuary: Toward the Evolution of Sane Societies. Routledge, 2013.Google Scholar
Bigwood, S, Crowe, M. ‘It's part of the job, but it spoils the job’: a phenomenological study of physical restraint. Int J Ment Health Nurs 2008; 17(3): 215–22.CrossRefGoogle ScholarPubMed
Moran, A, Cocoman, A, Scott, PA, Matthews, A, Staniuliene, V, Valimaki, M. Restraint and seclusion: a distressing treatment option? J Psychiatr Ment Health Nurs 2009; 16: 599605.CrossRefGoogle ScholarPubMed
Haugom, EW, Ruud, T, Hynnekleiv, T. Ethical challenges of seclusion in psychiatric inpatient wards: a qualitative study of the experiences of Norwegian mental health professionals. BMC Health Serv Res 2019; 19(1): 879.CrossRefGoogle Scholar
Fereidooni Moghadam, M, Fallahi Khoshknab, M, Pazargadi, M. Psychiatric nurses’ perceptions about physical restraint; a qualitative study. Int J Community Based Nurs Midwifery 2014; 2: 2030.Google ScholarPubMed
Muir-Cochrane, EC, Baird, J, McCann, TV. Nurses’ experiences of restraint and seclusion use in short-stay acute old age psychiatry inpatient units: a qualitative study. J Psychiatr Ment Health Nurs 2015; 22: 109–15.CrossRefGoogle ScholarPubMed
Thomas, J, Harden, A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol 2008; 8(1): 45.CrossRefGoogle ScholarPubMed
Page, MJ, McKenzie, JE, Bossuyt, PM, Boutron, I, Hoffmann, TC, Mulrow, CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021; 372: n71.CrossRefGoogle ScholarPubMed
Cooke, A, Smith, D, Booth, A. Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res 2012; 22: 1435–43.CrossRefGoogle ScholarPubMed
NVIVO. NVivo – Qualitative Data Analysis Software (Version 12). QSR International Pty Ltd, 2018.Google Scholar
Carroll, C, Booth, A. Quality assessment of qualitative evidence for systematic review and synthesis: is it meaningful, and if so, how should it be performed? Res Synth Methods 2015; 6: 149–54.CrossRefGoogle ScholarPubMed
Garside, R. Should we appraise the quality of qualitative research reports for systematic reviews, and if so, how? Innov Eur J Soc Sci Res 2014; 27: 6779.CrossRefGoogle Scholar
Chien, W-T, Chan, CW, Lam, L-W, Kam, C. Psychiatric inpatients’ perceptions of positive and negative aspects of physical restraint. Patient Educ Couns 2005; 59: 80–6.CrossRefGoogle ScholarPubMed
Bonner, G, Lowe, T, Rawcliffe, D, Wellman, N. Trauma for all: a pilot study of the subjective experience of physical restraint for mental health inpatients and staff in the UK. J Psychiatr Ment Health Nurs 2002; 9: 465–73.CrossRefGoogle ScholarPubMed
Sequeira, H, Halstead, S. Control and restraint in the UK: service user perspectives. Br J Forens Pract 2002; 4(1): 918.CrossRefGoogle Scholar
Kontio, R, Joffe, G, Putkonen, H, Kuosmanen, L, Hane, K, Holi, M, et al. Seclusion and restraint in psychiatry: patients’ experiences and practical suggestions on how to improve practices and use alternatives. Perspect Psychiatr Care 2012; 48: 1624.CrossRefGoogle ScholarPubMed
Johnson, ME. Being restrained: a study of power and powerlessness. Issues Ment Health Nurs 1998; 19: 191206.CrossRefGoogle ScholarPubMed
Ezeobele, IE, Malecha, AT, Mock, A, Mackey-Godine, A, Hughes, M. Patients’ lived seclusion experience in acute psychiatric hospital in the United States: a qualitative study. J Psychiatr Ment Health Nurs 2014; 21: 303–12.CrossRefGoogle ScholarPubMed
McCain, M, Kornegay, K. Behavioral health restraint: the experience and beliefs of seasoned psychiatric nurses. J Nurs Prof Dev 2005; 21: 236–42.CrossRefGoogle ScholarPubMed
Firsten, T. Violence in the lives of women on psych wards. Can Woman Stud 1991; 11(4): 45–8.Google Scholar
Department of Health. Mental Health Policy Implementation Guide: Adult Acute Inpatient Care Provision. Department of Health, 2002.Google Scholar
Care Quality Commission. Mental Health Acute Inpatients Service User's Survey 2009. CQC, 2009.Google Scholar
Bak, J, Zoffman, V, Sestoft, DM, Almvik, R, Siersma, VD, Brandt-Christensen, M. Comparing the effect of non-medical mechanical restraint preventive factors between psychiatric units in Denmark and Norway. Nord J Psychiatry 2015; 69: 433–43.CrossRefGoogle ScholarPubMed
Bowers, L, James, K, Quirk, A, Simpson, A, Stewart, D, Hodsoll, J. Reducing conflict and containment rates on acute psychiatric wards: the Safewards cluster randomised controlled trial. Int J Nurs Stud 2015; 52: 1412–22.CrossRefGoogle ScholarPubMed
National Technical Assistance Center. Six Core Strategies to Reduce the Use of Seclusion and Restraint Planning Tool. National Association of State Mental Health Program Directors, 2008.Google Scholar
Duxbury, J, Baker, J, Downe, S, Jones, F, Greenwood, P, Thygesen, H, et al. Minimising the use of physical restraint in acute mental health services: the outcome of a restraint reduction programme (‘REsTRAIN YOURSELF’). Int J Nurs Stud 2019; 95: 40–8.CrossRefGoogle Scholar
Joseph, P. Occupational stress in psychiatric nursing. J Adv Nurs 1993; 18: 591601.Google Scholar
Maslach, C, Jackson, S. Burnout in health professionals: a social psychological analysis. In Social Psychology of Health and Illness (eds Sanders, GS, Suls, J): 227–51. Lawrence Erlbaum Associates, 1982.Google Scholar
Perlman, B, Hartman, EA. Burnout: summary and future research. Hum Relat 1982; 35: 283305.CrossRefGoogle Scholar
Muir-Cochrane, E. An investigation into nurses’ perceptions of secluding patients on closed psychiatric wards. J Adv Nurs 1996; 23: 555–63.CrossRefGoogle ScholarPubMed
Sutherland, VJ, Cooper, CL. Understanding Stress: A Psychological Perspective for Health Professionals. Chapman & Hall/CRC, 1990.Google Scholar
Crowe, M, Inder, M, Porter, R. Conducting qualitative research in mental health: thematic and content analyses. Aust N Z J Psychiatry 2015; 49: 616–23.CrossRefGoogle ScholarPubMed
Hui, AM. The Lived Experiences of Black and Minority Ethnic Patients within a High Security Hospital. Health Education England, 2017.Google Scholar
Khan, KS, Kunz, R, Kleijnen, J, Antes, G. Five steps to conducting a systematic review. J R Soc Med 2003; 96: 118–21.CrossRefGoogle ScholarPubMed
Waffenschmidt, S, Knelangen, M, Sieben, W, Bühn, S, Pieper, D. Single screening versus conventional double screening for study selection in systematic reviews: a methodological systematic review. BMC Med Res Methodol 2019; 19(1): 132.CrossRefGoogle ScholarPubMed
Meehan, T, Vermeer, C, Windsor, C. Patients' perceptions of seclusion: a qualitative investigation. J Adv Nurs 2000; 31: 370–7.CrossRefGoogle ScholarPubMed
Kuosmanen, L, Hätönen, H, Malkavaara, H, Kylma, J, Välimäki, M. Deprivation of liberty in psychiatric hospital care: the patient's perspective. Nursing Ethics 2007; 14(5): 597607.CrossRefGoogle ScholarPubMed
Ling, S, Cleverley, K, Perivolaris, A. Understanding mental health service user experiences of restraint through debriefing: a qualitative analysis. Can J Psychiatry 2015; 60(9): 386–92.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1 PRISMA diagram.

Figure 1

Table 1 Summary of study characteristics

Supplementary material: File

Butterworth et al. supplementary material

Butterworth et al. supplementary material

Download Butterworth et al. supplementary material(File)
File 61.1 KB
Submit a response

eLetters

No eLetters have been published for this article.