Hostname: page-component-5c6d5d7d68-wbk2r Total loading time: 0 Render date: 2024-08-31T06:59:30.593Z Has data issue: false hasContentIssue false
  • English
  • Français

Assessing Therapist Adherence to Recovery-Focused Cognitive Behavioural Therapy for Psychosis Delivered by Telephone with Support from a Self-Help Guide: Psychometric Evaluations of a New Fidelity Scale

Published online by Cambridge University Press:  23 April 2013

Samantha Hartley ,
Phillippa Scarratt ,
Sandra Bucci ,
James Kelly ,
John Mulligan ,
Sandra T. Neil ,
Zoe Rivers ,
Christopher D. J. Taylor ,
Mary Welford  and
Gillian Haddock
Samantha Hartley*
Affiliation:
University of Manchester and Greater Manchester West Mental Health NHS Foundation Trust, UK
Phillippa Scarratt
Affiliation:
University of Manchester, UK
Sandra Bucci
Affiliation:
University of Manchester, UK
James Kelly
Affiliation:
Greater Manchester West Mental Health NHS Foundation Trust, UK
John Mulligan
Affiliation:
Greater Manchester West Mental Health NHS Foundation Trust, UK
Sandra T. Neil
Affiliation:
Greater Manchester West Mental Health NHS Foundation Trust, UK
Zoe Rivers
Affiliation:
Greater Manchester West Mental Health NHS Foundation Trust, UK
Christopher D. J. Taylor
Affiliation:
University of Manchester, and Manchester Mental Health and Social Care Trust, UK
Mary Welford
Affiliation:
Greater Manchester West Mental Health NHS Foundation Trust, UK
Gillian Haddock
Affiliation:
University of Manchester, and Manchester Mental Health and Social Care Trust, UK
*
Reprint requests to Samantha Hartley, Division of Clinical Psychology, 2nd Floor, Zochonis Building, University of Manchester, Brunswick Street, Manchester M13 9PL, UK. E-mail: samantha.hartley@manchester.ac.uk
Get access Rights & Permissions [Opens in a new window]

Abstract

Background: Recent research has highlighted the importance of psychological interventions such as cognitive behavioural therapy (CBT) in improving outcomes and promoting recovery for people with experience of psychosis, although a lack of trained therapists means that availability of face-to-face CBT is low. Alternative modes of delivering CBT are being explored, such as telephone and self-help methods, although research to date on whether they can be implemented effectively is limited. Aims: The aims of the present study were to describe and evaluate a new therapy fidelity scale (ROSTA; Recovery Oriented Self-help and Telephone therapy Adherence). This scale was developed to assess fidelity to cognitive behaviour therapy for psychosis (CBTp) focused on improving recovery, with optional subscales for delivery over the telephone and alongside a self-help guide. Method: Experienced CBT therapists rated recorded therapy sessions using the ROSTA scale. The scores were used to assess internal consistency and inter-rater reliability, before being compared to scores from an independent expert rater using an alternative fidelity scale for cognitive therapy in psychosis (the CTS-Psy), to investigate concurrent validity. Results: The ROSTA scale demonstrated excellent internal consistency, inter-rater reliability and validity when evaluated as a whole, although findings were mixed in terms of the individual subscales and items. Conclusions: The ROSTA scale is, on the whole, a reliable and valid tool, which may be useful in training and supervision, a utility that would be further emphasized if the therapeutic intervention it assesses is deemed to be efficacious based on future work.

Keywords

Psychosisrecoveryfidelitycognitivebehaviouralpsychometric
Type
Research Article
Information
Behavioural and Cognitive Psychotherapy , Volume 42 , Issue 4 , July 2014 , pp. 435 - 451
Copyright
Copyright © British Association for Behavioural and Cognitive Psychotherapies 2013 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anthony, W. A. (1993). Recovery from mental illness: the guiding vision of the mental health service system in the 1990s. Psychosocial Rehabilitation Journal, 16, 11–23.Google Scholar
Bell, K., Startup, M., French, P., Morrison, A., Bucci, S. and Fowler, D. (2008). Therapist treatment adherence in CBT for people at ultra-high risk for psychosis: development of a new rating scale. Early Intervention in Psychiatry, 2, A16–A16.Google Scholar
Bellg, A., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D., Ory, M., et al. (2004). Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Health Psychology, 23, 443–451. doi: 10.1037/0278-6133.23.5.443 Google Scholar
Blackburn, I.-M., James, I. A., Milne, D. L., Baker, C., Standart, S., Garland, A., et al. (2001). The Revised Cognitive Therapy Scale (CTS-R): psychometric properties. Behavioural and Cognitive Psychotherapy, 29, 431–446.Google Scholar
Coleman, R. (1999). Recovery: an alient concept. Gloucester: Handsell Press.Google Scholar
Haddock, G., Devane, S., Bradshaw, T., McGovern, J., Tarrier, N., Kinderman, P., et al. (2001 ). An investigation into the psychometric properties of the cognitive therapy scale for psychosis (CTS-Psy). Behavioural and Cognitive Psychotherapy, 29, 221–233. doi: 10.1017/S1352465801002089 Google Scholar
Haddock, G., Wood, L., Watts, R., Dunn, G., Morrison, A. P. and Price, J. (2011). The Subjective Experiences of Psychosis Scale (SEPS): Psychometric evaluation of a scale to assess outcome in psychosis. Schizophrenia Research, 133, 244–249. doi: 10.1016/j.schres.2011.09.023 Google Scholar
Keeley, H., Williams, C. and Shapiro, D. (2002). A United Kingdom survey of accredited cognitive behaviour therapists’ attitudes towards and use of structured self-help materials. Behavioural and Cognitive Psychotherapy, 30, 193–203. doi: 10.1017/S1352465802002060 Google Scholar
Landis, J. and Koch, G. (1977). Measurement of observer agreement for categorical data. Biometrics, 33, 159–174.Google Scholar
Lovell, K., Cox, D., Haddock, G., Jones, C., Raines, D., Garvey, R., et al. (2006). Telephone administered cognitive behavioural therapy for treatment of obsessive compulsive disorder: randomised controlled non-inferiority trial. The British Journal of Psychiatry, 333, 883–886.Google Scholar
Lovell, K. and Richards, D. (2000). Multiple access points and levels of entry (MAPLE): ensuring choice, accessibility and equity for CBT services. Behavioural and Cognitive Psychotherapy, 28, 379–392.Google Scholar
May, R. (2004). Making sense of psychotic experiences and working towards recovery. In Gleeson, J. F. and McGorry, P. D. (Eds.), Psychological Iinterventions in Early Psychosis: a treatment handbook. Chichester: Wiley.Google Scholar
Mohr, D., Hart, S., Julian, L., Catledge, C., Honos-Webb, L., Vella, L., et al. (2005). Telephone-administered psychotherapy for depression. Archives of General Psychiatry, 62, 1007–1014.Google Scholar
Moncher, F. and Prinz, R. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247–266.Google Scholar
Morrison, A. P. and Barratt, S. (2010). What are the components of CBT for psychosis? A Delphi study. Schizophrenia Bulletin, 36, 136–142.Google Scholar
National Institute for Clinical Excellence (2009). Core Interventions in the Treatment and Management of Schizophrenia in Adults in Primary and Secondary Care. CG82. London: NICE.Google Scholar
Neil, S. T., Kilbride, M., Pitt, L., Nothard, S., Welford, M., Sellwood, W., et al. (2009). The questionnaire about the process of recovery (QPR): a measurement tool developed in collaboration with service users. Psychosis, 1, 145–155. doi: 10.1080/17522430902913450 Google Scholar
Pitt, L., Kilbride, M., Nothard, S., Welford, M. and Morrison, A. P. (2007). Researching recovery from psychosis: a user-led project. Psychiatric Bulletin, 31, 55–60.Google Scholar
Randolph, J. J. (2005). Free-Marginal Multirater Kappa (Multirater Free): an alternative to Fleiss fixed-rater kappa. Paper presented at the Joensuu University Learning and Instruction Symposium, Joensuu, Finland.Google Scholar
Rollinson, R., Smith, B., Steel, C., Jolley, S., Onwumere, J., Garety, P., et al. (2008). Measuring adherence in CBT for psychosis: a psychometric analysis of an adherence scale. Behavioural and Cognitive Psychotherapy, 36, 163–178. doi: 10.1017/S1352465807003980 Google Scholar
Sarin, F., Wallin, L. and Widerlov, B. (2011). Cognitive behavior therapy for schizophrenia: a meta-analytical review of randomized controlled trials. Nordic Journal of Psychiatry, 65, 162–174. doi:10.3109/08039488.2011.577188 Google Scholar
Shapiro, D., Cavanagh, K. and Lomas, H. (2003). Geographic inequity in the availability of cognitive behavioural therapy in England and Wales. Behavioural and Cognitive Psychotherapy, 31, 185–192. doi: 10.1017/S1352465803002066 Google Scholar
Shrout, P. E. and Fleiss, J. L. (1979). Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.Google Scholar
Startup, M., Jackson, M. and Pearce, E. (2002). Assessing therapist adherence to cognitive-behaviour therapy for psychosis. Behavioural and Cognitive Psychotherapy, 30, 329–339. doi:10.1017/S1352465802003077 Google Scholar
Stickley, T. and Wright, N. (2011a). The British research evidence for recovery, papers published between 2006 and 2009 (inclusive). Part One: a review of the peer-reviewed literature using a systematic approach. Journal of Psychiatric and Mental Health Nursing, 18, 247–256. doi: 10.1111/j.1365-2850.2010.01662.x Google Scholar
Stickley, T. and Wright, N. (2011b). The British research evidence for recovery, papers published between 2006 and 2009 (inclusive). Part Two: a review of the grey literature including book chapters and policy documents. Journal of Psychiatric and Mental Health Nursing, 18, 297–307. doi: 10.1111/j.1365-2850.2010.01663.x CrossRefGoogle Scholar
Waltz, J., Addis, M., Koerner, K. and Jacobson, N. (1993). Testing the integrity of a psychotherapy protocol: assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.Google Scholar
Wykes, T., Steel, C., Everitt, B. and Tarrier, N. (2008 ). Cognitive behavior therapy for schizophrenia: effect sizes, clinical models, and methodological rigor. Schizophrenia Bulletin, 34, 523–537. doi: 10.1093/schbul/sbm114 Google Scholar
Submit a response

Comments

No Comments have been published for this article.