Published online by Cambridge University Press: 14 November 2008
Studies designed to evaluate the services of a health or welfare institution face the major difficulty of selecting evaluative criteria to serve as measures of successful performance. This paper explores that difficulty in the context of a study of a new psychogeriatric day hospital. The study and its methods of data collection are described. ‘Patient turnover’ features prominently as a measure of success within the hospital. Consultants, nurses, general practitioners, social workers, staff of a related hospital and patients’ relatives interpret this measure in different ways and adopt different strategies to pursue ‘success’ in their own interests. These differences are described. The paper concludes that a ‘pluralistic evaluation’ has several advantages as compared to other approaches.
1 For the most recent overview of research on this theme in the context of services for the elderly see Goldberg, E. M. and Connelly, N.The Effectiveness of Social Care for the Elderly: An Overview of Recent and Current Evaluative Research, Heinemann, London, 1982.Google Scholar In spite of much work on the problems of evaluation, a difficulty – which is essentially some form of the difficulty that we describe here – constantly reappears. Goldberg, and Connelly, state in summary: ‘The evaluative process starts with the identification of aims, goes on to the definition and assessment of needs, the description and monitoring of input and moves on finally to the measurement of outcome’ (p. 37)Google Scholar [italics added]. In this article we describe how we are confronting the first stage of this process in research. (Although by the end of the paper we shall be led to concude that aims, assessed needs, inputs and outputs are by no means as separate or sequentially related as Goldberg and Connelly seem to suggest.)
2 Throughout the paper, such figures are drawn from the pilot study of the medical records, mentioned in the text. There may have been changes over time but we have no evidence to suggest that this would affect the general points that are made in this paper.
3 For comparative accounts of day hospital and other day services for the elderly and elderly mentally infirm, see Brocklehurst, J. C. and Tucker, J. S.Progress in Geriatric Day Care, King Edward's Hospital Fund for London, 1980Google Scholar; and Tibbitt, J. E. and Tombs, J.Day Services for the Elderly and Elderly with Mental Disability in Scotland, Scottish Office, Edinburgh, 1981.Google Scholar
4 Smith, G. Some Problems in the Evaluation of a New Psychogeriatric Day Hospital, in Taylor, R. and Gilmore, A. (eds) Current Trends in British Gerontology, Gower, Aldershot, 1982, 204–216.Google Scholar
5 ‘Patient flow’ is not the only criterion of success used within this hospital. We are reporting upon other aspects of the work of the hospital elsewhere. See Smith, G., Cantley, C. with the assitance of Ritman, V.Pluralistic Evaluation: A Study in Day Care for the Elderly Mentally Infirm. End of Grant Report Submitted to the Scottish Home and Health Department (mimeo), Department of Social Administration, University of Hull, 1983.Google ScholarSmith, G., Cantley, C. with the assistance of Ritman, V., Day Care Made Simple. Health and Social Service Journal (9 06 1983).Google ScholarPubMedCantley, C. and Smith, G. Social work and a relatives support group in a psychogeriatric day hospital: a research note. British Journal of Social Work (forthcoming).Google Scholar
6 For examples see Pathy, M. S.Day hospitals for geriatric patients. The Lancet, ii (619), (1969), 533–535.CrossRefGoogle ScholarBaker, A. A. and Byrne, R. J. F.Another style of psychogeriatric service. Brit. J. Psychiat. 130, (1977), 123–126.CrossRefGoogle ScholarPubMedCross, K. W., Hassail, C. and Gath, D.Psychiatric day-care: the new chronic population? Journal of Preventive Social Medicine 26, (1972), 199–204.Google ScholarPubMedMartin, A. and Millard, P. H.The new patient index – a method of measuring the activity of day hospitals. Age and Ageing 4, (1975), 119–122.CrossRefGoogle ScholarPubMedGreen, J. G. and Timbury, G. C.A geriatric psychiatry day hospital service: a five-year review. Age and Ageing 8, (1979), 49–53.CrossRefGoogle Scholar
7 Data on this project were collected under the usual conventions of research confidentiality and the protection of individual respondents. It is not possible in this paper to infer with certainty the identity of respondents (even though readers familiar with the research context may feel that they can). In ways which are not significant to the arguments of the paper some details have been deliberately falsified to ensure that this is so.
8 Blake, D. H.A day hospital for geriatric patients: the first twelve months. The Medical Journal of Australia ii (18), (1968), 802–804.Google Scholar
9 Op. cit.
10 Silverman, W. H. and Val, E.Day hospital in the context of a community health program, Community Mental Health Journal ii, 1, (1975), 82–90.CrossRefGoogle Scholar
11 Op. cit.
12 Goldstein, S., Sevriuk, R. N. and Grauer, H.The establishment of a psychogeriatric day hospital. Canad. Med. Ass. J. 98, (18 05 1968), 955–959.Google ScholarPubMed
13 Irvine, R. E.Physiotherapy and the Geriatric Day Hospital. Physiotherapy, 55 (9), (1969). 352–357.Google ScholarPubMed
14 Op. cit.
15 For example, Marsden, C. D. The Diagnosis of Dementia, in Isaacs, A. D. and Post, F. (eds), Studies in Geriatric Psychiatry. Wiley, Chichester, 1978, pp. 95–118.Google Scholar
16 This is not to imply that patients are discharged in a way that could be adjudged clinically premature. Such an assessment is not a part of our evaluation of the hospital.
17 Op. cit.
18 Op. cit.
19 McDonald, R. D., Neulander, A., Holod, O. and Holcomb, N. S. Description of a non-residential psychogeriatric day-care facility. The Gerontologist, Winter, Part 1, (1970).Google Scholar
20 Goldstein, S. E. and Carlson, S.Evolution of an active psychogeriatric day hospital. C. M. A. Journal 11 (1976), 874–875.Google Scholar
21 Op. cit.
22 Op. cit.
23 Op. cit.
24 Morton, E. V. B., Barker, M. E. and McMillan, D.The joint assessment and early treatment unit in psychogeriatric care. Geron. Clin, 10, 2 (1968), 65–73.CrossRefGoogle Scholar
25 Pitts, J. Y.Psychogeriatric care: a programme for hospital treatment. Nursing Times 70, 35, (1974), 1342, 1343.Google ScholarPubMed
26 Erickson, R. C. and Backus, F. I.Symptom severity and day hospital admission. Hospital and Community Psychiatry 24, 2, (1973), 102–104.Google ScholarPubMedRobertson, D., Griffiths, R. A. and Cosin, L. Z.A community-based continuing care program for the elderly disabled: an evaluation of planned intermittent hospital readmission. Journal of Gerontology 32, (1977), 334–339.CrossRefGoogle ScholarPubMed
27 Organisational strategies for achieving patient turnover are important, but we do not mean to imply that the Consultant's manoeuvres are purely tactical. He also exercises very considerable power rooted in his professional and legal position as consultant-in-charge of the hospital.
28 Austin, N. K.., Liberman, R. P., King, L. W. and DeRisi, W. J.A comparative evaluation of two day hospitals. The Journal of Nervous and Mental Disease 163, 4, (1976), 253–262.CrossRefGoogle ScholarPubMed
29 Op. cit.
30 Op. cit.
31 Silverman, and Val, , op. cit.Google Scholar
32 Op. cit.
33 Shulman, K. and Ane, T.Fall in admission rate of old people to psychiatric units. British Medical Journal (21 01 1978), 156–158.CrossRefGoogle ScholarPubMed
34 Carney, M. W. P., Ferguson, R. S. and Sheffield, B. F. Psychiatric day hospital and community. Lancet, (1970) 1218–1220.Google Scholar
35 Williams, R. G. A.Innovation in community care and general practice: a study of interpretations of a day hospital. Social Science and Medicine, 14 A, (1980), 501–510.Google Scholar
36 Jones, I. G. and Munbodh, R.An evaluation of a day hospital for the demented elderly. Health Bulletin 40, 1, (1982), 10–15.Google Scholar
37 For a general discussion of this and related processes see Thompson, K. Organisations as constructors of social reality, in Salaman, G. and Thompson, K.Control and Ideology in Organisations. Open University Press, Milton Keynes, 1980, 216–236.Google Scholar
38 Wadsworth, M. E. J., Sinclair, S. and Wirz, H. M.A Geriatric day hospital and its system of care. Social Science and Medicine 6, (1972), 507–525.CrossRefGoogle ScholarPubMed
39 Whitehead, T. and Mankikar, G. Geriatric psychiatry in the general hospital. The Lancet, (15 06 1974), 1213–1215.Google Scholar
40 Op. cit.
41 For a comparison see Wadsworth, , op. cit.Google Scholar
42 Peach, H. and Pathy, M. S.Social support of patients attending a geriatric day hospital. Journal of Epidemiology and Community Health 32, (1978), 215–218.CrossRefGoogle ScholarPubMed
43 Rathod, N. H. and Vandrey, B. H.Factors associated with assignment to treatment. Acta Psichiatrica Scandinavia. 47 (4), 1971, 368–398.Google ScholarPubMed
44 Bergmann, K., Foster, E. M., Justice, A. W. and Matthews, V., Management of the demented elderly patient in the community. British Journal of Psychiatry 132, (1978), 44–449.CrossRefGoogle Scholar
45 Cosin, L.Architectural and functional planning for a geriatric day hospital. International Journal of Social Psychiatry 17, 2 (1971), 133–140.CrossRefGoogle Scholar
46 Robertson, Unlikeop. cit.)Google Scholar who deliberately didnot interview patients because they expected their views to differ from staff, we do consider patients to be a significant constituent group of the day hospital. However, the collection and analysis of data generated by psychogeriatric patients themselves raises such substantial practical and methodological problems as to be beyond the scope of this paper.
47 For a recent study see Blaxter, M.The Meaning of Disability: A Sociological Study of Impairment. Heinemann, London, 1976.Google Scholar
48 Weiss, Carol H.Evaluation Research. Prentice-Hall, Englewood Cliffs, New Jersey, 1972, pp. 24–25.Google Scholar Amongst the problems she lists are the following. Goals are often hazy and ambiguous. In pursuing goals unexpected accomplishments are often achieved additionally and sometimes instead. Programmes consist of ‘congeries of activities, people and structures’. And in its simplest form the evaluative question neglects the issue of why, which is quite as important as the issues of how well.
49 Goldberg, E. M. and Connelly, W.Evaluative Research in Social Care. Heinemann, London, 1981, p. 313.Google Scholar
50 Kelman, H. R.The underdevelopment of evaluative research on health services for the elderly in the United States. International Journal of Health Services 10, 3 (1980), 501–511.CrossRefGoogle ScholarPubMed
51 Smith, G.Op. cit. p. 204.Google Scholar
52 Hall, P., Land, H., Parker, R. and Webb, A.Change, Choice and Conflict in Social Policy. Heinemann, London, 1975, 127.Google Scholar
53 Ibid. pp. 127–129.
54 Strauss, A., Schatzman, L., Ehrlich, D., Booker, R. and Shabshin, M. The Hospital and Its Negotiated Order. In Salaman, J. and Thompson, K. (eds) People and Organisations. Longmans for the Open University Press, 1973, p. 318.Google Scholar
55 It could be argued that it is a mistake to link pluralistic evaluation methods to the pluralistic model of policy analysis. It may well be thought equally possible to use pluralistic methods within a ‘conflict’ model of policy analysis, or any other theoretical framework for that matter. Here we note only that in the course of our research we came to adopt pluralistic methods by viewing the Hospital as a pluralistic institution. We propose to discuss the general point at greater length elsewhere, for it involves issues which are beyond the scope of this paper. We are grateful to an anonymous referee for raising the matter.