Hostname: page-component-77c89778f8-sh8wx Total loading time: 0 Render date: 2024-07-19T13:31:05.591Z Has data issue: false hasContentIssue false
  • English
  • Français

Validation of a computerized assessment (PROQSY) of minor psychological morbidity by Relative Operating Characteristic analysis using a single GP's assessments as criterion measures

Published online by Cambridge University Press:  09 July 2009

Greg Wilkinson  and
A. C. Markus
Greg Wilkinson*
Affiliation:
Institute of Psychiatry, London, Thame Health Centre, Thame
A. C. Markus
Affiliation:
Institute of Psychiatry, London, Thame Health Centre, Thame
*
1Address for correspondence: Dr G. Wilkinson, Institute of Psychiatry, De Crespigny Park, London SE5 8AF.
Get access Rights & Permissions [Opens in a new window]

Synopsis

This is a study of the criterion validity of a newly developed computerized assessment (PROQSY) of minor psychological morbidity based on the Clinical Interview Schedule, employing a single GP's assessments as criterion measures of such morbidity and Relative Operating Characteristic (ROC) analysis. Two-stage screening was carried out with a consecutive sample of 256 patients aged 15 69 consulting an experienced GP in a semi-rural setting over a six-week period. The GP made a standardized assessment of the reason for consultation and the degree of psychological disorder present. A 40% random sub-sample was then assessed using PROQSY. The area under the ROC curve using a GP criterion of minor psychological disorder (‘degree of psychological problem - mild or greater’) was 081 (s.D. = 006). However, the kappa coefficient obtained between this criterion assessment and the PROQSY assessment of minor psychological problem at the observed optimal cut-off score was only 0·28 (S.E. = 0–1; z = 2.83). It is concluded that PROQSY may be recommended for further development as a research tool providing a valid measure of minor psychological morbidity as assessed by GPs in primary care settings.

Type
Preliminary Communication
Information
Psychological Medicine , Volume 19 , Issue 1 , February 1989 , pp. 225 - 231
Copyright
Copyright © Cambridge University Press 1989

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bellantuono, C., Fiori, R., Zanotelli, R. & Tansella, M. (1987). Psychiatric screening in general practice in Italy. A validity study of the GHQ. Social Psychiatry 22, 113–117CrossRefGoogle ScholarPubMed
Bridges, K. W. & Goldberg, D. (1986) The validation of the GHQ-28 and the use of the MMSE in neurological inpatients. British Journal of Psychiatry 148, 548–553.CrossRefGoogle Scholar
Egan, J. P. (1975). Signal Detection Theory and ROC Analysis. Academic Press: New York.Google Scholar
Erickson, B. H. & Nosanchuk, T. A. (1979). Understanding Data. An Introduction to Exploratory and Confirmatory Data Analysis for Students in the Social Sciences. Open University Press: Milton Keynes.Google Scholar
Dorfman, D. D. & Alf, E. (1969). Maximum-likelihood estimation of parameters of signal detection theory and determination of confidence intervals: rating method data. Journal of Mathematic al Psychology 6, 487–496.CrossRefGoogle Scholar
Goldberg, D (1978). The Manual of the General Health Questionnaire. NFER Publishing Company: Windsor.Google Scholar
Goldberg, D. P. & Blackwell, B. (1970) Psychiatric illness in general practice. A detailed study using a new method of case identification. British Medical Journal ii, 439–443.CrossRefGoogle Scholar
Goldberg, D. & Williams, P. (1988) A User's Guide to the General Health Questionnaire. NFER Publishing Company: WindsorGoogle Scholar
Goldberg, D. P., Cooper, B., Eastwood, M. R., Kedward, H. B. & Shepherd, M. (1970). A standardised psychiatric interview for use in community surveys. British Journal of Preventive and Social Medicine 24, 18–23Google ScholarPubMed
Hanley, J. A & McNeil, B. J. (1982). The meaning and use of the area under a Receiver Operating Characteristic (ROC) curve. Radiology 143, 29–36.CrossRefGoogle Scholar
Hanley, J. A. & McNeil, B. J. (1983). A method of comparing the areas under Receiver Operating Characteristic curves derived from the same cases. Radiology 148, 839–843.CrossRefGoogle ScholarPubMed
Lewis, G., Pelosi, A. J., Glover, E., Wilkinson, G., Stansfeld, S. A., Williams, P & Shepherd, M (1988) The development of a computerised assessment for minor psychiatric disorder Psychological Medicine 17, 737–745.CrossRefGoogle Scholar
Mari, J. J. & Williams, P (1985). A comparison of the validity of two psychiatric screening questionnaires (GHQ-12 and SRQ-20) in Brazil, using Relative Operating Characteristic (ROC) analysis. Psychological Medicine 15, 651–659.CrossRefGoogle ScholarPubMed
Marks, J. N., Goldberg, D. P. & Hillier, V. F. (1979). Determinants of the ability of general practitioners to detect psychiatric illnes. Psychological Medicine 9, 337–353.CrossRefGoogle Scholar
Metz, C. E., Wang, P.-L. & Kronman, H B. (1984). ROCFIT. Department of Radiology and the Franklin McLean Memorial Research Institute. University of Chicago.Google Scholar
Sen, B.Wilkinson, G. & Mari, J. J. (1987). Psychiatric morbidity in primary health care. Choice of instruments and cost-effectiveness. British Journal of Psychiatry 151, 33–38.CrossRefGoogle ScholarPubMed
Shepherd, M. & Wilkinson, G. (1988). Primary care as the middleground for psychiatric epidemiology. Psychological Medicine 18, 263–267CrossRefGoogle Scholar
Skuse, D. & Williams, P. (1984) Screening for psychiatric disorder in general practice. Psychological Medicine 14, 365–377.CrossRefGoogle ScholarPubMed
Surtees, P. G. (1987). Psychiatric disorder in the community and the General Health Questionnaire British Journal of Psychiatry 150. 828–835.CrossRefGoogle ScholarPubMed
Swets, J. A. (1964) Signal Detection and Recognition by Human Observers. John Wiley & Sons: New YorkGoogle Scholar
Swets, J A. (1979). ROC analysis applied to the evaluation of medical imaging techniques. Investigative Radiology 14, 365–377.CrossRefGoogle Scholar
Wilkinson, G. & Markus, A C. (1988). PROQSY: a computerised technique for case definition in general practice British Journal of Psychiatry (in the press).CrossRefGoogle Scholar
Wing, J. K., Cooper, J. E. & Sartorius, N. (1974). Measurement and Classification of Psychiatric Symptoms. Cambridge University Press: Cambridge.Google Scholar
Wright, A. F. & Perini, A. F. (1987) Hidden psychiatric illness: use of the General Health Questionnaire in general practice. Journal of the Royal College of General Practitioners 37, 164–167.Google ScholarPubMed