Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-25T11:40:17.583Z Has data issue: false hasContentIssue false

Is AGREE II a counsel of perfection? A letter commenting on Lytvyn et al1

Published online by Cambridge University Press:  03 April 2017

Sheldon P. Stone*
Affiliation:
Royal Free Campus, Royal Free and University College Medical School, University College London, London, United Kingdom
Mark Wilcox
Affiliation:
Department of Microbiology, Leeds Teaching Hospitals and University of Leeds, Old Medical School, Leeds General Infirmary, Leeds, United Kingdom
Peter Hawkey
Affiliation:
National Infection Service, Public Health England, Birmingham Heartlands Hospital, Birmingham, United Kingdom.
*
Address correspondence to Sheldon P. Stone, BSc, MD, FRCP, Senior Lecturer, Stroke Physician and Consultant Physician for Older People, Royal Free Campus, Royal Free and University College Medical School, University College London, Rowland Hill Street, Hampstead, London NW3 2PF United Kingdom (sheldon.stone@ucl.ac.uk).
Rights & Permissions [Opens in a new window]

Abstract

Type
Letters to the Editor
Copyright
© 2017 by The Society for Healthcare Epidemiology of America. All rights reserved 

To the Editor—We read the systematic survey (review) of Clostridium difficile (CD) guidelines (August 2016) with interest. We suggest that Lytvyn et al are proposing a counsel of perfection, ignoring the realities of producing practical guidelines to address rising infection levels. In particular, we question their data extraction from the UK guidelines and their views that (1) a systematic review is a pre-requisite of guideline writing; (2) relatively weak evidence should not result in strong recommendations; (3) ecological studies are grade 5 evidence; and (4) probiotics have the highest level of evidence for any CD prevention intervention.

Guidelines are produced in response to emergence of new diseases, new evidence on management, or rising levels of existing disease. The latter circumstance, plus a high-profile political drive to reduce CD, prompted revision of the UK guidelines. As we explained “A formal systematic review with grading of the level of evidence (in) each study was not done … (we) did not consider that evidence had changed sufficiently to … warrant extra time and resources.” We would like to ask Lytvyn et al which studies, published up to the end of 2007, were excluded from our review that would have materially affected the final recommendations? We suggest that AGREE II amend their standard to allow the guideline authors to justify why systematic reviews were not done.

Lytvyn et al state that the UK guidelines did not update prevention-related information. However, our introduction explicitly stated, “This guidance updates and replaces the 1994 report … outlines newer evidence and approaches to good infection control and environmental hygiene … taking into account national clinical governance frameworks which did not exist in 1994.” The example of antibiotic stewardship illustrates the difference in prevention-related information between 1994 and 2008. The former simply recommend, “adoption of an antibiotic policy” and “use of narrow spectrum antibiotics whenever the causative pathogen is known.” The 2008 guidelines recommend “restrictive antibiotic guidelines using narrow-spectrum agents … for empirical and definitive treatment … .” They specify which antibiotics to avoid, and they recommend the formation of antimicrobial management teams including antimicrobial pharmacists and information technology specialists to facilitate feedback of antibiotic and CD data. In 1994, neither antimicrobial teams, antimicrobial pharmacists, information technologists, nor data feedback existed.

Lytvyn et al are concerned that guidelines fail to explain how low-quality evidence leads to strong recommendations. The UK guidelines were explicit that lower-quality evidence could result in strong recommendations if “supported by non-RCT studies and/or by clinical governance reports and/or the Code.” Maybe they overlooked this statement or did not appreciate that the Hygiene Code has legal status, with hospitals and individuals facing legal sanctions for noncompliance. Governance reports based on public inquiries or investigations by regulatory authorities cannot be ignored and must be considered alongside the scientific evidence. Do Lytvyn et al suggest that a lack of RCTs or systematic reviews of RCTs of the effects of restrictive antibiotic policies on CD levels means that antibiotic restriction should not be strongly recommended? How well do they think clinicians would follow a “moderate” recommendation”? The proof of the pudding is in the eating. Since the United Kingdom adopted these guidelines, fluoroquinolone, cephalosporin, and other broad-spectrum antibiotic prescriptions have declined markedly, with the levels of CDI falling by 70%–80%. No other country has achieved this result. 2 , 3

Why do Lytvyn et al regard ecological studies as “grade 5 evidence”? Such studies recognize the environmental determinants of disease, are a well-accepted pragmatic design for evaluating public health interventions, use widely available data, and provide a wider range of exposures than a trial, thus increasing the generalizability of findings. Potential limitations are minimized if measurement, analysis, and interpretation are performed at group level, if data are available and reliable, and if inference from group to individual is avoided.Reference Stevenson and McClure 4 One such study, using 4 years of data from all English acute-care hospitals, showed a very strong independent association between soap use and CD rates.Reference Pratt 5 Would Lytvyn et al really not consider such evidence that supports a strong recommendation for hand-hygiene with soap to prevent CD?

Lytvyn et al took all guidelines to task for not recommending probiotics, which they regard as “the prevention strategy with highest-level evidence.” All but 1 of these guidelines, however, was prepared or published before the Cochrane review of probiotics was published. The single guideline published afterward rightly regards the case for probiotics as unproven, due to few large robustly designed studies, pooling of data on different probiotics, and large amounts of missing CD data. The Cochrane review’s own reanalysis using complete data sets revealed no effect of probiotics.

We do not agree that clinical guidelines should address resource implications. Their development may require substantial extra work and research, delaying guidance needed to address rising infection levels. For example, calculating the additional isolation capacity required for CD, its cost, opportunity costs, and their potential offset by reduced CD may be less important than getting the guidelines published. Insisting that both systematic reviews and cost estimations are done, although ideal, may risk accusations of “fiddling while Rome burns.” As authors of guidelines ourselves,Reference Pratt 6 , Reference Stone, Cooper and Kibbler 7 we consider them to be guidance from which authors may depart when there are good grounds or circumstances to do so. 8 Clinical guideline writing is neither an isolated academic exercise nor so difficult that it requires a “methodologist” lead. It requires experienced clinicians and researchers to apply its principles wisely in the clinical and national contexts where the guideline will be applied. The United Kingdom was experiencing an epidemic of CDI. The publication of the 2008 guidelines was part of a concerted ultimately successful public health campaign to reduce the CDI epidemic.

ACKNOWLEDGMENTS

Financial support: No financial support was provided relevant to this article.

Potential conflicts of interest: M.W. has done research work for and received consultancy and/or lecture fees from Actelion, Cubist, Astellas, Optimer, Sanofi-Pasteur, Summit, Biomerieux, Da Volterra and Qiagen; consultancy fees from Seres, Merck, Valneva; and a consultancy fee and a departmental grant from ALera. P.H. has received personal fees from Merck, Optimer, Novolytics, Novasta, Biselea, Wyeth, MagisCommunications, Pfizer, and Novartis as well as grants and personal fees from Eumedica and Pfizer. S.P.S. has no conflict of interest relevant to this article.

References

REFERENCES

1. Lytvyn, L, Mertz, D, Sadeghirad, B, et al. Prevention of Clostridium difficile infection: a systematic survey of clinical practice guidelines. Infect Control Hosp Epidemiol 2016;37:901908.Google Scholar
2. The National Archives. Public Health England. Mandatory surveillance of Clostridium difficile. Previous C. difficile monthly tables. http://webarchive.nationalarchives.gov.uk/20140714084352/http://www.hpa.org.uk/web/HPAweb&HPAwebStandard/HPAweb_C/1259151898525. Accessed March 13, 2017.Google Scholar
3. Dingle KE, Didelot X, Phuong Quan T, Eyre DW, Stoesser N, Golubchik T, et al. Effects of control interventions on Clostridium difficile infection in England: an observational study. Lancet Infect Dis 2017; doi: http://dx.doi.org/10.1016/S1473-3099(16)30514-X.Google Scholar
4. Stevenson, M, McClure, R. Use of ecological study designs for injury prevention. Inj Prev 2005;11:24.CrossRefGoogle ScholarPubMed
5. Stone, S, Fuller, C, Savage, J, et al. Evaluation of the national Cleanyourhands campaign to reduce Staphylococcus aureus bacteraemia and Clostridium difficile infection in hospitals in England and Wales by improved hand hygiene: four year, prospective, ecological, interrupted time series study. BMJ 2012;344:e3005.Google Scholar
6. Pratt, R. The EPIC project: developing national evidence-based guidelines for preventing healthcare associated infections. J Hosp Infect 2001;47:S1S82.Google Scholar
7. Stone, SP, Cooper, BS, Kibbler, CC, et al. The ORION STATEMENT guidelines for transparent reporting of outbreak reports and intervention studies of nosocomial infection. Lancet Infect Dis 2007;7:282288.Google Scholar
8. Stone SP, Cookson BD. Commentary: Endorsing reporting guidelines: infection control literature gets ahead of the game. Am J Infect Control 2016;44:14461448.CrossRefGoogle Scholar