Background
Morbidity is defined as a state of being unhealthy or of experiencing an aspect of health that is “generally bad for you”. Morbidity associated with paediatric cardiac surgery is illness or lack of health that has a temporal connection to such an operation, and as such may be regarded as an adverse outcome. The Society of Thoracic Surgeons Taskforce Subcommittee on Patient Safety has defined a range of unwanted events that may contribute to postoperative morbidity, including complications, adverse events, harm, medical error or injury, and near misses.Reference Jacobs, Benavidez, Bacha, Walters and Jacobs 1 This Patient Safety Taskforce further noted that in the current era of falling mortality rates after paediatric cardiac surgery, improvement in healthcare as measured by reduction in adverse outcomes is more likely when unwanted events are acknowledged, measured, and responded to in terms of healthcare deliveryReference Jacobs, Benavidez, Bacha, Walters and Jacobs 1 .
The main focus of our study, which has a national setting in the United Kingdom, is upon early paediatric cardiac surgical morbidities that are considered potentially avoidable, reducible, or can be mitigated. This is important to achieve as children who experience prolonged hospitalisation with complications, which are occurrences associated with an intervention that represent a departure from the desired course of events and are linked to suboptimal outcomeReference Jacobs, Benavidez, Bacha, Walters and Jacobs 1 , are at greater risk of deathReference Pasquali, Li and Burstein 2 , Reference Brown, Ridout, Goldman, Hoskote and Penny 3 Furthermore, over the long term, children with specific heart conditions who experienced prolonged stays in hospital following surgery also developed higher levels of neurological disability.Reference Bellinger, Wypij and duPlessis 4 , Reference Newburger, Sleeper and Bellinger 5 Prolonged stays in hospital may be required when a patient takes longer to recover after surgery because of complications, but it is well recognised that prolonged hospitalisation may itself expose patients to the likelihood of further hospital-associated adverse events. A significant complication of paediatric cardiac surgery and mechanical circulatory support is linked to neurological disability in around 50% of casesReference Lequier, Joffe and Robertson 6 and may cost in excess £10,000/day to implement.Reference Mahle, Forbess, Kirshbom, Cuadrado, Simsic and Kanter 7 , Reference Brown, Wray, Wood, Mc Mahon, Burch and Cairns 8
Routine audit of postoperative mortality is well established in the United Kingdom via the National Congenital Heart Diseases Audit (NCHDA), 9 which has published centre-specific results of individual operations online since 2005. Stakeholders including children’s heart surgery programmes, congenital heart patient support groups, and National Congenital Heart Diseases Audit share a goal of reporting morbidity, but acknowledge that to enable routine monitoring of morbidities approaches to data analysis and display must be developed alongside defining suitable measures for routine use. A series of detailed articles by professionals from the United States of America-based Multi-Societal Database Committee for Pediatric and Congenital Heart Disease profiled an extensive range of complications incorporating all organ systems.Reference Cooper, Jacobs and Chai 10 – Reference Jacobs 17 The Society of Thoracic Surgery database selected a narrower range of defined major complications that were retrospectively available within the Registry, and demonstrated that rates varied from 1 to 38% with greater prevalence at increased procedural complexity.Reference Jacobs, O’Brien and Jacobs 18 A further study indicated that prospective monitoring of complications may lead to greater case ascertainment, and hence a perception of higher complication ratesReference Belliveau, Burton, O’Blenes, Warren and Hancock Friesen 19 .
Views may differ between professionals and non-professionals over what exactly the term morbidity refers to, and which morbidity events are most important. A recent study showed differing perceptions and priorities between clinicians and patients regarding chronic obstructive pulmonary disease services and outcomes.Reference Murphy, Black and Lamping 20 Focus groups and formal consensus methods have been used to elicit patient and carer perspectives and determine group priorities in many contexts.Reference Gill, Hewitson, Peile and Harnden 21 The nominal group technique was successfully used among general practitioners to identify prioritised lists of quality markers for the management of children in general practiceReference Gill, Hewitson, Peile and Harnden 21 and by kidney transplant patients in ranking outcomes by importance.Reference Howell, Tong, Wong, Craig and Howard 22 Our study, which aimed to identify the incidence and impact of important early morbidities following paediatric cardiac surgery, 23 has been undertaken within the context of the United Kingdom National Health Service. As is depicted in Figure 1, which displays our study methodology, we utilised information from a systematic review of the literature that screened 1169 publications, an online discussion forum between families of patients with CHD, and three focus groups with CHD families run by the patient and family support group Children’s Heart Federation, to identify, as far as possible, the entire range of known morbidity events. A group representing individuals from a range of backgrounds – the “Selection Panel” – which comprised 15 people – three family representatives, three paediatric cardiac surgeons, two paediatric intensive care doctors, two paediatric cardiologists, two paediatricians, a paediatric intensive care nurse, a clinical nurse specialist, and a clinical psychologist with experience of working with children with CHD and their families – prioritised the possible morbidities using the nominal group technique and secret voting. Working in parallel alongside this “Selection Panel”, a second group of professionals, referred to as the “Definition Panel” (see Acknowledgements), worked with the prioritised list of potential morbidities to both define and assess the practicality of measuring them in routine clinical practice. This article details the definitions of morbidity that the panel recommended.
Methods
Development of operational definitions for routine morbidity monitoring
Over 1 year, we convened two meetings of a surgical morbidity “Definition Panel” that included three paediatric cardiac surgeons, where one was the chair, three paediatric cardiologists, with one specialising in adult CHD, three paediatric intensive care specialists, and two children’s heart disease nurses. The “Definition Panel” had the following goals:
-
∙ Establish diagnostic criteria that constitute the definition of each of the morbidities, as prioritised by the “Selection Panel”.
-
∙ Define the measurement protocol for each of the morbidities, including any aspects that require additional specialist input or alternatively surveillance outside the tertiary centre.
-
∙ Outline the minimum standards of the clinical pathway and necessary referrals and treatment for children who experience morbidities over the first 6 months after surgery.
This third part of the study drew upon information from the literature review and any relevant, established guidelines.Reference Cooper, Jacobs and Chai 10 – Reference Jacobs 17 , 24
In the first phase of the study, conducted through an initial face-to-face meeting followed by e-mail correspondence, the group provided the “Selection Panel” with views as to whether each candidate morbidity nominated by the first meeting of the “Selection Panel” was definable, measureable, and feasible to measure in routine practice, highlighting any additional issues identified in relation to each morbidity; one or two clinical leads were identified to take forward each of the individual shortlisted morbidities, utilising both e-mail and web-based interactions to develop each morbidity definition, reporting back at the second meeting of the definition group with an agreed package to sign off. Clinical leads consulted with other experts in the relevant field in order to optimise definitions and protocols where necessary. The protocols for identification, measurement, and management of shortlisted morbidities, including the timings of measurements, were designed for use in a multi-centre evaluation of morbidity incidence and impact, with suitability for routine use as a key requirement.
The morbidity definitions were implemented by a small group of nurses, intensive care doctors, and cardiothoracic surgeons within five children’s heart centres based in the United Kingdom over a period of 2 months and used to prospectively record cases of morbidity as part of a wider research study. 23 During this time period, the definitions underwent further refinement and clarification in order to ensure that they were workable in the context of routine audit within the National Health Service.
Results
Morbidity definitions
Each definition is described in turn incorporating the timescale for identification of the morbidity, the definition, measurement protocol, and early management protocol in brief as described by the group. Morbidities are listed in priority order as determined by the selection panel.
Multiple morbidities and items not included
Within the context of the present study, 23 which aims to prospectively measure the incidence and impact of defined morbidity events, the approach to the number of morbidities in a given patient will be to identify single morbidity events as defined (1–9), extracorporeal life support morbidity events, which may incorporate further identified morbidities alongside, and multiple morbidities in instances where a patient has one or more morbidities excluding extracorporeal life support.
The “Selection Panel” further highlighted the importance of prolonged hospitalisation and poor communication between the treating team and the family, which they considered to be morbidities. It was noted by the definition panel that prolonged hospitalisation is linked to all post-procedural complications, and hence including length of stay as a morbidity would make measurement of the incidence of individual morbidities very challenging. Length of stay data including ventilation times, ICU length of stay, and hospital length of stay will be reviewed as part of the data analysis at the end of the study.
The “Definition Panel” considered that there was potential to define poor communication between the treating team and family in the future, but that it would necessarily involve asking parents about their experience in a way that would involve new data collection. The quality of communication between the treating team and the family has previously been assessed within the context of a patient satisfaction survey for all paediatric inpatients in England commissioned by the Care Quality Commission and undertaken by the organisation Picker Institute Europe.Reference Europe 25 The survey questions were formally developed using focus groups and were formally validated. The Picker Institute agreed to assist the definitions panel in identifying a short list of six questions to ask parents about communication and issued the research team with licence to allow our study to use these questions for patients recruited to a 6-month follow up sub-study to delineate this issue further. From a long list of 25 candidate questions from the Picker Questionnaire identified by the definition panel, Picker ran the following analysis:
-
∙ Frequency analysis to ascertain the percentage of missing data and the percentage of patients answering each of the possible responses.
-
∙ Inter-item correlation analysis and principal component analysis to identify questions that provided different dimensions of communication experience.
Picker then advised the Definition Panel on five to seven questions that could be asked of parents within 6 weeks of the patient’s primary operation. The final questions chosen by the Definition Panel after discussion with Picker are as follows:
Q1.Did new members of staff treating your child introduce themselves?
Q2. Were you encouraged to be involved in decisions about your child’s care and treatment?
Q3.Were you told different things by different people, which left you feeling confused?
Q4.Were the different members of staff caring for and treating your child aware of their medical history?
Q5. Before the operation or procedure, did a member of staff explain to you what would be done during the operation or procedure?
Q6. Did a member of staff tell you what to do or who to talk to if you were worried about your child when you got home?
We did not set a threshold for what defines “poor communication”; instead, we will explore the range of responses among control and case patients in our 6-month follow-up sub-study and possible associations with other clinical factors as part of a secondary data analysis.
Discussion
We present a list of consensus-based definitions of morbidities arising with paediatric cardiac surgery that have been designed for prospective audit. The prioritised and defined morbidities reflect a range of viewpoints and priorities, including those of both professionals and patients or parents. The professionals involved in our study represent tertiary, secondary, and primary care, and furthermore we have involvement in our study from at least one professional from every specialist paediatric cardiac surgical centre in the United Kingdom. We note that the list contains morbidities that were previously prioritised as “complications” by specialist professionals and included in a recent consensus-based statement from the United States of America-based Multi-Societal Database Committee for Pediatric and Congenital Heart Disease,Reference Jacobs, Jacobs and Austin 26 which are extracorporeal life support, renal support, pacemaker placement, diaphragm palsy, new permanent neurological deficit, and re-operation, but our list also contains further items not previously identified and prioritised, which are feeding problems, prolonged pleural effusion, and sepsis.
Challenges and limitations
In reaching these definitions certain challenges arose.
Consideration of pre-procedural factors
A major difficulty when contemplating the monitoring of morbidity following paediatric cardiac surgery is achieving a distinction between the morbidity that was present in the patient before the operation and the new morbidities that arose after surgery. It must be acknowledged that preoperative events such as existing congenital diagnoses and patient condition are inextricably linked to the postoperative journey,Reference Brown, Ridout, Goldman, Hoskote and Penny 3 , Reference Newburger, Sleeper and Bellinger 5 and indeed both preoperative and postoperative events matter for the patient. Preoperative events may also potentially be subject to quality control – for example, the collapse of a neonate from late diagnosis of heart disease leads to higher rates of multiple organ failureReference Brown, Ridout, Hoskote, Verhulst, Ricci and Bull 27 and may be averted by antenatal diagnosis and prospective management of the circulation.Reference Sivarajan, Penny, Filan, Brizard and Shekerdemian 28 Nonetheless, our focus is upon early outcomes after paediatric cardiac surgery and not on the entire care pathway; therefore, the definitions are designed to delineate postoperative events as clearly as possible. The delineation of new neurological morbidity in a postoperative patient may be challenging because of the inherent difficulties of assessing (in particular) small infants who may be critically ill. Prospective serial evaluation including preoperative and postoperative scans and detailed neurodevelopmental follow-up is ideal; however, this is not feasible within a United Kingdom National Health Service context, where cranial scans may only be undertaken on the basis of clinical indicators of suspected neurological injury, and hence our definition is pragmatic by necessity, although we hope that in the future it will be supplemented by enhanced methods of assessment.
Post-procedural timing
Conventionally, the time horizon linked to surgical complications has been considered as 30 days following the operation,Reference Jacobs, Jacobs and Austin 26 and for mortality outcomes Registries such as Society of Thoracic Surgery view the relevant time horizon as within the same operative hospitalisation or 30 days, whichever is longer.Reference Clarke, Breen and Jacobs 29 For the majority of morbidity definitions, the time limit of either within 30 days or within the same hospitalisation was applied (see Table 1), based on what was considered most appropriate for the individual morbidity event. Certain morbidities, particularly those defined by the use of technology, such as renal support and extracorporeal life support, are only likely to occur within a hospitalisation, whereas others may occur at any time point over an operated child’s lifespan – for example, re-operation, endocarditis, and feeding problems – and hence a time limit was placed accordingly in order to enhance the feasibility of postoperative audit, despite this time limit in some cases appearing arbitrary. It was noted that deep surgical site infection or mediastinitis, although always linked to cardiac surgery, may arise after discharge home and later than 30 days after surgery, and thus the timeline was extended for this morbidity.
Consistency and complexity of definitions
There are inherent practical difficulties with prospective audit of complex outcome measures; this is one reason for the historic focus on mortality as an outcome as this is much easier to measure than morbidity. For some morbidities, a treatment indicating the presence of morbidity was considered the better option rather than basing the diagnosis on clinical findings. This applies to the postoperative morbidities of renal failure, diaphragm paralysis, and feeding problems, for which postoperative renal support, the need for diaphragm plication, and technology-assisted feeding at discharge were selected as the most objective definitions available. A concern with using a treatment rather than a diagnosis as a measure of morbidity is that treating centres may initiate therapy at differing thresholds. During the course of our study, additional data items will be collected to explore the potential for such variation. As an example, practice patterns with respect to technology-assisted feeding in cardiac babies vary widely between geographic regions and diagnostic groups, and it is acknowledged that the audit of feeding problems at discharge rather than over time in outpatients may not capture the full picture.Reference Medoff-Cooper and Ravishankar 30 For the case of extracorporeal life support, there is an inextricable link between the severe condition of patients requiring this therapy and the burden of the treatment itself,Reference Newburger, Sleeper and Bellinger 5 , Reference Jacobs, Jacobs and Austin 26 , Reference Medoff-Cooper, Naim, Torowicz and Mott 31 and therefore this is reasonably widely accepted as a major morbidity after paediatric cardiac surgery by all stakeholder groups.Reference Jacobs, Benavidez, Bacha, Walters and Jacobs 1 Moreover, considering the example of renal failure, given the complex inter-relationship between the patient’s preoperative condition, which may incorporate renal dysfunctionReference Zuluaga 32 , their age, especially very young neonates as is commonReference Brown, Ridout, Hoskote, Verhulst, Ricci and Bull 27 , their body mass index, which may be low in CHD, their postoperative condition, and measures of renal function, a definition involving a specified measure of renal function was considered to be impractical to define for routine use. Of note, it proved infeasible for the panel to agree a clear and usable definition of low cardiac output syndrome for use in routine audit.
Future steps
The definitions presented in Table 1 incorporate feedback from five United Kingdom paediatric cardiac surgical centres that have been using them prospectively for 5 months with paediatric cardiac surgery patients; however, we acknowledge that as yet the long-term practicalities involved in monitoring these morbidities are unclear. The next stage is to report on the morbidities for the purposes of quality assurance and to assess their impact on patients and families with formal prospective analysis. We note that analytical and graphical methods for the timely reporting of risk-adjusted mortality outcomes for the purposes of quality improvement are well established in adult cardiac surgery practiceReference Sherlaw-Johnson, Gallivan, Treasure and Nashef 33 and have been developed by members of our research group for paediatric cardiac surgery;Reference Tsang, Brown and Synnergren 34 two single-centre studies have attempted to generate an aggregate “Morbidity Index” by assigning subjective weights to postoperative complications,Reference Bojan, Gerelli, Gioanni, Pouard and Vouhe 35 , Reference Stoica, Carpenter and Campbell 36 and the Society for Thoracic Surgeon group have attempted a similar “Morbidity Score”.Reference Jacobs, O’Brien and Jacobs 18 Condensing diverse morbidities into a single score loses information, and recent work on using graphical methods to routinely monitor a range of morbidities highlighted the complexity of graphically summarising multiple morbiditiesReference Belliveau, Burton, O’Blenes, Warren and Hancock Friesen 19 (see also commentary by Utley et alReference Utley, Brown and Tsang 37 ). We intend to report on the incidence and impact of the defined morbidities over the next few months: the findings of these studies will inform future data collection for national audit in the United Kingdom.
Acknowledgements
The authors acknowledge the work done by the research teams based in the paediatric cardiac surgery and ICUs at Great Ormond Street Hospital, Evelina London, Birmingham Children’s Hospital, Bristol Children’s Hospital, and The Royal Hospital for Children in Glasgow who have implemented these definitions and provided valuable feedback. The Definition Panel comprised the following individuals with specialist skills as listed: R.B., Evelina Children’s Hospital, paediatric intensive care nurse and data expert. Dr K.B., Great Ormond Street Hospital, paediatric cardiologist and family liaison officer. Dr P.D., Bristol Royal Hospital for Children, paediatric intensive care consultant. Dr R.F., Royal Brompton Hospital, paediatric cardiologist. Dr A.H., Great Ormond Street Hospital, paediatric intensive care consultant. Ms N.K., Birmingham Children’s Hospital, paediatric cardiac surgeon. Mr A.M., Royal Hospital for Children, Glasgow, paediatric cardiac surgeon and Chair. Dr W.R., Royal Hospital for Children, Glasgow, paediatric intensive care consultant. L.S., Great Ormond Street Hospital, intensive care nurse. Dr S.T., University Hospital Birmingham, cardiologist.
Financial Support
This project was funded by the National Institute for Health Research Health Services and Delivery Research Programme (Project No. 12/5005/06). K.B., L.S., A.H., J.W., L.C., and V.T. were supported by the National Institute for Health Research Biomedical Research Centre at Great Ormond Street Hospital for Children NHS Foundation Trust and University College London.
Conflicts of Interest
Dr K.B., Dr R.F. and Mr A.M. serve on the steering committee of the National Congenital Heart Diseases Audit (NCHDA).
Ethical Standards
The paediatric cardiac surgery morbidity study was granted ethical approval by London City Road Research Ethics Committee (REC) on 8th November 2013 and the REC number is 14-LO-1442.