Article Text

Download PDFPDF

The CHALICE rule: ready for prime time?
  1. R Forsyth
  1. Correspondence to:
    R Forsyth
    Department of Child Health, The Royal Victoria Infirmary, Queen Victoria Road, Newcastle upon Tyne, NE1 4LP, UK; r.j.forsyth{at}newcastle.ac.uk

Statistics from Altmetric.com

Perspective on the paper by Dunning et al (see page 885)

The paper by Dunning et al1 in this issue discusses a classic medical screening problem. Particularly during the long, light summer evenings, every accident and emergency department in the country sees large numbers of children who have sustained traumatic head injuries, most of which seem trivial; but among such children, there are a small number who are at avoidable risk of severe disability or death. How can they be identified most effectively? In the reported series of around 20 000 children, 95% had not even a brief loss of consciousness and 97% had a Glasgow Coma Scale of 15, but at the tip of the severity pyramid were 281 (1.2%) children with abnormal computed tomograms, 137 (0.6%) of whom required a neurosurgical procedure, and 15 deaths (although the paper does comment on how many of these deaths were deemed potentially preventable).

The authors point out the weakness of the evidence base (and thus the current National Institute of Clinical Evidence guidelines) in this area, particularly in relation to children, and are to be commended for the largest prospective paediatric study of this problem to date. Their paper derives a clinical decision rule that identifies high-risk children warranting computed tomography, and they have deliberately prioritised sensitivity over specificity.

The traditional approach to this problem (which might be described as “observation-first”) relied on a combination of skull x rays (SXR) and admission for clinical observation, with computed tomography reserved for high-risk patients. The deficiencies of this approach have been recognised for some time. The sensitivity of SXR for major intracranial abnormality is inadequate, and National Institute of Clinical Evidence and other recent guidelines have convincingly argued that for all clinical management purposes, computed tomography should be used, with SXR having a role only in the forensic evaluation of suspected non-accidental head injury. The Children’s Head injury Algorithm for the prediction of Important Clinical Events (CHALICE) data support this view.

Another deficiency of the traditional approach has been less emphasised but is equally important, and is again well illustrated by the CHALICE data, which largely reflects traditional observation-first practice. More children were admitted for observation than were scanned. However, only 27 of 1461 (1.8%) children admitted to the ward for observation without a prior scan deteriorated (24 requiring neurosurgery). Clinical skills of neurological assessment and observation are hard earned. With shortened clinical training, fewer adverse events are seen, and it is the experience of most junior doctors that these children “do OK”, leading to complacency. “Watch and wait” becomes “wait”.

At the heart of the data in this paper are the 10 children who were sent home from the accident and emergency department without a scan and the two other children who were actually admitted and sent home without a scan, who later returned with positive scans. Of these 12 patients, seven required neurosurgery. Two of these children returned to a hospital other than where they were first seen, again reinforcing the complacency of those who originally sent them home.

The advocates of the “computed tomography first” strategy have two arguments. Clinical features are just too non-specific to form the basis of robust triage rules: most children, even those who are symptomatic, will do well. Secondly, the admission only of children with known computed tomography abnormalities for careful neurological observation focuses minds and can be centralised to units with the appropriate expertise.

The counter-argument is predominantly one of unintended consequences. The CHALICE rule has intentionally been developed as a high-sensitivity rule at the expense of specificity. The main value of the CHALICE rule is its negative predictive value. In the absence of any of the CHALICE features, a child can be discharged without examination. Although most clinicians presume this many times a day already, we now know we can be 99.9% confident that such a child will come to no harm (owing to the design of the study, we cannot assume that rule-negative children had normal computed tomograms, just that they do not return to medical attention). The rule, however, failed in four (arguably three) cases, two of which were due to human error, where important signs were missed.

But what should we do with a child meeting one or more CHALICE criteria? Application of the rule would result in a 14% predicted computed tomography rate (versus an observed admission rate of 6.4% and a computed tomography rate of 3.3% in this study), of which approximately 92% are expected to be normal. Again, the main value is in a negative computed tomography scan, enabling large numbers of these children to be discharged home with confidence. The number of children showing unexpected computed tomography abnormalities will be low. The study population did not exclude obviously moderately and severely injured children: this increases the prevalence of abnormal computed tomograms and inflates the positive predictive value of the rule. Any positive screening test is of most use where least needed, performing best in populations with a high prior probability of pathology. The number of (normal) scans needed to identify each unexpectedly abnormal scan will be greatest precisely in the population that clinicians currently hesitate over. Although the paper offers some data on the performance of the rule in less severely injured children (Glasgow Coma Scale 13–15, where its positive predictive value is, as expected, lower), a more exacting analysis is required of its positive predictive value in truly borderline cases (eg, the children who vomited a few times but never lost consciousness and are now fine).

Any paediatrician who has seen the devastating, avoidable disability (and lifelong care costs) that can arise after delayed recognition of an expanding extradural haemorrhage will be sympathetic to the argument that the economic costs of increased computed tomography rates are justified (and are also countered by reduced bed occupancy). But such cases are rare. The cost–benefit and risk–benefit analyses will need to be more sophisticated to include, for example, the borderline child who vomited three times and presents late at night to a smaller unit that does not currently have a paediatric out-of-hours computed tomography capacity. Should such a child be transferred to a larger centre in the middle of the night? How likely is it, even if an abnormality is shown on computed tomography, that clinical management will be altered if the child is well? Would a combined clinical–radiological rule (eg, admitting the child and taking a scan in the morning if symptoms have persisted for a threshold period after injury) improve the positive predictive value sufficiently to overcome economic and radiation-exposure concerns?

The authors correctly state that their study has established a rule that now needs prospective validation in further studies. Previous studies of the implementation of the Royal College of Surgeons head injury guidelines found that they were not being fully followed: recommended numbers of SXRs, computed tomograms and admissions were not occurring because clinicians believed them to be inappropriately aggressive. A robust validation of CHALICE discussing these more complex cost– and risk–benefit analyses will be required to reassure clinicians and ensure that history does not repeat itself.

Note in Proof

Perspective on the paper by Dunning et al (see page 885)

REFERENCE

Footnotes

  • Competing interests: None declared.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles