development and validation of a cellulitis risk score: the

9
ARTICLE Development and Validation of a Cellulitis Risk Score: The Melbourne ASSET Score Laila F. Ibrahim, MB, BCh, BAO, a,b Sandy M. Hopper, FRACP, FACEM, a,b,c Susan Donath, MA, b Bennett Salvin, MD, a Franz E. Babl, MD, a,b,c Penelope A. Bryant, PhD a,b,d,e BACKGROUND: The evidence is unclear about the optimal route of treatment for children with cellulitis, specifically how to assess the risk of moderate-to-severe cellulitis requiring intravenous (IV) antibiotics. We aimed to derive and validate a cellulitis risk assessment scoring system to guide providers as to which patients require IV antibiotics. METHODS: This was a prospective cohort study of children presenting to the emergency department aged 6 months to 18 years diagnosed with cellulitis from January 2014 to August 2017. Patients were divided into 2 groups based on route of antibiotics at 24 hours (the predetermined gold standard). Demographics and clinical features were compared. Clinicians were surveyed about which features they used to decide whether to start IV antibiotics. Combinations of differentiating features were plotted on receiver operating characteristic curves. RESULTS: There were 285 children in the derivation cohort used to create the Melbourne Area, Systemic features, Swelling, Eye, Tenderness (ASSET) Score, which has a maximum score of 7. The area under the curve was 0.86 (95% confidence interval 0.830.91). Using a cutoff score of 4 to start IV antibiotics yielded the highest correct classification of 80% of patients (sensitivity 60%; specificity 93%). This score was validated in 251 children and maintained a robust area under the curve of 0.83 (95% confidence interval 0.780.89). CONCLUSIONS: The Melbourne ASSET Score was derived and validated for cellulitis in children to guide clinicians regarding when to start IV antibiotics. Although intended for widespread use, if limitations exist in other settings, it is designed to allow for refinement and is amenable to local impact analysis. abstract a Department of Paediatrics, University of Melbourne, Parkville, Australia; and b Murdoch Childrens Research Institute, c Emergency Department, d Infectious Diseases Unit, Department of General Medicine, and e Hospital-In- The-Home Department, The Royal Childrens Hospital, Parkville, Australia Dr Ibrahim conceptualized, designed, and coordinated the study, conducted the initial and subsequent data analyses, drafted the initial manuscript, and revised subsequent drafts; Drs Bryant, Babl, and Hopper were involved in the design of the study, provided input into data analysis, and reviewed and revised the manuscript; Ms Donath was involved in the design of the study, advised on statistical analysis, and revised the final manuscript; Dr Salvin was involved in the design of the study, coordinated parts of the study, and revised the final manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work. DOI: https://doi.org/10.1542/peds.2018-1420 Accepted for publication Oct 29, 2018 PEDIATRICS Volume 143, number 2, February 2019:e20181420 WHAT’S KNOWN ON THIS SUBJECT: Cellulitis is a common childhood skin infection. However, there is no clear evidence to guide clinicians treating this condition regarding which patients need intravenous antibiotics. This poses risks for both undertreatment and overtreatment, resulting in unnecessary hospitalization. WHAT THIS STUDY ADDS: The Melbourne ASSET Score is proposed to aid in decision-making regarding the route of antibiotics for treating cellulitis. This score involves 5 easily assessed clinical features (area, systemic features, swelling, eye involvement, and tenderness) and is adaptable to different clinical environments. To cite: Ibrahim LF, Hopper SM, Donath S, et al. Develop- ment and Validation of a Cellulitis Risk Score: The Melbourne ASSET Score. Pediatrics. 2019;143(2):e20181420 Downloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Upload: others

Post on 03-Jan-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development and Validation of a Cellulitis Risk Score: The

ARTICLE

Development and Validation of a Cellulitis Risk Score: The Melbourne ASSET ScoreLaila F. Ibrahim, MB, BCh, BAO, a, b Sandy M. Hopper, FRACP, FACEM, a, b, c Susan Donath, MA, b Bennett Salvin, MD, a Franz E. Babl, MD, a, b, c Penelope A. Bryant, PhDa, b, d, e

BACKGROUND: The evidence is unclear about the optimal route of treatment for children with cellulitis, specifically how to assess the risk of moderate-to-severe cellulitis requiring intravenous (IV) antibiotics. We aimed to derive and validate a cellulitis risk assessment scoring system to guide providers as to which patients require IV antibiotics.METHODS: This was a prospective cohort study of children presenting to the emergency department aged 6 months to 18 years diagnosed with cellulitis from January 2014 to August 2017. Patients were divided into 2 groups based on route of antibiotics at 24 hours (the predetermined gold standard). Demographics and clinical features were compared. Clinicians were surveyed about which features they used to decide whether to start IV antibiotics. Combinations of differentiating features were plotted on receiver operating characteristic curves.RESULTS: There were 285 children in the derivation cohort used to create the Melbourne Area, Systemic features, Swelling, Eye, Tenderness (ASSET) Score, which has a maximum score of 7. The area under the curve was 0.86 (95% confidence interval 0.83–0.91). Using a cutoff score of 4 to start IV antibiotics yielded the highest correct classification of 80% of patients (sensitivity 60%; specificity 93%). This score was validated in 251 children and maintained a robust area under the curve of 0.83 (95% confidence interval 0.78–0.89).CONCLUSIONS: The Melbourne ASSET Score was derived and validated for cellulitis in children to guide clinicians regarding when to start IV antibiotics. Although intended for widespread use, if limitations exist in other settings, it is designed to allow for refinement and is amenable to local impact analysis.

abstract

aDepartment of Paediatrics, University of Melbourne, Parkville, Australia; and bMurdoch Children’s Research Institute, cEmergency Department, dInfectious Diseases Unit, Department of General Medicine, and eHospital-In-The-Home Department, The Royal Children’s Hospital, Parkville, Australia

Dr Ibrahim conceptualized, designed, and coordinated the study, conducted the initial and subsequent data analyses, drafted the initial manuscript, and revised subsequent drafts; Drs Bryant, Babl, and Hopper were involved in the design of the study, provided input into data analysis, and reviewed and revised the manuscript; Ms Donath was involved in the design of the study, advised on statistical analysis, and revised the final manuscript; Dr Salvin was involved in the design of the study, coordinated parts of the study, and revised the final manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

DOI: https:// doi. org/ 10. 1542/ peds. 2018- 1420

Accepted for publication Oct 29, 2018

PEDIATRICS Volume 143, number 2, February 2019:e20181420

WHAT’S KNOWN ON THIS SUBJECT: Cellulitis is a common childhood skin infection. However, there is no clear evidence to guide clinicians treating this condition regarding which patients need intravenous antibiotics. This poses risks for both undertreatment and overtreatment, resulting in unnecessary hospitalization.

WHAT THIS STUDY ADDS: The Melbourne ASSET Score is proposed to aid in decision-making regarding the route of antibiotics for treating cellulitis. This score involves 5 easily assessed clinical features (area, systemic features, swelling, eye involvement, and tenderness) and is adaptable to different clinical environments.

To cite: Ibrahim LF, Hopper SM, Donath S, et al. Develop-ment and Validation of a Cellulitis Risk Score: The Melbourne ASSET Score. Pediatrics. 2019;143(2):e20181420

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 2: Development and Validation of a Cellulitis Risk Score: The

Cellulitis is a superficial skin and soft tissue infection that is a common cause of presentation to emergency departments (EDs) and primary care physicians.1 – 4 Although many children with cellulitis are successfully treated with oral antibiotics, up to 60% are treated with intravenous (IV) antibiotics.5 – 8 In the United States alone, skin and soft tissue infections account for >74 000 pediatric hospital admissions per year.9 However, despite the fact that cellulitis is common, the evidence is unclear about the optimal route of treatment for children with cellulitis, specifically how to assess the risk of moderate-to-severe cellulitis requiring IV antibiotics. Since the early 1980s, clinicians have tried to stratify the severity of cellulitis in children, but to date, there are no existing evidence-based guidelines.10 This is likely due to an absence of objective, universally agreed on criteria or a gold standard for the assessment of cellulitis that requires IV antibiotics.

The authors of the Infectious Diseases Society of America guidelines for the diagnosis and management of skin and soft tissue infections recommend IV antibiotics for cellulitis with systemic signs of infection.1 However, many children with systemic signs (such as pyrexia, which commonly accompanies cellulitis) can be safely and effectively treated with oral antibiotics.8, 11, 12 These guidelines were intended for a broad population, including adults; therefore, recommendations are not necessarily applicable to children. Attempts to establish guidelines for treating cellulitis affecting the eye serve to differentiate periorbital from orbital cellulitis (to avoid the risk of missing orbital cellulitis) rather than help the primary care or emergency clinician decide between oral or IV treatment for uncomplicated periorbital cellulitis.12 – 15 The local institutional

guideline recommends treatment with oral flucloxacillin or cephalexin unless a case is severe and/or extensive, a patient is systemically unwell, or a patient is not responding to oral treatment, in which case IV flucloxacillin is recommended. These clinical scenarios for when to use the IV route are open to different interpretations and therefore practices.

The absence of standardized practice means that some children are unnecessarily admitted to the hospital and administered IV antibiotics, putting them at risk for hospital-acquired infections, iatrogenic adverse events, and negative psychosocial impacts.16, 17 Several clinical scoring systems have been established for common childhood illnesses, for example, the Westley Croup Score, 18 the Pediatric Respiratory Assessment Measure for asthma, 19 and the Pediatric Appendicitis Score for acute appendicitis.20, 21 Such clinical scores are not intended to be used in isolation to stratify patients, 22, 23 but having a practical guideline for a common condition, such as cellulitis, can improve patient flow and be an important tool in clinical research.24 For a clinical score to be useful in the acute decision-making process, it needs to (1) have as few features as possible while remaining accurate and (2) be unambiguous and easily assessable by junior clinical staff.25

In this study, we had 2 aims: (1) to derive a pediatric cellulitis risk assessment scoring system for use by clinicians in EDs or primary care to guide the decision to start IV antibiotics and (2) to validate this scoring system on a separate cohort of children.

METHODS

Study Design and Population

This was a prospective cohort study in a convenience sample of children

presenting with cellulitis to the ED at the Royal Children’s Hospital in Melbourne. Recruitment occurred over a 15-month period from January 2014 to May 2015. Children aged 6 months to 18 years were eligible if an ED clinician made a diagnosis of cellulitis. The decision to treat with oral or IV antibiotics was made by an experienced ED physician (at least at the registrar and/or fellow level). Per routine institutional practice, patients who were treated with oral antibiotics were discharged from the ED, whereas those who were started on IV antibiotics were admitted to the hospital. Exclusion criteria were children with complicated cellulitis or associated toxicity. Complicated cellulitis was defined as cellulitis associated with the following conditions: orbital cellulitis, undrained abscess, penetrating injury, immunosuppression, fasciitis or foreign body, or cellulitis caused by large animal or human bite. Toxicity was defined as those with signs or symptoms of hypotension, resting tachycardia, or poor central perfusion.

Procedures

We correlated clinical features and outcomes to derive a cellulitis scoring system and, when appropriate, take into account clinicians’ opinions and practice on the basis of a survey. This study was approved by the institutional human research ethics committee (HREC34018).

Data Collection of Clinical Features

Data collection occurred in real time as patients were being assessed in the ED after written consent was obtained. This included demographics, whether previous oral antibiotics were taken before presenting to the ED, and clinical features at presentation. Clinical features were collected from ED clinicians on a standardized proforma and consisted of the size of the area affected (longest diameters

IBRAHIM et al2

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 3: Development and Validation of a Cellulitis Risk Score: The

in length and width measured in centimeters), the absence or presence (0 or 1, respectively) of functional impairment, lymphangitis and/or tracking, systemic features, and periorbital cellulitis. Additionally, clinicians were asked to rate 3 features of cellulitis on a 3-point scale (absent = 0, mild = 1, and moderate to severe = 2) for the following features: erythema, tenderness, and swelling. Patients were recorded as either starting IV or oral antibiotics; the duration administered was also recorded.

The Gold Standard for Treatment

To devise and validate the clinical scoring system, there needs to be a standard against which the decision to prescribe IV or oral antibiotics is judged. Because a gold standard for the appropriateness of this decision does not exist, a consensus was reached among the study investigators at our institution who had the relevant expertise and represented pediatric infectious diseases, general pediatrics, pediatric emergency medicine, and biostatistics. We determined that the route of ongoing antibiotic treatment after review at 24 hours was likely to be the correct one on the basis of ongoing symptom progression even if the patients had been started via the other route at presentation. Patients were therefore divided into 2 groups based on their ongoing route of antibiotic administration at 24 hours and having needed that route from the start regardless of their initial management route: IV or oral at 24 hours.

Patient Follow-up

We conducted follow-up with patients within 48 hours to ascertain their route of ongoing antibiotic treatment (either oral or IV at 24 hours) by checking the hospital attendance record electronically. In addition, within 14 days after the initial ED presentation, we contacted

all patients by telephone to follow-up and ascertain their outcomes.

Survey of Clinicians

This survey was performed at The Royal Children’s Hospital in Melbourne over a period of 4 weeks in December 2014. Participants (selected on the basis of exposure to cellulitis cases in their practices) were acute-care pediatricians from the following departments: ED, general medicine, infectious diseases, and adolescent and developmental medicine. Excluded participants were pediatric clinicians in subspecialties in which cellulitis cases would not be managed and clinicians with a predominantly academic role. Participants were contacted via their respective hospital-based e-mail address, whereby every participant was given a link to the Web-based survey via Research Electronic Data Capture (hosted at the Murdoch Children’s Research Institute).26

Statistical Analysis

All data were entered into a Research Electronic Data Capture database. A univariate analysis was performed in which we compared the demographic and clinical features of the 2 groups: IV versus oral antibiotics at 24 hours. A χ2 test was used for categorical variables, and a t test was used for continuous data. By using features that were significantly different, receiver operating characteristic (ROC) curves were then calculated for various combinations of the different cellulitis features. The size affected, measured in centimeters for length and width, was converted to a percentage of the body surface area affected on the basis of each child’s height. Proportions of survey responses were calculated. All statistical analysis was performed by using Stata/IC version 15.0 (Stata Corp, College Station, TX). A sample size calculation was not performed at the outset because of the exploratory nature of this study. We aimed to

recruit at least 100 patients in each group for each part of the study.

RESULTS

Clinical Features and Outcomes of the Derivation Cohort

There were 285 children in the derivation cohort. Of these, 171 (60%) received oral antibiotics, and 114 (40%) received IV antibiotics at initial presentation. Of those who were started on oral antibiotics, 10 (6%) re-presented within 24 hours and were deemed to require IV antibiotics. Of those who were started on IV antibiotics, 14 (8%) were switched to oral antibiotics within 24 hours. Therefore, 175 of the 285 (61%) were receiving oral antibiotics at 24 hours, and 110 of the 285 (39%) were receiving IV antibiotics at 24 hours. Clinical features at presentation were compared between the 2 groups (Table 1). Only age and sex did not differ between the IV and oral groups at 24 hours. There were 9 features that differed significantly between the groups. These were converted either to a binary score of 0 or 1 (absent or present, respectively; previous oral antibiotics, systemic features, area affected ≥1% of body surface area, functional impairment, lymphangitis, and periorbital cellulitis) or a score on a 3-point scale (0 = absent, 1 = mild, or 2 = moderate to severe; erythema, swelling, and tenderness).

Survey Responses

There were 106 of 138 (77%) clinicians who returned the cellulitis questionnaire. Of these, 61% were consultants or fellows, whereas 39% were trainee doctors. For the purpose of deriving a clinical score, we considered only responses from senior clinicians with consultant or fellow experience. The features clinicians usually used when deciding the route of antibiotic administration were lymphangitis and/or tracking

PEDIATRICS Volume 143, number 2, February 2019 3

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 4: Development and Validation of a Cellulitis Risk Score: The

(86%), functional impairment (76%), systemic features (78%), whether the patient had received previous oral antibiotics (70%), the size of the affected area (63%), whether the site affected was periorbital (52%), swelling (52%), and tenderness (48%). Features that were not commonly used by clinicians were erythema (25%) and family preference (2%).

Derivation of the Clinical Score

Various combinations and weighting of the 9 features that differed between the 2 groups were used to plot ROC curves and calculate the area under the curve (AUC), sensitivity, and specificity for each combination. The AUC for all 9 features was 0.89 (95% confidence interval [CI] 0.85–0.93), which is reassuringly high (Fig 1). However, having 9 features to score is impractical and inconvenient for clinicians. We therefore iteratively reduced the features by 1 to determine the minimum number of features required to maintain a high AUC. We found that the AUC remained high until the combination was reduced to <5 features (Fig 1). With only 4 features, the lower limit of the 95% CI of the AUC dropped to 0.77, so the minimum number of features for this clinical score was determined to be 5. We tested multiple combinations of 5 features because each significantly differed between the groups, and the AUC results (and therefore sensitivities and specificities) were similar (data not shown). Because there was no mathematical difference, the next stage was to use clinical reasons to determine the 5 most useful features. The 4 features that were removed were erythema, lymphangitis, functional impairment, and previous oral antibiotics. Erythema is difficult to assess in darker skin, therefore limiting the wide applicability of the score, and was only used by 25% of senior clinicians. Lymphangitis is

an uncommon sign at presentation and is specific to limb cellulitis.8 Additionally, although 86% of survey respondents said they would use this feature when considering IV antibiotics, 12 of 29 (41%) patients who had lymphangitis were on oral antibiotics at 24 hours. Functional impairment of the limb occurs because of significant swelling or tenderness, which are both already represented in the score; in addition, this feature is specific to limb cellulitis. Previous oral antibiotic administration was documented, but in 54 of 116 (47%) patients, the type

of antibiotic, dose, frequency, and duration were unknown, and parent recall of dosage is not necessarily reliable.28 The validity of this as a marker of needing IV treatment was therefore uncertain, potentially relating more to the perceived need by physicians to change something at presentation to ED. The 5 remaining features were used to address specific factors relating to the potential need for IV antibiotics: risk of sepsis (systemic features), severity and/or extent of infection (size, swelling, and tenderness), and risk of orbital cellulitis (eye involvement).

IBRAHIM et al4

TABLE 1 Comparison of the Derivation Cohort by Route of Antibiotics After 24 Hours

Clinical Feature at Presentation Oral at 24 h (n = 175)

IV at 24 h (n = 110)

P OR (95% CI)

Age, mean 6.4 ± 4.5 6.6 ± 4.7 .80 —Female sex, n (%) 47 (43) 74 (42) .94 1.0 (0.6–1.6)Previous oral antibiotic, n (%) 55 (31) 61 (55) .0001 2.7 (1.7–4.4)Systemic features, n (%) 35 (20) 36 (33) .02 1.9 (1.1–3.3)Area >1% of BSA, a n (%) 23 (13) 37 (34) <.0001 3.3 (1.8–6.0)Functional impairment, n (%) 28 (16) 35 (32) .002 2.5 (2.5–4.3)Moderate-to-severe erythema, n (%) 11 (7) 60 (57) <.0001 16.3 (8.2–32.4)Moderate-to-severe swelling, n (%) 14 (8) 60 (55) <.0001 13.8 (7.2–26.6)Moderate-to-severe tenderness, n (%) 8 (5) 50 (45) <.0001 17.4 (7.9–38.1)Lymphangitis or tracking, n (%) 12 (7) 17 (15) .02 2.5 (1.2–5.3)Periorbital, n (%) 13 (7) 24 (22) .0004 3.5 (1.7–7.1)

BSA, body surface area; OR, odds ratio; —, not applicable.a A child’s palmar surface and adducted fingers is equivalent to 1% of their BSA.27

FIGURE 1ROC curve with different numbers of features for the derivation cohort (n combination of features; AUC [95% CI]).

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 5: Development and Validation of a Cellulitis Risk Score: The

The Melbourne Area, Systemic features, Swelling, Eye, Tenderness Score

The optimal score therefore consisted of the following features: size of the affected area, systemic features, severity of swelling, periorbital and/or eye involvement, and severity of tenderness, which can be recalled with the acronym ASSET. The Melbourne ASSET Score has a maximum possible score of 7. The AUC was 0.86 (95% CI 0.83–0.91; Fig 2). Using a cutoff score of 4 (patients with a score of ≥4 receive IV antibiotics and those with a score <4 receive oral antibiotics) yields the highest proportion of patients who are correctly classified at 80% (sensitivity 60%; specificity 93%; Supplemental Table 2, Fig 3). If the cutoff score were reduced to a more conservative 3, the sensitivity would increase to 85%, but the specificity would decrease to 76%. By using a frequency distribution graph (Fig 4), a score of 4 would result in 11 (10%) patients receiving unnecessary IV treatment, and 44 (25%) patients on oral antibiotics may represent needing IV antibiotics. Lowering the cutoff to 3 would result in 44 (40%) patients receiving unnecessary IV treatment and 17 (10%) representing needing IV antibiotics.

Validation of the Melbourne ASSET Score

A subsequent cohort of patients presenting to the ED with cellulitis with the same inclusion and exclusion criteria was used to validate the score. Data collection methods and outcome rules were the same as for the derivation cohort. There were 251 children in the validation cohort. When using the same gold standard to define the appropriate route of antibiotic administration, 107 of the 251 (43%) children were receiving oral antibiotics at 24 hours, and 144 of the 251 (57%) children were receiving IV antibiotics at 24 hours.

When the Melbourne ASSET Score was retrospectively applied to the validation cohort, the AUC remained high at 0.83 (95% CI 0.78–0.89; Fig 2). A cutoff score of 4 as the threshold to start IV antibiotics has a sensitivity of 85% and a specificity of 63%, with which 76% of patients were correctly classified. A cutoff of 3 has a sensitivity of 98% and a specificity

of 32%, with which 70% of patients were correctly classified.

DISCUSSION

The results of this study reveal that children who were started on IV treatment have more severe features of cellulitis than those who were started on oral antibiotics, which is

PEDIATRICS Volume 143, number 2, February 2019 5

FIGURE 2Comparison of ROC curves for the Melbourne ASSET Score for the derivation and validation cohorts.

FIGURE 3Sensitivity and specificity at each threshold of the Melbourne ASSET Score for the derivation cohort.

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 6: Development and Validation of a Cellulitis Risk Score: The

consistent with previous literature.8 Using these features, we were able to derive a score and accurately classify 80% of patients. Importantly for pragmatic use, it is simple to use and widely applicable. Crucially, when the Melbourne ASSET Score was applied to a subsequent unrelated cohort of children, it still could be used to correctly classify a high proportion of patients. Interestingly, this was despite the sensitivity and specificity of the score cutoff of 4 being different between the 2 cohorts. This is useful

information because the trade-off between sensitivity and specificity will be different in different populations and settings.

The score comprises clinical features that clinicians routinely assess for and document in cellulitis without needing any investigations or other measures. This is the first study of cellulitis in which the authors recommend assessing the area involved as >1% or <1% by using the size of the patient’s own hand, 27

and we support this with our data. The site affected was measured by using a tape measure during the study, which is an onerous and time-consuming task for busy physicians, with traditional conversion to percentage of total body surface area also requiring a child’s height and weight and a calculator. Using this novel hand-size method to assess the contribution of the area of cellulitis to the score is simple and convenient. A minimum of 5 features maintained a high AUC, sensitivity, and specificity and is also correlated with the number of fingers on 1 hand, making it easy for clinicians to check off the number of features (Fig 5). All of these features ensure that a child with cellulitis can be examined rapidly in the ED or primary care office with a score that is easy to calculate; both are imperative for it to be useful.29

The 5 features of the Melbourne ASSET Score are each important in the consideration of risk of more severe infection. First, the size of the area involved reflects the burden of infection. Second, the presence of systemic features (fever and lethargy) potentially reflects sepsis. It is 1 of the reasons that the authors of the Infectious Diseases Society of America guidelines for adults recommend that systemic features are used to guide the need for IV antibiotics. Third, swelling reflects the severity of inflammation and can also represent induration in the early formation of abscess. Fourth, the eye is a vulnerable location, and it is not always straightforward to differentiate orbital infection, which has more severe morbidity. Fifth, tenderness also reflects the severity of inflammation, and as a bonus, it can be used to differentiate cellulitis from other inflammatory conditions, such as allergic reactions, which are typically nontender. Several features considered to be important in some contexts were excluded from the score as detailed, and not necessarily

IBRAHIM et al6

FIGURE 4Frequency of patients on IV and oral antibiotics, characterized by the Melbourne ASSET Score for the derivation cohort.

FIGURE 5The Melbourne ASSET Score with a child’s adducted hand measuring 1% of body surface area.

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 7: Development and Validation of a Cellulitis Risk Score: The

because they have no value in individual patients. In addition to those mentioned above, the age of the child is an important consideration in any pediatric condition. However, whether analyzed on a continuum or stratified by different age categories, age was not different between the groups.

A hurdle for us in this study, like for many others attempting to devise a clinical score, is the absence of a gold standard for cellulitis against which to assess the true requirement for IV antibiotics. The rationale behind using the status at 24 hours is that if a change in route has already been made within 24 hours, the features at presentation could likely be used to predict this. It is possible that clinicians who treat children with IV antibiotics may unnecessarily treat beyond 24 hours simply because there is IV access in situ. This would result in a slightly more conservative gold standard than true need, which is similar to other scoring systems.18 If found to be too conservative when validated in a different setting, the score cutoff can be refined.30, 31 Similarly, if using this score in settings in which patients live farther from the hospital,

minimizing ED reattendance may be more important, so the cutoff could be lowered.

Our study has some limitations. Firstly, it was conducted in a tertiary pediatric hospital with experienced pediatric ED clinicians, and a more conservative approach may be required in a different setting. However, we have been able to use the expertise of these clinicians in the absence of a gold standard to derive and validate a clinical score for cellulitis in children for the first time. If a more conservative approach is desired, the cutoff threshold for IV treatment can be lowered. Second, our region has a low prevalence of methicillin-resistant Staphylococcus aureus, which is similar to many other pediatric populations. However, although we would recommend external validation of the score in high-prevalence areas, there is no reason to suspect that this score would not be applicable because it is the defining route, not choice, of antibiotic. Lastly, with this clinical score, we do not aim to replace clinical assessment for each individual patient but to aid in decision-making.22

CONCLUSIONS

The Melbourne ASSET Score is the first risk assessment scoring system for pediatric cellulitis that is proposed to aid clinicians in deciding whether to treat with IV or oral antibiotics. It is simple, easy to use, applicable, and reliable. Although intended for widespread use, if limitations exist in other settings, it is designed to allow for refinement and is amenable to local impact analysis. We propose an impact analysis of this score, ideally in a different setting and population.

ACKNOWLEDGMENTS

We acknowledge the participation of the patients and families.

ABBREVIATIONS

ASSET:  Area, Systemic features, Swelling, Eye, Tenderness

AUC:  area under the curveCI:  confidence intervalED:  emergency departmentIV:  intravenousROC:  receiver operating

characteristic

PEDIATRICS Volume 143, number 2, February 2019 7

Address correspondence to Franz E. Babl, MD, Emergency Department, Murdoch Children’s Research Institute, The Royal Children’s Hospital, Flemington Rd, Parkville, VIC 3052, Australia. E-mail: [email protected]

PEDIATRICS (ISSN Numbers: Print, 0031-4005; Online, 1098-4275).

Copyright © 2019 by the American Academy of Pediatrics

All authors hereby declare there has been no support from any organization for the submitted work. There have been no financial relationships with any organizations that might have an interest in the submitted work in the previous 3 years. There are no other relationships or activities that could appear to have influenced the submitted work.

FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

FUNDING: Funded in part by grants from The Royal Children’s Hospital Foundation, the Murdoch Children’s Research Institute, and the Victorian Department of Health and Human Services in Melbourne, Australia. Ms Ibrahim was supported in part by a scholarship from Avant Mutual Group Ltd (Melbourne), the Melbourne Children’s Campus Postgraduate Health Research Scholarship, and the Doctor Nicholas Collins Fellowship. Dr Bryant was supported in part by a Melbourne Campus Clinician Scientist Fellowship (Melbourne, Australia). Dr Babl was supported in part by a grant from The Royal Children’s Hospital Foundation, a Melbourne Campus Clinician Scientist Fellowship (Melbourne, Australia), and a National Health and Medical Research Council Practitioner’s Fellowship (Canberra, Australia). The Emergency Research Group at Murdoch Children’s Research Institute is supported in part by a National Health and Medical Research Council Centre for Research Excellence grant for pediatric emergency medicine (Canberra, Australia) and the Victorian government’s Operational Infrastructure Support Program. The funding bodies do not have any authority in design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.

POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 8: Development and Validation of a Cellulitis Risk Score: The

REFERENCES

1. Stevens DL, Bisno AL, Chambers HF, et al; Infectious Diseases Society of America. Practice guidelines for the diagnosis and management of skin and soft tissue infections: 2014 update by the Infectious Diseases Society of America [published correction appears in Clin Infect Dis. 2014;59:147–159]. Clin Infect Dis. 2014;59(2):e10–e52

2. Pallin DJ, Egan DJ, Pelletier AJ, Espinola JA, Hooper DC, Camargo CA Jr. Increased US emergency department visits for skin and soft tissue infections, and changes in antibiotic choices, during the emergence of community-associated methicillin-resistant Staphylococcus aureus. Ann Emerg Med. 2008;51(3):291–298

3. Pallin DJ, Espinola JA, Leung DY, Hooper DC, Camargo CA Jr. Epidemiology of dermatitis and skin infections in United States physicians’ offices, 1993-2005. Clin Infect Dis. 2009;49(6):901–907

4. Schuler CL, Courter JD, Conneely SE, et al. Decreasing duration of antibiotic prescribing for uncomplicated skin and soft tissue infections. Pediatrics. 2016;137(2):e20151223

5. Ibrahim LF, Hopper SM, Connell TG, Daley AJ, Bryant PA, Babl FE. Evaluating an admission avoidance pathway for children in the emergency department: outpatient intravenous antibiotics for moderate/severe cellulitis. Emerg Med J. 2017;34(12):780–785

6. Gouin S, Chevalier I, Gauthier M, Lamarre V. Prospective evaluation of the management of moderate to severe cellulitis with parenteral antibiotics at a paediatric day treatment centre. J Paediatr Child Health. 2008;44(4):214–218

7. Smith JK, Alexander S, Abrahamson E. Ambulatory intravenous ceftriaxone in paediatric A&E: a useful alternative to hospital admission? Emerg Med J. 2011;28(10):877–881

8. Khangura S, Wallace J, Kissoon N, Kodeeswaran T. Management of cellulitis in a pediatric emergency department. Pediatr Emerg Care. 2007;23(11):805–811

9. Lopez MA, Cruz AT, Kowalkowski MA, Raphael JL. Trends in resource

utilization for hospitalized children with skin and soft tissue infections. Pediatrics. 2013;131(3). Available at: www. pediatrics. org/ cgi/ content/ full/ 131/ 3/ e718

10. Fleisher G, Ludwig S, Henretig F, Ruddy R, Henry W. Cellulitis: initial management. Ann Emerg Med. 1981;10(7):356–359

11. Moran GJ, Krishnadasan A, Mower WR, et al. Effect of cephalexin plus trimethoprim-sulfamethoxazole vs cephalexin alone on clinical cure of uncomplicated cellulitis: a randomized clinical trial. JAMA. 2017;317(20):2088–2096

12. Goldman RD, Dolansky G, Rogovik AL. Predictors for admission of children with periorbital cellulitis presenting to the pediatric emergency department. Pediatr Emerg Care. 2008;24(5):279–283

13. Vu BL, Dick PT, Levin AV, Pirie J. Development of a clinical severity score for preseptal cellulitis in children. Pediatr Emerg Care. 2003;19(5):302–307

14. Crosbie RA, Nairn J, Kubba H. Management of paediatric periorbital cellulitis: our experience of 243 children managed according to a standardised protocol 2012-2015. Int J Pediatr Otorhinolaryngol. 2016;87:134–138

15. Reynolds DJ, Kodsi SR, Rubin SE, Rodgers IR. Intracranial infection associated with preseptal and orbital cellulitis in the pediatric patient. J AAPOS. 2003;7(6):413–417

16. Hultén KG, Kaplan SL, Lamberth LB, et al. Hospital-acquired Staphylococcus aureus infections at Texas Children’s Hospital, 2001-2007. Infect Control Hosp Epidemiol. 2010;31(2):183–190

17. Cunliffe NA, Booth JA, Elliot C, et al. Healthcare-associated viral gastroenteritis among children in a large pediatric hospital, United Kingdom. Emerg Infect Dis. 2010;16(1):55–62

18. Westley CR, Cotton EK, Brooks JG. Nebulized racemic epinephrine by IPPB for the treatment of croup: a double-blind study. Am J Dis Child. 1978;132(5):484–487

19. Ducharme FM, Chalut D, Plotnick L, et al. The pediatric respiratory assessment measure: a valid clinical score for assessing acute asthma severity from toddlers to teenagers. J Pediatr. 2008;152(4):476–480, 480.e1

20. Samuel M. Pediatric appendicitis score. J Pediatr Surg. 2002;37(6):877–881

21. Kharbanda AB, Vazquez-Benitez G, Ballard DW, et al. Development and validation of a novel Pediatric Appendicitis Risk Calculator (pARC). Pediatrics. 2018;141(4):e20172699

22. Babl FE, Borland ML, Phillips N, et al; Paediatric Research in Emergency Departments International Collaborative (PREDICT). Accuracy of PECARN, CATCH, and CHALICE head injury decision rules in children: a prospective cohort study. Lancet. 2017;389(10087):2393–2402

23. Mandeville K, Pottker T, Bulloch B, Liu J. Using appendicitis scores in the pediatric ED. Am J Emerg Med. 2011;29(9):972–977

24. Barata I, Brown KM, Fitzmaurice L, Griffin ES, Snow SK; American Academy of Pediatrics Committee on Pediatric Emergency Medicine; American College of Emergency Physicians Pediatric Emergency Medicine Committee; Emergency Nurses Association Pediatric Committee. Best practices for improving flow and care of pediatric patients in the emergency department. Pediatrics. 2015;135(1). Available at: www. pediatrics. org/ cgi/ content/ full/ 135/ 1/ e273

25. Stiell IG, Bennett C. Implementation of clinical decision rules in the emergency department. Acad Emerg Med. 2007;14(11):955–959

26. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381

27. Nagel TR, Schunk JE. Using the hand to estimate the surface area of a burn in children. Pediatr Emerg Care. 1997;13(4):254–255

IBRAHIM et al8

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022

Page 9: Development and Validation of a Cellulitis Risk Score: The

28. Dasanayake AP, Macaluso M, Roseman JM, Caufield PW. Validity of the mother’s recall of her child’s antibiotic use. ASDC J Dent Child. 1995;62(2):118–122

29. Moons KG, Kengne AP, Grobbee DE, et al. Risk prediction models: II. External validation, model updating,

and impact assessment. Heart. 2012;98(9):691–698

30. Kharbanda AB, Dudley NC, Bajaj L, et al; Pediatric Emergency Medicine Collaborative Research Committee of the American Academy of Pediatrics. Validation and refinement of a prediction rule to identify children

at low risk for acute appendicitis. Arch Pediatr Adolesc Med. 2012;166(8):738–744

31. Reilly BM, Evans AT. Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med. 2006;144(3):201–209

PEDIATRICS Volume 143, number 2, February 2019 9

Dow

nloaded from http://publications.aap.org/pediatrics/article-pdf/143/2/e20181420/1075995/peds_20181420.pdf by guest on 03 January 2022