Article Text

2016 Classification Criteria for Macrophage Activation Syndrome Complicating Systemic Juvenile Idiopathic Arthritis
  1. Angelo Ravelli1,
  2. Francesca Minoia2,
  3. Sergio Davì2,
  4. AnnaCarin Horne3,
  5. Francesca Bovis2,
  6. Angela Pistorio2,
  7. Maurizio Aricò4,
  8. Tadej Avcin5,
  9. Edward M Behrens6,
  10. Fabrizio De Benedetti7,
  11. Lisa Filipovic8,
  12. Alexei A Grom8,
  13. Jan-Inge Henter3,
  14. Norman T Ilowite9,
  15. Michael B Jordan8,
  16. Raju Khubchandani10,
  17. Toshiyuki Kitoh11,
  18. Kai Lehmberg12,
  19. Daniel J Lovell8,
  20. Paivi Miettunen13,
  21. Kim E Nichols14,
  22. Seza Ozen15,
  23. Jana Pachlopnik Schmid16,
  24. Athimalaipet V Ramanan17,
  25. Ricardo Russo18,
  26. Rayfel Schneider19,
  27. Gary Sterba20,
  28. Yosef Uziel21,
  29. Carol Wallace22,
  30. Carine Wouters23,
  31. Nico Wulffraat24,
  32. Erkan Demirkaya25,
  33. Hermine I Brunner8,
  34. Alberto Martini1,
  35. Nicolino Ruperto2,
  36. Randy Q Cron26
  37. on behalf of the Paediatric Rheumatology International Trials Organisation, the Childhood Arthritis and Rheumatology Research Alliance, the Pediatric Rheumatology Collaborative Study Group, and the Histiocyte Society
  1. 1Università degli Studi di Genova and Istituto Giannina Gaslini, Genoa, Italy
  2. 2Istituto Giannina Gaslini, Genoa, Italy
  3. 3Karolinska Institute and Karolinska University Hospital Solna, Stockholm, Sweden
  4. 4Azienda Sanitaria Provinciale 7, Ragusa, Italy
  5. 5University Children's Hospital, Ljubljana, Slovenia
  6. 6The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
  7. 7Ospedale Pediatrico Bambino Gesù, Rome, Italy
  8. 8Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
  9. 9Albert Einstein College of Medicine and Children's Hospital at Montefiore, Bronx, New York, USA
  10. 10Jaslok Hospital and Research Centre, Mumbai, India
  11. 11Aichi Medical University, Nagakute, Japan
  12. 12University Medical Center, Hamburg, Germany
  13. 13University of Calgary, Calgary, Alberta, Canada
  14. 14St Jude Children's Research Hospital, Memphis, Tennessee, USA
  15. 15Hacettepe University, Ankara, Turkey
  16. 16University Children's Hospital, Zurich, Switzerland
  17. 17Bristol Royal Hospital for Children, Bristol, UK
  18. 18Hospital de Pediatria Juan P. Garrahan, Buenos Aires, Argentina
  19. 19University of Toronto and Hospital for Sick Children, Toronto, Ontario, Canada
  20. 20Mount Sinai Medical Center, Miami Beach, Florida, USA
  21. 21Meir Medical Centre, Kfar Saba, Israel
  22. 22Seattle Children's Hospital and University of Washington, Seattle, USA
  23. 23University Hospital Leuven, Leuven, Belgium
  24. 24Wilhelmina Children's Hospital and University Medical Center Utrecht, Uthrecht, The Netherlands
  25. 25Gulhane Military Medical Faculty, Ankara, Turkey
  26. 26University of Alabama at Birmingham, Birmingham, UK
  1. Correspondence to Professor Angelo Ravelli, Pediatria II, Istituto G. Gaslini, Largo G. Gaslini 5, Genoa 16147, Italy; angeloravelli{at}gaslini.org

A European League Against Rheumatism/American College of Rheumatology/Paediatric Rheumatology International Trials Organisation Collaborative Initiative

Abstract

To develop criteria for the classification of macrophage activation syndrome (MAS) in patients with systemic juvenile idiopathic arthritis (JIA). A multistep process, based on a combination of expert consensus and analysis of real patient data, was conducted. A panel of 28 experts was first asked to classify 428 patient profiles as having or not having MAS, based on clinical and laboratory features at the time of disease onset. The 428 profiles comprised 161 patients with systemic JIA—associated MAS and 267 patients with a condition that could potentially be confused with MAS (active systemic JIA without evidence of MAS, or systemic infection). Next, the ability of candidate criteria to classify individual patients as having MAS or not having MAS was assessed by evaluating the agreement between the classification yielded using the criteria and the consensus classification of the experts. The final criteria were selected in a consensus conference. Experts achieved consensus on the classification of 391 of the 428 patient profiles (91.4%). A total of 982 candidate criteria were tested statistically. The 37 best-performing criteria and 8 criteria obtained from the literature were evaluated at the consensus conference. During the conference, 82% consensus among experts was reached on the final MAS classification criteria. In validation analyses, these criteria had a sensitivity of 0.73 and a specificity of 0.99. Agreement between the classification (MAS or not MAS) obtained using the criteria and the original diagnosis made by the treating physician was high (κ=0.76). We have developed a set of classification criteria for MAS complicating systemic JIA and provided preliminary evidence of its validity. Use of these criteria will potentially improve understanding of MAS in systemic JIA and enhance efforts to discover effective therapies, by ensuring appropriate patient enrollment in studies.

  • Adult Onset Still's Disease
  • Amyloidosis
  • Analgesics
  • Ankylosing Spondylitis
  • Ant-CCP

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

  • This criteria set has been approved by the European League Against Rheumatism (EULAR) Executive Committee and the American College of Rheumatology (ACR) Board of Directors. This signifies that the criteria set has been quantitatively validated using patient data, and it has undergone validation based on an independent data set. All EULAR/ACR-approved criteria sets are expected to undergo intermittent updates.

  • The ACR is an independent, professional, medical and scientific society that does not guarantee, warrant, or endorse any commercial product or service.

Introduction

Macrophage activation syndrome (MAS) is the term used to describe a potentially life-threatening complication of systemic inflammatory disorders, which occurs most commonly in systemic juvenile idiopathic arthritis (JIA) and in its adult equivalent, adult-onset Still's disease,1–4 although its occurrence in patients with other autoimmune or autoinflammatory conditions, that is, adult-onset and childhood-onset systemic lupus erythematosus,5 ,6 Kawasaki disease7 ,8 and periodic fever syndromes,9 ,10 is being reported with increased frequency. MAS is characterised by an overwhelming inflammatory reaction due to an uncontrolled and dysfunctional immune response involving the continual activation and expansion of T lymphocytes and macrophages, which results in massive hypersecretion of proinflammatory cytokines.11 ,12

Characteristic clinical features of MAS are high, non-remitting fever, hepatosplenomegaly, generalised lymphadenopathy, central nervous system dysfunction and haemorrhagic manifestations. Typical laboratory abnormalities include pancytopenia, increased levels of ferritin, liver enzymes, lactate dehydrogenase, triglycerides, D-dimers and soluble interleukin 2 (IL-2) receptor α (also known as soluble CD25 (sCD25)), and decreased fibrinogen levels. A typical histopathological feature of MAS is the accumulation of well differentiated macrophages exhibiting hemophagocytic activity in bone marrow biopsy specimens or aspirates.13 Although the prevalence of MAS among patients with systemic JIA has been estimated to be ∼10%, recent reports suggest that subclinical MAS may occur in as many as 30–40% of patients with systemic JIA.14 ,15

MAS can result in progressive multiorgan failure and eventually a fatal outcome if unrecognised. Recent studies indicate a mortality rate of 8%,16 ,17 making timely diagnosis and prompt initiation of appropriate treatment imperative. However, early recognition of MAS is often challenging, given the lack of a single pathognomonic clinical or laboratory feature. Furthermore, histopathological features of hemophagocytosis may not be present in the initial stages18 ,19 and lack specificity for hemophagocytic syndromes.20 In addition, features of MAS may be difficult to distinguish from other conditions that may present with overlapping manifestations, such as flares of systemic JIA or systemic infections. Recently, a wide disparity in the frequency and severity of the classic clinical and laboratory features across patients has been described.16 ,17

The difficulties in making the diagnosis of MAS and its clinical heterogeneity, together with the recent advances in its treatment and in the understanding of its pathophysiology and underlying genetic defects,11 ,21–23 emphasise the need for accurate criteria to aid physicians in appropriately classifying patients as having MAS to facilitate enrolment into clinical studies. The recognition that the syndrome is clinically similar to hemophagocytic lymphohistiocytosis (HLH) has led some to recommend the use of the HLH-2004 diagnostic guidelines.24 An alternative approach is based on application of the preliminary diagnostic guidelines for MAS complicating systemic JIA.25 However, although both sets of guidelines have been used for detecting MAS in patients with systemic JIA, each has several limitations.26 The primary purpose of the international collaborative project described herein, conducted under the auspices of EULAR, ACR and the Paediatric Rheumatology International Trials Organisation (PRINTO), was to develop a set of classification criteria for MAS complicating systemic JIA, based on a combination of expert consensus, available evidence from the medical literature and analysis of real patient data.

Methods

A multistep process was used in developing the classification criteria and included the following phases: (1) a Delphi survey of international paediatric rheumatologists, aimed at identifying MAS features potentially suitable for inclusion in classification criteria;27 (2) large-scale data collection on patients with systemic JIA—associated MAS and patients with two other conditions that potentially could be confused with MAS; (3) a web-based procedure for ascertaining consensus among experts; (4) selection of candidate criteria through statistical analyses; (5) selection of final classification criteria in a consensus conference; and (6) cross-sectional validation of final classification criteria. Health professionals and patient/parent representatives were not included in the study task force because the project did not involve any issues of specific interest to these stakeholders. In particular, none of the study assessments required the participation of health professionals, and no patient/parent-reported outcomes were incorporated.

Data collection on patients with MAS and patients with conditions that could be confused with MAS

The design, inclusion criteria and data collection procedures of this portion of the project have been described in detail previously.16 ,17 ,26 Briefly, international paediatric rheumatologists and paediatric haematologists were invited to participate in a retrospective cohort study of patients with systemic JIA-associated MAS or with one of two conditions that could potentially be confused with MAS, that is, active systemic JIA not complicated by MAS and systemic infection.

For patients with MAS, information on laboratory features at three time points (the last visit before onset of MAS, the time of MAS onset and the period of full-blown MAS) was collected. Because the classification criteria were aimed at identification of MAS in its earlier stages, only laboratory data recorded at the time of onset were retained. Data at the time of presentation in patients with conditions that could be confused with MAS were also obtained. Except for blood cell counts and acute-phase reactant levels, values of laboratory parameters were tested using the original values provided by each local laboratory and the values standardised according to the SI unit system based on their normal ranges, as previously reported.16

A total of 1111 patients (362 with systemic JIA-associated MAS, 404 with active systemic JIA without MAS and 345 with systemic infection) were reported by 95 paediatric subspecialists practicing in 33 countries in 6 continents. Paediatric subspecialists who provided these data are listed in Appendix A. The features of the patients with MAS and the comparison patients have been described elsewhere.16 ,17 ,26

Web-based procedures for ascertaining consensus among experts

At present, there is no single feature that is pathognomonic for MAS. Furthermore, no prior validated diagnostic or classification criteria are available. In order to classify patients as having or not having MAS, we therefore decided to use expert consensus as the ‘gold standard’. Based on publication records and experience in the care of children with MAS and related disorders, a panel of 28 experts (20 paediatric rheumatologists and 8 paediatric haematologists) was created.

The experts were asked to classify a total of 428 patient profiles as having or not having MAS, based on the clinical and laboratory features recorded at disease onset. The 428 profiles were selected randomly from among the 1111 patients whose data were collected and comprised 161 patients with MAS, 140 patients with active systemic JIA without evidence of MAS and 127 patients with systemic infection. Selection bias was unlikely, as the characteristics of patients who were selected and those who were not selected were comparable (data not shown). The experts were intentionally kept unaware of the original diagnosis and overall course of each patient.

Each patient profile included information about the presence or absence of key clinical manifestations, and the values of laboratory parameters and normal ranges at the respective institutions. Based on these data, all experts were asked to classify each patient as having or not having MAS. The minimum required level of agreement among experts was set at 80%. If an 80% consensus was not attained, the patient profile was discussed in a further round. Profiles for which consensus had not been achieved after the final round were declared uninterpretable and discarded from further analyses. Three rounds of voting were used, with prior vote data and recorded comments available to all of the participants before each vote took place, to augment the number of consensus decisions. All web-based consensus procedures were conducted by PRINTO.

Selection of best classification criteria through statistical analyses

All statistical analyses used for selecting the best classification criteria were conducted only on the sample of patients for whom the experts achieved consensus about the diagnosis of MAS or non-MAS. Cut-off values for laboratory tests were calculated with the receiver operator characteristic (ROC) curve method, by identifying the point on the ROC curve that best discriminated between patients classified by the experts as having MAS and those classified as not having MAS.

The aim of this exercise was to assess the ability of candidate criteria to classify individual patients as having or not having MAS, and to evaluate the agreement between the classification yielded by the criteria and the consensus classification of experts. Candidate classification criteria were partly derived from the literature and partly generated from the study data.

Literature criteria included the following: (1) the preliminary diagnostic guidelines for MAS complicating systemic JIA,25 (2) the same guidelines modified by addition of the item ferritin at various threshold levels (500 ng/mL, 1000 ng/mL or 1500 ng/mL) and (3) the HLH-2004 diagnostic guidelines,24 adapted by eliminating three of the eight items because information about presence of hemophagocytosis was not available for both comparison groups, and neither natural killer (NK) cell activity nor sCD25 levels were determined in all patients. Criteria obtained from the study data were generated in two ways: (1) through the evaluation, by the project steering committee, of all combinations of clinical and laboratory variables (see some examples in online supplementary table S1, on the Arthritis & Rheumatology web site at http://onlinelibrary.wiley.com/doi/10.1002/art.?????/abstract) (combination of criteria approach), and (2) by assigning weights to clinical and laboratory variables, on the basis of their association with the diagnosis of MAS made by the experts, through multivariable logistic regression analysis. For each combination of variables that were significantly associated with the diagnosis of MAS in logistic regression models, the rule was to convert the OR of each variable to its percentage value out of a total of 100%. Each set of criteria was then composed of a group of variables whose sum of weights made up a total score of 100 (MAS score). The cut-off value in the MAS score that was associated with the higher likelihood of the presence of MAS was obtained by calculating the point on the ROC curve that corresponded to the highest sensitivity and specificity.

A total of 982 candidate classification criteria were tested. For each set of criteria, we calculated the sensitivity (ability of the criteria to identify a patient as having MAS who had been classified as having MAS according to the expert panel), the specificity (ability of the criteria to identify a patient as not having MAS who had been classified as not having MAS by the experts), the positive and negative predictive values, the area under the ROC curve (AUC), and the κ value for agreement between the classification yielded by the criteria and the classification made by the experts. Although there was one single model with the highest predictive value (criterion no. 929; see online supplementary table S1), we generated multiple combinations for comparison because we believed that less predictive models might have more face validity with the experts. Nevertheless, it was established that in order to qualify for inclusion in expert voting procedures at the consensus conference, a set of classification criteria should demonstrate a κ value of ≥0.85, a sensitivity of ≥0.80, a specificity of ≥0.93 and an AUC of ≥0.90. An exception was made for the historical literature criteria, which were retained for further consideration even if they did not meet all statistical requirements.

Selection of the final classification criteria at consensus conference

The International Consensus Conference on MAS Classification Criteria was held in Genoa, Italy on 21–22 March 2014. The meeting was attended by all 28 experts who participated in web-based consensus evaluations and was facilitated by two moderators (HIB and NR) with expertise in nominal group technique. The overall goal of the meeting was to decide on a preliminary set of classification criteria using a combination of statistical and consensus formation techniques.

A plenary session was first held to present the scope, methodology and flow of the project, the results of the Delphi survey, the characteristics of patients included in the data collection, the results of web-based consensus procedures and of statistical analyses of candidate classification criteria, and the methodology of the nominal group technique. Participants were then randomised into two equal-sized nominal groups and were asked to rank using nominal group technique, independently of each other and based on the evaluation of ease of use and credibility (face/content validity) and statistical performance (particularly in terms of sensitivity, specificity and κ value), the five best classification criteria from 5 (highest) to 1 (lowest). All experts were connected by their laptops to a central computer and submitted all of their rankings electronically. A series of repeated independent voting sessions was held until the top three classification criteria were selected by each voting group. Then an 80% consensus was attained on the best (final) set of classification criteria, in a session with members of the two nominal groups combined.

Analysis of the association between the variables included in the final classification criteria and the web-based experts’ consensus evaluations

The association between the final classification criteria and the web-based evaluations made by the experts was assessed by multiple logistic regression analysis, which used as explanatory variables the individual items included in the final classification criteria and as the dependent variable the web-based expert consensus on classification of patients as having or not having MAS. The effect was expressed in terms of ORs, and 95% CIs were calculated; statistical significance was tested by the likelihood ratio test. The AUC of the model was used as an indicator of its predictive ability. The purpose of this postconsensus analysis was to evaluate which were the variables that most influenced the experts’ decision to classify the patients as having or not having MAS.

Validation of final classification criteria

Validation analysis was performed by assessing the performance of the criteria, in terms of sensitivity, specificity, negative predictive value, positive predictive value, AUC, and κ value, in discriminating patients with MAS from patients with the two conditions with which MAS could be confused (combined in a single group), using the original diagnosis made by the caring physician (ie, the investigator who entered the patient's data in the study website) as the gold standard. This analysis was performed on the sample of patients not used for expert evaluations (n=683). Only patients with available data on all items included in the final classification criteria were used for the analyses.

Results

Results of the web-based process for ascertainment of expert consensus

After three rounds of web-based evaluations, the experts achieved consensus on the classification of 391 (91.4%) of the 428 patient profiles examined (figure 1). A total of 95 patients were classified as having MAS by the experts, 88 of whom had also been diagnosed as having MAS by the treating physician; the original diagnosis had been systemic JIA without MAS in 3 patients and systemic infection in 4. A total of 296 patients were classified by the experts as not having MAS, 47 of whom had been diagnosed as having MAS by the treating physician. Thirty-seven patient profiles for which 80% consensus among experts was not reached were discarded. A comparison of clinical and laboratory features between patients diagnosed by the experts as having MAS and those diagnosed as not having MAS is shown in table 1. Overall, patients whose condition was classified as MAS by the experts had more severe clinical and laboratory features than those classified as not having MAS.

Table 1

Comparison of clinical and laboratory features at disease onset between patients classified by the 28-member expert panel as having macrophage activation syndrome (MAS) (n=95) and those classified as not having MAS (n=296)

Figure 1

Patient samples evaluated in the study and results of web-based expert evaluations. MAS, macrophage activation syndrome; sJIA, systemic juvenile idiopathic arthritis.

Candidate clinical and laboratory variables determined by univariate analysis

In univariate analyses, the 10 variables found to have the greatest ability to distinguish patients with MAS from comparison patients were as follows: ferritin level, platelet count, levels of aspartate transaminase (AST), lactate dehydrogenase, triglycerides, alanine transaminase (ALT), and fibrinogen, central nervous system involvement, hepatomegaly, and haemorrhagic manifestations (table 2). These variables qualified for inclusion in logistic regression analyses aimed at generating candidate classification criteria through the MAS score method described above. However, ALT levels were excluded owing to their close correlation with AST levels and a slightly lower statistical performance. They were replaced by neutrophil count or albumin level, depending on the model.

Table 2

Univariate analysis of the ability of specific variables to distinguish patients with macrophage activation syndrome from comparison patients, as assessed using the 391 patients for whom expert consensus was achieved

Candidate classification criteria sets

Of the 982 sets of criteria tested, 45 were retained for further evaluation at the consensus conference. Of these, 37 (20 generated through the combination of criteria approach and 17 obtained with the MAS score method) were represented by criteria that met the statistical requirements described in Methods, and 8 were criteria derived from the literature. The statistical performance of the 20 best candidate criteria is presented in online supplementary table S1 (on the Arthritis & Rheumatology web site at http://onlinelibrary.wiley.com/doi/10.1002/art.?????/abstract). The definition of and statistics on all 982 criteria tested are available from the corresponding author upon request.

Final classification criteria selected at face-to-face conference

During the consensus conference, seven voting sessions were held among the 28 experts until three top classification criteria sets remained (criteria nos. 466, 472 and 929; see online supplementary table S1). Notably, the same criteria were selected independently by the 2 nominal groups, confirming convergent validity of the selection process. After the last voting session, 82% consensus was reached on the final definition (criteria no. 472; see online supplementary table S1). A subsequent open face-to-face discussion among all experts led to the decision to include in the final definition the presence of fever as a mandatory criterion and the requirement that the patient should have known or suspected systemic JIA. The final classification criteria selected at the consensus conference are presented in figure 2.

Figure 2

Criteria for the classification of macrophage activation syndrome in patients with systemic juvenile idiopathic arthritis. Laboratory abnormalities should not be otherwise explained by the patient's condition, such as concomitant immune-mediated thrombocytopenia, infectious hepatitis, visceral leishmaniasis or familial hyperlipidaemia.

Association between final classification criteria and experts’ web-based consensus evaluations

For this multivariable analysis, complete data were available on 227 patients. The logistic regression model to evaluate which were the variables included in the final classification criteria that most influenced the experts’ decision to classify a patient as having or not having MAS is presented in table 3. All variables were independently correlated with the experts’ diagnoses. However, the association was much stronger for ferritin and platelet count. The AUC of the model was 0.99.

Table 3

Logistic regression model to assess association between the variables included in the final classification criteria and the experts’ consensus of patients’ classification as having or not having macrophage activation syndrome*

Preliminary validation of the final criteria set

The evaluation of the ability of the new classification criteria to discriminate MAS from comparator conditions in the patient sample not included in the expert evaluations (n=415 of 683) showed a sensitivity of 0.73, a specificity of 0.99, a positive predictive value of 97.4%, a negative predictive value of 85.9%, an AUC of 0.86, and a κ value for agreement between the diagnosis yielded by the criteria and the diagnosis made by the treating physician of 0.76.

Discussion

Using a consensus process as well as a statistical approach, we have developed a new set of classification criteria for MAS complicating systemic JIA (figure 2). Because the criteria were established against comparison samples composed of patients with either a rheumatological condition (active systemic JIA without evidence of MAS) or a non-rheumatological condition (systemic infection), they may be of interest to specialists in a range of disciplines.

The classification criteria include only laboratory variables and no clinical manifestations, with the exception of fever. This choice is in accordance with the common view that suspicion of MAS is most commonly raised by detection of subtle laboratory alterations, whereas clinical symptoms are often delayed and/or similar to those observed in other conditions.28 In a previous analysis of the MAS sample included in the present study, we found that four of the five laboratory tests that are part of the criteria (ferritin, platelet count, AST and triglycerides) were among the parameters that showed a change of >50% between the last visit before the onset of MAS and the onset of MAS.16 In the same study, ferritin levels exhibited the largest change over time, which underscores the major importance of this feature in MAS detection and supports its use as a mandatory criterion. The key value of ferritin in the classification of MAS was corroborated by the observation that it was the parameter that had the greatest influence on the experts’ classification of patients as having or not having MAS (table 3).

Although the presence of fever did not enable discrimination between MAS and comparator illnesses as it was found in all or nearly all patients in each sample, the expert panel considered fever a prerequisite for the classification of MAS. The cardinal diagnostic role of fever is substantiated by the observation that it was the mostly highly ranked clinical feature identified in the Delphi survey.27 Unfortunately, we lacked reliable information on the pattern of fever in the three patient groups. However, it is generally accepted that the onset of MAS is heralded by a shift from the high-spiking intermittent pattern typical of active systemic JIA to a continuous non-remitting pattern.3 ,4 ,29

The detection of macrophage hemophagocytosis in bone marrow biopsy specimens or aspirates or reticuloendothelial organ biopsy specimens is another frequent and characteristic feature of MAS. However, because hemophagocytosis is often absent during the early stages of MAS18 ,19 and its demonstration requires an invasive procedure, the expert panel deemed it not necessary for the classification of systemic JIA-associated MAS. Notably, the demonstration of hemophagocytosis is not mandatory in either the HLH-2004 or the preliminary MAS diagnostic guidelines.24 ,25

Although possibly useful for diagnostic purposes, the classification criteria are primarily intended for use in clinical trials and research studies. The criteria exhibited high accuracy and face/content validity in consensus and statistical evaluations, but it should be taken into account that they were developed using expert consensus as the gold standard. It also should be noted that the experts were asked to differentiate MAS from non-MAS conditions by reviewing the clinical features and laboratory values recorded at a single point in time (ie, at disease onset), and were unaware of the patient's clinical course, laboratory values over time, response to treatment or outcome. This information was, however, available to the treating physician, who made the original diagnosis in the clinical setting. This disparity in the available information may partially explain the high proportion of patients who were diagnosed by the treating physician as having MAS but classified by the experts as not having MAS (47 of 161; 29.2%). It is conceivable that because the experts were provided with only the information relevant to the development of the criteria, they tended to confirm the diagnosis of MAS only in straightforward and unambiguous cases.

It is therefore important to emphasise that the classification criteria may not capture all instances of MAS seen in the routine clinical setting, particularly those with subtle onset or incomplete clinical expression. Notably, of the 47 patients for whom the treating physician's diagnosis of MAS was not confirmed by the experts, 30 (63.8%) also did not meet the final classification criteria, 11 (23.4%) could not be assessed due to lack of data on the laboratory variables needed to apply the criteria, and only 6 (12.8%) were classified as having MAS according to the final classification criteria. In addition, only 18 (46.6%) of the 37 patients for whom the experts could not agree on the diagnosis were classified as having MAS according to the final classification criteria. These findings underscore the consistency of the experts’ evaluations and support the validity of the final classification criteria.

The fact that the cut-off values for platelet count and fibrinogen level included in the criteria are within the normal range of routine laboratory assessments may be regarded as clinically implausible. The same may apply to the cut-offs for AST and triglycerides, which are only slightly above the upper limits of normal. However, it is widely recognised that children with active systemic JIA often have increased platelet counts (eg, >600–800×109/L) as well as elevated fibrinogen levels (eg, >500–600 mg/dL) as part of the underlying inflammatory process.30 ,31 Thus, a paradoxically normal platelet count or fibrinogen level in the setting of otherwise prominent systemic inflammation may raise the suspicion of MAS.16 ,28 Because the levels of serum transaminases and triglycerides are generally normal in children with systemic JIA who do not have other coexistent pathological conditions (eg, infectious hepatitis or familial hyperlipidaemia), their simple increase above the upper normal limits, combined with the other clinical and laboratory parameters included in the criteria, may be sufficient to herald the occurrence of MAS. This fits with the real-world patient data used in these studies to establish cut-off values that distinguish between children with JIA who have MAS and those who do not have MAS.

A secondary objective of the present project was analysis of the role of change in laboratory findings over time in the detection of MAS. However, this exercise was performed only for descriptive purposes, that is, to identify and rank the laboratory parameters for which change over time was deemed by the experts as most important or useful for early detection of MAS. Because serial laboratory results were available for patients with MAS but not for the comparator groups, we could not establish the threshold level of change in each parameter that had the greatest sensitivity and specificity for the diagnosis of MAS. This precluded the ability to incorporate the change in laboratory values over time in the classification criteria. Due to space constraints, this analysis is reported in a separate manuscript.32

Recently there have been several reports, from randomised controlled clinical trials and from postmarketing experience, of MAS occurring in patients with systemic JIA being treated with the cytokine blockers canakinumab and tocilizumab.33–35 Because these agents inhibit the biological effects of IL-1 and IL-6, respectively, which are among the proinflammatory cytokines involved in the physiopathology of MAS,11 ,36 it is conceivable that MAS episodes developing during treatment with these biologic agents may occur in the absence of fever or some of the typical laboratory abnormalities of the syndrome. Clinical symptoms in patients with systemic JIA-associated MAS receiving tocilizumab were found to be milder than those in patients not receiving this treatment.37 Preliminary analyses in patients who developed MAS while receiving tocilizumab or canakinumab have shown that a few cases did not meet the new criteria, due to the absence of fever or a peak ferritin level of <684 ng/mL.38 ,39 More data from real-world clinical practice are needed to establish whether the criteria should be refined to increase their power to identify MAS occurring during treatment with IL-1 and IL-6 inhibitors.

Our study should be interpreted in light of some potential caveats. Patient data were collected through retrospective review of clinical charts, and retrospective analysis is subject to missing and possibly erroneous data. However, because all patient profiles were reviewed by the experts and the diagnosis of MAS or non-MAS was confirmed only when a high level of consensus was reached, the impact of this potential limitation was likely minimised. Some important diagnostic parameters of MAS, such as sCD25 and sCD163 levels and NK cell activity, could not be assessed due to their unavailability in some of the patient samples. However, these biomarkers are not routinely assessed, nor are they timely, in most paediatric rheumatology centres.

In summary, we have developed a set of classification criteria for MAS complicating systemic JIA and provided preliminary evidence of their validity. These criteria will help standardise the design and conduct of future clinical trials and research studies and contribute to enhancing knowledge and awareness of the syndrome.

Acknowledgments

The authors thank the PRINTO employees, Simona Angioloni, Chiara Pallotti, Michele Pesce, Mariangela Rinaldi and Luca Villa, for technical assistance during the study and for technical and secretarial assistance in the organisation of the consensus conference.

Appendix A

Participating physicians

The following physicians contributed patient data for use in the study: Mario Abinun, MD (Newcastle, UK); Amita Aggarwal, MD (Lucknow, India); Jonathan Akikusa, MD (Melbourne, Victoria, Australia); Sulaiman M. Al-Mayouf, MD (Riyadh, Saudi Arabia); Maria Alessio, MD (Naples, Italy); Jordi Anton, MD (Barcelona, Spain); Maria Teresa Apaz, MD (Cordoba, Argentina); Itziar Astigarraga, MD (Bilbao, Spain); Nuray A. Ayaz, MD (Istanbul, Turkey); Patrizia Barone, MD (Catania, Italy); Blanca Bica, MD (Rio de Janeiro, Brazil); Isabel Bolt, MD (Berne, Switzerland); Luciana Breda, MD (Chieti, Italy); Vyacheslav Chasnyk, MD (Saint Petersburg, Russian Federation); Rolando Cimaz, MD (Florence, Italy); Fabrizia Corona, MD (Milan, Italy); Ruben Cuttica, MD (Buenos Aires, Argentina); Gianfranco D'Angelo, MD (Ancona, Italy); Zane Davidsone, MD (Riga, Latvia); Carmen De Cunto, MD (Buenos Aires, Argentina); Jaime De Inocencio, MD (Madrid, Spain); Eli Eisenstein, MD (Jerusalem, Israel); Sandra Enciso, MD (Mexico City, Mexico); Graciela Espada, MD (Buenos Aires, Argentina); Michel Fischbach, MD (Munster, Germany); Michael Frosch, MD (Munster, Germany); Romina Gallizzi, MD (Messina, Italy); Maria Luz Gamir, MD (Madrid, Spain); Yi-Jin Gao, MD (Shangai, China); Thomas Griffin, MD (Charlotte, NC); Soad Hashad, MD (Tripoli, Libya); Teresa Hennon, MD (Buffalo, NY); Gerd Horneff, MD (Sankt Augustin, Germany); Zeng Huasong, MD (Guangzhou, China); Adam Huber, MD (Halifax, Nova Scotia, Canada); Norman Ilowite, MD (New York, NY); Antonella Insalaco, MD (Rome, Italy); Maka Ioseliani, MD (Tbilisi, Georgia); Marijia Jelusic-Drazic, MD (Zagreb, Croatia); Michael Jeng, MD (Stanford, CA); Agneza Kapovic, MD (Zagreb, Croatia); Ozgur Kasapcopur, MD (Istanbul, Turkey); Toshiyuki Kitoh, MD (Nagakute, Japan); Isabelle Kone-Paut, MD (Paris, France); Sheila Knupp Feitosa de Oliveira, MD (Rio de Janeiro, Brazil); Bianca Lattanzi, MD (Ancona, Italy); Loredana Lepore, MD (Trieste, Italy); Caifeng Li, MD (Beijing, China); Jeffrey M. Lipton, MD (New York, NY); Silvia Magni-Manzoni, MD (Rome, Italy); Despoina Maritsi, MD (Athens, Greece); Deborah McCurdy, MD (Orange, CA); Rosa Merino, MD (Madrid, Spain); Velma Mulaosmanovic, MD (Sarajevo, Bosnia and Herzegovina); Susan Nielsen, MD (Copenhagen, Denmark); Priyankar Pal, MD (Kolkata, India); Sampath Prahalad, MD (Atlanta, GA); Donato Rigante, MD (Rome, Italy); Ingrida Rumba-Rozenfelde, MD (Riga, Latvia); Claudia Saad Magalhaes, MD (Botucatu, Brazil); Helga Sanner, MD (Oslo, Norway); Sujata Sawhney, MD (New Delhi, India); Wafaa M. Sewairi, MD (Riyadh, Saudi Arabia); Bita Shakoory, MD (Philadelphia, PA); Susan Shenoi, MD (Seattle, WA); Artur Silva Clovis, MD (Sao Paulo, Brazil); Valda Stanevicha, MD (Riga, Latvia); Kimo C. Stine, MD (Little Rock, AR); Gordana Susic, MD (Belgrade, Serbia); Flavio Sztajnbok, MD (Rio de Janeiro, Brazil); Syuji Takei, MD (Kagoshima City, Japan); Hasan Tezer, MD (Ankara, Turkey); Ralf Trauzeddel, MD (Berlin, Germany); Elena Tsitsami, MD (Athens, Greece); Erbil Unsal, MD (Izmir, Turkey); Olga Vougiouka, MD (Athens, Greece); Lehn K. Weaver, MD (Philadelphia, PA); Jennifer Weiss, MD (Hackensack, NJ); Sheila Weitzman, MD (Toronto, Ontario, Canada); Mabruka Zletni, MD (Tripoli, Libya).

References

View Abstract

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Handling editor Tore K Kvien

  • This article is published simultaneously in the March 2016 issue of Arthritis & Rheumatology.

  • Supported by the American College of Rheumatology, the European League Against Rheumatism, and the Paediatric Rheumatology International Trials Organisation.

  • Contributors All authors were involved in drafting the article or revising it critically for important intellectual content, and all authors approved the final version to be published. AR had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study conception and design: AR, FM, SD, AH, AM, NR and RQC. Acquisition of data: AR, FM, SD, AH, MA, TA, EMB, FDB, LF, AAG, J-IH, NTI, MBJ, RK, TK, KL, DJL, PM, KEN, SO, JP-S, AVR, RR, RS, GS, YU, CWa, CWo, NW, ED, HIB, AM, NR and RQC. Analysis and interpretation of data: AR, FM, AH, FB, AP, HIB, NR and RQC.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; internally peer reviewed.