Article Text
Abstract
Background Diagnosis of congenital syphilis (CS) is not straightforward and can be challenging. This study aimed to evaluate the validity of an algorithm using timing of maternal antisyphilis treatment and titres of non-treponemal antibody as predictors of CS.
Methods Confirmed CS cases and those where CS was excluded were obtained from the Guangzhou Prevention of Mother-to-Child Transmission of syphilis programme between 2011 and 2019. We calculated sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) using receiver operating characteristics (ROC) in two situations: (1) receiving antisyphilis treatment or no-treatment during pregnancy and (2) initiating treatment before 28 gestational weeks (GWs), initiating after 28 GWs or receiving no treatment for syphilis seropositive women.
Results Among 1558 syphilis-exposed children, 39 had confirmed CS. Area under the curve, sensitivity and specificity of maternal non-treponemal titres before treatment and treatment during pregnancy were 0.80, 76.9%, 78.7% and 0.79, 69.2%, 88.7%, respectively, for children with CS. For the algorithm, ROC results showed that PPV and NPV for predicting CS were 37.3% and 96.4% (non-treponemal titres cut-off value 1:8 and no antisyphilis treatment), 9.4% and 100% (non-treponemal titres cut-off value 1:16 and treatment after 28 GWs), 4.2% and 99.5% (non-treponemal titres cut-off value 1:32 and treatment before 28 GWs), respectively.
Conclusions An algorithm using maternal non-treponemal titres and timing of treatment during pregnancy could be an effective strategy to diagnose or rule out CS, especially when the rate of loss to follow-up is high or there are no straightforward diagnostic tools.
- microbiology
- statistics
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Introduction
Congenital syphilis (CS) resulting from intrauterine infection with Treponema pallidum1 continues to be a substantial global public health problem.2 Korenromp et al estimated that the global CS rate in 2016 was 473 per 100 000 live births.3 CS is considered as a re-emerging disease in developed countries.4 The incidence in the USA increased from 9.2 to 23.3 cases per 100 000 newborns during 2013–2017.5 Similarly, in China, the reported incidence of CS sharply increased from 7.2 to 82.7 per 100 000 newborns during 2003–2011. Although this incidence rate rapidly dropped to 27.6 to 100 000 newborns in 2016,6 this is still exceeding the target of 15 per 100 000 newborns by 2020.
CS results in an estimated additional $9969 per case in hospitalisation costs,7 placing a substantial economic burden on individuals and families. Additionally, managing the high-risk population creates substantial challenges for the health service system.8 Therefore, timely and accurate diagnosis of CS is vital to avoid severe health consequences for children born to syphilis-seropositive mothers and an economic burden to their families and community.9
The diagnostic criteria for CS are complicated, requiring a careful review of maternal tests and treatment history, comparison of maternal and neonatal non-treponemal titres, and multiple blood tests and clinical follow-up of children.10 A reactive serological test before age 18 months does not necessarily indicate that the infant is infected.11 A broad spectrum of severity exists, from inapparent infection to severe cases that are present at birth.12 Therefore, diagnostic misclassification of CS in clinical practice is not uncommon. The reported rate of accurate diagnosis of CS in China ranges from 33.8% to 49.1%.13 14 In the USA, both underdiagnosis and overdiagnosis of CS exist, with 98% of CS being diagnosed by neonatologists based on the severity of the symptoms such as central nervous system calcification or hydrocephalus.15 However, 56% of neonatologists choose a treponemal instead of a non-treponemal test for CS, which results in overdiagnosis.15
The high probability of no clinical manifestations of CS at birth hinders its diagnosis and the mothers’ awareness of the importance of follow-up.4 In England, at least one-third of infants born to treated syphilis-seropositive women did not have a follow-up.16 In Brazil, the lost to follow-up rate of syphilis-exposed children was reported to be about 62.3%.4 Furthermore, we have previously shown that the lost to follow-up rate of syphilis-exposed children is 44.2%, and the rate gradually increases with age.17 This high rate of lost to follow-up is an obstacle for timely diagnosis of some CS cases.
Taken altogether, the complex diagnostic criteria and the high lost to follow-up rate hinder the timely and accurate detection of CS. Identifying predictors for CS detection at birth is of great clinical importance and could contribute to the global elimination of CS launched by the WHO in 2007.18
In the present study, we examined the usefulness and validity of two commonly used and easy-to-collect objective CS predictors: maternal non-treponemal titres before treatment and timing of antisyphilis treatment during pregnancy. Higher maternal non-treponemal titre at the time of diagnosis was found to be a risk factor for CS.11 19–21 Similarly, timing of antisyphilis treatment during pregnancy was chosen due to the close association between inappropriate or no treatment and CS.22 Previous studies have shown that antisyphilis treatment before 28 gestational weeks (GWs) is critical for CS prevention.22 23 Initiating adequate antisyphilis treatment during early pregnancy, ideally, before the second trimester, was emphasised by the WHO.24 Therefore, we hypothesised that maternal non-treponemal titres before treatment and timing of antisyphilis treatment during pregnancy might identify children at high risk for CS and help clinicians develop better follow-up management strategies. This study aimed to test this hypothesis.
Methods
Participants and study design
This study was a retrospective cohort study. We included all syphilis-infected pregnant women registered in China’s Information Management System for Prevention of Mother-to-Child Transmission (PMTCT) of syphilis in Guangzhou between January 2011 and December 2019. Pregnant women received free toluidine red unheated serum test (TRUST; a non-treponemal test for syphilis) and Treponema pallidum particle agglutination test (TPPA) at their first antenatal visit at Guangzhou. Maternal syphilis was diagnosed if TRUST and TPPA were both positive. All syphilis-seropositive pregnant women were referred to designated hospitals where treatment and regular serological tests were free. Children born to mothers with syphilis were entitled to free treatment and serological tests at delivery and every 3 months after birth in designated hospitals until CS was confirmed or excluded.
Covariate assessment
Trained medical staff regularly followed pregnant women with syphilis and their children. During face-to-face interviews, medical staff recorded maternal and children’s information on structured forms. This information included maternal demographic characteristics (eg, age, ethnicity, education, occupation and marital status), clinical information (previous infection history, TRUST before treatment and before delivery, stage of infection, time of starting treatment, time of stopping treatment, name and dosage of medications used) and children’s birth information (eg, sex, gestation at birth, delivery mode and TRUST at birth). The information was collected and reported to the PMTCT surveillance system after district-municipal-provincial reviews.
All participants’ information was confidential, and only the first and corresponding authors had access to the data.
Diagnosis of CS
Cases of CS reported in the PMTCT surveillance system were verified by checking the mothers and their children’s information according to the national PMTCT programme25 and syphilis diagnosis guidelines issued by the Ministry of Health. The definitions of confirmed cases and cases where CS was excluded are summarised in table 1.
Diagnosis criteria of CS
Algorithms
Laboratory tests
Treponemal and non-treponemal tests were used in the diagnosis of syphilis. The former is highly specific but can identify syphilis infection, while the latter is less specific but reflects the response to treatment and infection activity.26 There are several non-treponemal tests such as TRUST and rapid plasma reagin (RPR), but Parham et al27 found that TRUST is comparable to RPR in all parameters. For non-treponemal test, we used TRUST (Rongsheng Biotech, Shanghai, China). For treponemal test, TPPA (Fujirebio Diagnostics, Tokyo, Japan) is used in Guangzhou, which is based on the agglutination of coloured gelatin particle carriers sensitised with T. pallidum (Nichols Strain) antigen.
Treponemal pallidum IgM tests seem to be the most sensitive and specific tests for CS since they cannot cross the placental barrier.28 There are only two dermatology institutes in Guangzhou which perform fluorescent treponemal antibody absorption assay-19S-immunoglobulin M antibody test, which is expensive and paid for by patients. Only a few patients underwent this test due to its lack of availability and relatively high cost.
All laboratory tests were performed according to the manufacturer’s instructions, and routine quality control procedures were carried out to reduce false positive or negative results.
Treatment for maternal syphilis
Syphilis-infected pregnant women were initially divided into two groups, those who received antisyphilis treatment during pregnancy (group 1) and those who received no treatment (group 2). Pregnant women receiving treatment were further divided into two subgroups: those starting treatment before 28 weeks of gestation and those starting treatment after 28 weeks. Thus, we ended up with three groups of syphilis-infected pregnant women: women who received treatment before 28 weeks (group 1a), after 28 weeks (group 1b) and untreated (group 2).
Statistical analysis
The study participants’ sociodemographic data and clinical characteristics were summarised and compared between confirmed and non-confirmed CS using χ² test for categorical variables.
We proposed a new screening algorithm using the two predictors (maternal non-treponemal titres and timing of antisyphilis treatment) to identify children at high risk for CS (figure 1). The usefulness of these two indicators was evaluated using receiver operating characteristic curves (ROC). The optimal cut-off values of non-treponemal titres and treatment were obtained by maximising Youden’s index, the difference between the true positive rate (sensitivity) and the false positive rate (1-specificity).29 To better understand the clinical predictive capability of non-treponemal titres before treatment, positive predictive value (PPV) and negative predictive value (NPV) were calculated. A non-parametric approach was used to compare the area under the curves (AUCs) among different maternal antisyphilis treatment status with the bootstrap method. The statistical analysis was performed by pROC and reportROC packages of R software, V.3.5.1. All reported p values were based on a two-sided test with a significance level of α=0.05.
Description of the evaluated algorithm. CS, congenital syphilis.
Results
Characteristics of participants
From 2011 to 2019, syphilis-infected pregnant women gave birth to 3583 newborns. A total of 1558 (43.5%) children were followed up for the results of syphilis infection, of whom 39 children were diagnosed with CS. The status of syphilis infection was indeterminate in 2025 (56.5%) children because they did not receive continuous serological tests. As shown in table 2, mothers with syphilis, who were younger than 24 years old, unmarried, had no history of syphilis, received no treatment and non-treponemal titres before treatment ≥1:8 were more likely to deliver a baby with CS. Premature children were more likely to have CS (table 2).
Characteristics of mothers with syphilis associated with CS
Diagnostic value of non-treponemal titres before treatment and maternal antisyphilis treatment
The AUC (95% CI) for maternal non-treponemal titres before treatment was 0.80 (0.72 to 0.87), and for receiving treatment during pregnancy it was 0.79 (0.72 to 0.86) (figure 2). There was no difference between the two indicators for predicting CS (p=0.87). We observed high NPV but low PPV for both indicators (table 3).
ROC curves of titres of non-treponemal titres before treatment and maternal antisyphilis treatment during pregnancy. AUC, area under the curve; ROC, receiver operating characteristic.
Statistical measures of non-treponemal titres before treatment and maternal antisyphilis treatment during pregnancy as predictions for CS
Diagnostic value of non-treponemal titres before treatment stratified by two treatment groups
By maximising Youden’s index, the optimal cut-off value for the prediction of CS was 1:6 for maternal non-treponemal titres before treatment (table 3). We used 1:8 for convenience. We found that non-treponemal titres (≥1:8) before treatment during pregnancy were more predictive of CS (AUC, PPV and NPV of 0.80, 37.3% and 96.4%, respectively) (table 4). Nevertheless, there was no difference between the two AUCs (p=0.38).
The diagnostic values of non-treponemal titres before treatment for CS stratified by two treatment groups
Diagnostic value of non-treponemal titres before treatment stratified by three treatment groups
We found the optimal cut-off values of non-treponemal titres before treatment for CS prediction were 1:24, 1:12 and 1:6, respectively. For convenience of use in clinical practice, the optimal cut-off values were changed to 1:32, 1:16 and 1:8 for groups 1a, 1b and 2, respectively.
Figure 3 and table 5 show the diagnostic values of non-treponemal titres for CS in the three groups. We found that non-treponemal titres (≥1:16) in group 1b had the highest predictions for CS with an AUC of 0.87 (95% CI 0.82 to 0.93) and a maximum Youden’s index of 0.73. Notably, there were significant differences between the AUCs of group 1b and group 2 (p=0.01) and between those of group 1a and group 1b (p=0.01). However, there was no difference between the AUCs of group 1a and group 2 (p=0.23).
ROC curves of timing of maternal syphilis treatment in three groups. AUC, area under the curve; ROC, receiver operating characteristic.
The diagnostic values of non-treponemal titres before treatment for CS stratified by three treatment groups
Discussion
This study is the first to find that maternal non-treponemal titres before treatment combined with timing of antisyphilis treatment during pregnancy could be used as surrogate indicators for the diagnosis of CS. We also found that untreated syphilis-seropositive women with non-treponemal titres higher than 1:8 had the highest PPV for their babies having CS.
Despite the effort to improve patients’ compliance, increase rates of follow-up testing and reduce misdiagnosis of CS by healthcare professionals, many practical challenges exist. These challenges include a lack of manpower and financial resources or parents’ busy schedules that lead to lost to follow-up. In practice, the detection of CS can be challenging because of complex diagnostic criteria.25 30 31 Our new screening algorithm has the potential to simplify the diagnosis of CS and subsequently allow cost-effective follow-up strategies.
CS occurs when mothers with syphilis are inadequately or not treated. Our study found that 13.6% of the children born to untreated mothers developed CS, which is similar to previous studies.22 32 Using our new algorithm based on timing of initiating treatment before or after 28 weeks gestation, the cut-off values of non-treponemal titres before treatment were different, as well as PPV and NPV of CS.
Most pregnant women with syphilis are asymptomatic,33 and the duration of syphilis infection is uncertain. Therefore, it is clinically difficult to determine whether they have early or late latent syphilis. That is why we selected the non-treponemal titre as another surrogate indicator. Our findings show that maternal non-treponemal titres alone could be an alternative predictor of CS diagnosis, with an optimal cut-off value of 1:8. High titres of non-treponemal antibodies (≥1:8) represent significant fetal exposure to Treponema pallidum.11 The persistence of low titres (<1:8), indicating the presence of serological scarring,34 reduces the risk of vertical transmission.
The risk of vertical transmission is higher when lack of maternal antisyphilis treatment is combined with high non-treponemal titres.11 After combining the maternal non-treponemal titres and timing of antisyphilis treatment, we found that the cut-off value of non-treponemal titres became lower and the PPV became larger, with more delays of mother’s treatment initiation. Like other studies,35 children born to mothers with untreated syphilis were more likely to develop CS when maternal non-treponemal titres were high (≥1:8). Initiating antisyphilis treatment after 28 GWs with non-treponemal titres≥1:16 had a sensitivity of 100% and a specificity of 81.9% to predict CS in children born to these women. This is consistent with previous findings in which 1:16 was used as the cut-off value for high non-treponemal titres for pregnant women initiating treatment less than 4 weeks before delivery.36 In addition, our findings show that if pregnant women with syphilis started antisyphilis treatment before 28 weeks of gestation, the lowest serological titre for CS was 1:32 and PPV was the lowest (4.2%). Results of a randomised trial showed that benzathine penicillin G (BPG) administered to high-risk newborns born to mothers with untreated syphilis whose non-treponemal titre was higher than 32 was effective.37 The likelihood of fetal infection is influenced by maternal non-treponemal titres and the duration of fetal exposure.34
For syphilis, validation of WHO criteria was difficult due to a lack of reliable data about CS.38 Our study suggests that the combination of timing of antisyphilis treatment and non-treponemal titres has high predictive ability (reflected as a high NPV) and could be used as a useful clinical tool to exclude CS. About 99.5% (99.1%–99.9%) of children born to syphilis-seropositive mothers would not be infected with syphilis, if their mothers received treatment before 28 weeks of gestation and the non-treponemal titres before treatment were less than 1:32. When pregnant women received antisyphilis therapy after 28 GWs and non-treponemal titres before treatment were lower than 1:16, their children were unlikely to have CS. Therefore, reviewing maternal non-treponemal titres and timing of treatment can help clinicians focus on strengthening the management for high-risk individuals for CS.
Given the gaps in the follow-up and management of syphilis-exposed children and lack of efficient diagnostic measures, our study provided a new approach for risk stratification of CS in syphilis-exposed children. For newborn infants at high risk of CS, standardised treatment (aqueous benzylpenicillin 100 000–150 000 U/kg/day intravenously for 10–15 days or procaine penicillin 50 000 U/kg/day as a single dose intramuscularly for 10–15 days39) can be used soon after delivery to eradicate the disease. Given the shortage of BPG globally, especially in resource-limited areas,40 it is important to ensure that children at high risk of CS receive priority treatment.
Some limitations of this study should be noted. First, the small number of CS cases might have limited the statistical power, resulting in a relatively low PPV of CS. Second, the lost to follow-up rate of syphilis-exposed children was high, reducing the representativeness of our target population. Third, because the focus of this study was to diagnose or exclude CS after birth, the CS cases in this study excluded miscarriages and stillbirths caused by syphilis infection, limiting the prediction of CS incidence in miscarriages and stillbirths. Therefore, further studies in a larger number of patients, including miscarriages and stillbirths, are needed to increase prediction accuracy.
Conclusion
We provide a new algorithm to facilitate clinical decision-making and CS diagnosis. This new algorithm could be used to predict the probabilities of CS and non-CS in children based on maternal non-treponemal titres before treatment and timing of therapy during pregnancy. In addition, the algorithm could also be used to identify children at high-risk or low-risk for CS. Using this new algorithm, we hope to make the follow-up of syphilis-exposed children more manageable and effective.
Ethics statements
Patient consent for publication
Ethics approval
This study was approved by the Ethics Approval Board of Guangzhou Women and Children’s Medical Center (202046801).
Acknowledgments
We thank all pregnant women and their children for their participation in the study. We are grateful to the obstetric and paediatric care providers who have assisted the implementation of the PMTCT program.
References
Footnotes
S-FL and SZ contributed equally.
Correction notice This article has been corrected since it first published. The provenance and peer review statement has been included.
Contributors FH conceived the study, provided funding and drafted manuscript. J-JL and S-JG revised the paper. Y-YS and N-XH coordinated and supervised data collection. S-FL and SZ conceived the study. All authors were involved in the data interpretation and contributed to drafting and revision of the paper. All authors read and approved the final manuscript.
Funding The project was supported by The AbbVie Foundation for Maternity and Child Care and Prevention of Mother-to-child Transmission Chinese Association of STD and AIDS Prevention and Control (2020PMTCT-S6) and Guangzhou Institute of Pediatrics/Guangzhou Women and Children’s Medical Center (YIP-2019-001).
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.