Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

The development and validation of a diagnostic scoring system to differentiate pulmonary tuberculosis from non-tuberculosis pulmonary infections in HIV-infected patients with severe immune suppression

BMC Infectious Diseases volume 21, Article number: 863 (2021) Cite this article

Abstract

Background

It remains challenging to differentiate tuberculosis (TB) from non-TB pulmonary infections in HIV-infected patients. Herein, we developed a scoring system aimed to rapidly determine the likelihood of TB or non-TB pathology in HIV-infected patients presenting with pulmonary infections.

Methods

We collected and collated data of hospitalized HIV-infected patients with pulmonary infections, followed by univariate and multivariate data analyses to determine risk variables that were significantly different between HIV/TB patients and HIV/non-TB patients. Subsequently, a regression coefficient was calculated for each variable, and a score was assigned to each variable in line with its regression coefficient. The sum of the scores for each variable in our scoring model was used to predict the likelihood of TB or non-TB pulmonary infection in each patient. Finally, we tested the diagnostic accuracy of the scoring system in our retrospective cohort, as well as in a prospective cohort.

Results

A total of 598 HIV-infected patients were enrolled in our retrospective cohort, among whom 288 had TB and 310 had non-TB pulmonary infections. Eight variables, including fever, highest body temperature, erythrocyte sedimentation rate (ESR), cervical lymphadenopathy, hilar and/or mediastinum lymphadenopathy, pulmonary cavitation, pleural effusion, and miliary nodules, were found to be mathematically significantly different via univariate analysis and multivariate logistic regression analysis. After regression coefficient calculation followed by score assignment, a receiver operating characteristic (ROC) curve was plotted, and the area under the curve (AUC) was calculated to be 0.902. When the total score for a patient is > 12, the sensitivity and specificity for TB prediction using our scoring system were 76.4% and 87.7% respectively in the retrospective cohort, and its diagnostic accuracy was 82.7% in the prospective cohort.

Conclusions

Our results demonstrate that our proposed diagnostic scoring system could be helpful in differentiating pulmonary TB from non-TB pulmonary infections in HIV-infected patients.

Peer Review reports

Background

Human immunodeficiency virus (HIV) infection and tuberculosis (TB) are two major communicable diseases that threaten human health globally. In 2019, about 10 million people developed TB globally, and among them, 8.2% of these individuals were people living with HIV. Moreover, there were an estimated 1.2 million TB deaths among HIV-negative people in 2019, and an additional 208,000 TB deaths among HIV-positive people [1].

As is well established, HIV-infected patients are susceptible to various opportunistic infections as a consequence of a paucity of adequate cellular immunity, among which TB remains the leading cause of hospitalization and death among people living with HIV [2]. For co-infected individuals, the two pathogens, Mycobacterium tuberculosis (MTB) and HIV, pose a dual threat which creates a vicious cycle of immune dysfunction among these individuals. On the one hand, MTB increases HIV viral load and genetic mutation, accelerates CD4 + T-cell depletion, and leads to progressive HIV disease [3, 4]. On the other hand, HIV results in a 2–20 times increased risk of TB above baseline rates, and causes more cases of multi-drug resistant TB [3, 4].

Early establishment of TB diagnosis and effective anti-tuberculosis treatment followed by antiretroviral therapy are key steps for the survival of patients co-infected with HIV and TB. However, early diagnosis of TB remains challenging in HIV/TB co-infected patients with advanced immunodeficiency owing to the following reasons: (1) the clinical features and chest radiographic presentations of these patients are often atypical; (2) sputum smear-negative TB is common in those with advanced immunodeficiency and noncavitary disease [5]; (3) sputum culture is time-consuming and may be inaccessible in many resource-limited regions.

In this study, we aimed to establish a scoring system for the diagnosis of TB in HIV-infected patients with advanced immunodeficiency, and evaluate its overall predictive accuracy.

Materials and methods

Study method

This study included retrospective and prospective cohorts. The selection criteria for our retrospective cohort were as follows: (1) HIV-infected patients admitted to the Division of Infectious Diseases of Chongqing Public Health Medical Center; (2) Diagnosis of HIV/AIDS was consistent with Chinese Guidelines for Diagnosis and Treatment of HIV/AIDS [6]; (3) Aged 18–65 years; (4) Received chest computerized tomography (CT) imaging examination; (5) Co-existing pulmonary infections; (6) The requisite case records were complete and traceable.

Confirmation of TB was based on positive sputum or bronchoscopic lavage fluid smear results and/or positive culture results, and positive clinical response to anti-tuberculosis treatment; the diagnostic criteria for non-TB pulmonary infectious diseases (e.g., viral, fungal, bacterial pneumonia) were based on negative sputum or bronchoscopic lavage fast-acid smear results, negative MTB culture results, positive results of the corresponding pathogenic organism, and having no evidence for TB infection for at least one year after discharge from hospital.

Firstly, we retrospectively collected and collated the demographic and clinical data, and chest CT scan results of HIV-infected patients with confirmed TB co-infection (HIV/TB patients) and HIV-infected patients with pulmonary infections caused by pathogens other than MTB (HIV/non-TB patients). These were the first data collected when the patients were admitted to hospital. Weight loss was defined as no less than 5% weight loss from positive symptoms to admission [7]. Highest body temperature was that detected during the hospitalization period. Pulmonary cavitation, pulmonary lesion, effusion, and lymphadenopathy were identified on CT imaging. Lymphadenopathy was defined as the short axis diameter of a lymph node exceeding 10 mm on CT examination [8, 9].

The demographic, clinical, and chest CT data of these patients were compared by univariate data analysis. Mathematical differences in risk variables between the two groups of patients were deemed to be statistically significant if the calculated p value was found to be < 0.05. Subsequently, the significant continuous variables in the univariate analysis were discretized, and were assigned discrete values for different weighted levels of a particular variable.

Subsequently, we conducted a multivariate logistic regression analysis of all significant variables obtained via univariate analysis, including categorical variables and discretized variables, further identifying the variables that were significantly different between the two groups of patients. These significant variables after multivariate analysis were incorporated in the scoring system.

Moreover, during the course of multivariate logistic regression analysis, a regression coefficient was generated for these variables. A score would be assigned for each eligible variable according to its regression coefficient. The variable with the lowest regression coefficient was assigned a score of 1. Scores of other variables were linearly calculated (in units of 0.5) according to their regression coefficient ratios relative to that of the variable assigned a score of 1. The sum of the scores of all the variables indicates the likelihood of TB. Finally, a receiver operating characteristic (ROC) curve was plotted to decide the optimal cut-off scores that would distinguish TB and non-TB pulmonary pathology, depending on specificity and sensitivity.

Subsequent to the scoring system being established, we tested its accuracy in the retrospective cohort, as well as in a prospective cohort presenting with HIV infection and co-existing pulmonary infections. Written informed consent was required for each participant in the prospective cohort. Other selection criteria for the prospective cohort were the same as that of participants in the retrospective cohort. The study flowchart is illustrated in Fig. 1.

Fig. 1
figure 1

Flow chart of the study. *For 2742 cases presenting with pulmonary infections in the retrospective cohort, 2144 patients did not meet the selection criteria. Among them, 488 patients were excluded as they were younger than 18 years or older than 65 years of age. The remaining 1656 patients were excluded as requisite data were missing, among which were 98 for CT, 620 for ESR, 593 for PCT, 68 for CD4 + T-cell count, 193 for HIV RNA, 169 for ALB, and 138 for microorganism evidence. #For 755 cases in the prospective cohort, 419 patients were excluded as requisite data were missing, among which were 13 for CT, 145 for ESR, 143 for PCT, 18 for CD4 + T-cell count, 43 or HIV RNA, 44 for ALB, and 32 for microorganism evidence

Full size image

Statistical analysis

Statistical data analysis was performed using Statistical Package for the Social Sciences (SPSS) 23.0 software (IBM, Armonk, NY). Differences between HIV/TB patients and HIV/non-TB patients were analyzed using the Mann–Whitney U test for numerical variables and the Chi-square test for categorical variables, with a value of p < 0.05 being considered statistically significant. Backward logistic regression analysis was utilized to further select variables that were significantly different (p < 0.05) between the two groups of patients, to obtain a regression coefficient, and assign a score for each variable.

Results

Patients and diagnoses

As shown in Fig. 1 and Table 1, 598 patients were included in our retrospective analysis, of which 288 were HIV-infected patients with confirmed TB co-infection (HIV/TB patients) and 310 were HIV-infected patients with non-TB pulmonary infections (HIV/non-TB patients). Most TB case confirmation (244/288) was based on combined positive culture and positive smear results, 6 cases were based on positive culture results only, and the diagnostic status of the remaining 38 cases was based on their positive smear results only. Moreover, all 288 patients exhibited a positive response to diagnostic anti-tuberculosis treatment. Among the non-TB group, fungal infection (52.58%) was the most common infection, followed by bacterial infection (40.00%), and viral infection (7.42%). When admitted, only a small proportion of subjects were receiving antiretroviral therapy (ART) (14.60% in the TB group and 19.70% in the non-TB group). Most subjects were highly immunodeficient (CD4 + T-cell count < 200 cells/μL), specifically 92.71% (267/288) in the TB group and 88.39% (274/310) in the non-TB group. All patients were admitted to the Division of Infectious Diseases of the Chongqing Public Health Medical Center between January 2015 and December 2017.

Table 1 Comparison of variables between HIV/TB patients and HIV/non-TB patients by univariate analysis
Full size table

Screening of potentially eligible variables for further analysis

We compared the mathematical differences of 24 risk variables between the two groups, using the Mann–Whitney U test for numerical variables and the Chi-square test for categorical variables. To avoid excluding potential variables that may differ between the two groups, we considered a p value of < 0.05 as being statistically significant, and included all variables with a p value of < 0.05 for further analysis.

As shown in Table 1, our univariate data analysis showed that the differences among 15 variables between HIV/TB patients and HIV/non-TB patients were statistically significant (p < 0.05), whereas 9 variables were not. The 15 statistically significant variables included age, hemoglobin, albumin, erythrocyte sedimentation rate (ESR), procalcitonin (PCT), fever, highest body temperature, number of infected pulmonary lobes, solid lesion, pulmonary cavitation, pulmonary effusion, cervical lymphadenopathy, hilar and/or mediastinal lymphadenopathy, pericardial effusion, and miliary nodules.

Discretization of numerical variables

Among the 15 variables with a p value of < 0.05, there were seven numerical variables which needed to be discretized for further analysis. The discretization of the seven numerical variables is shown in Table 2. Each of the numerical variables was assigned an integer value of 0 to 4 based on their individual discretized ranges.

Table 2 Discretization of numerical variables
Full size table

Multivariate logistic regression analysis and establishment of the scoring model

Based on the seven discretized variables and the other eight significantly different categorical variables, multivariate logistic regression analysis was carried out to further identify the differences between the two groups. Among these 15 variables, eight variables were observed to be significantly different (p < 0.05, Table 3), suggesting that these parameters could be applied to distinguish TB from non-TB infections in HIV-infected patients.

Table 3 Backward logistic regression analysis of 15 variables and score assignment
Full size table

These eight variables were therefore incorporated into the scoring model, in which, ESR was assigned a score of 1, as its regression coefficient was the lowest. Scores of other seven variables were linearly calculated (in units of 0.5) according to their regression coefficient ratios relative to that of ESR. The score assignment for each variable is shown in Table 3. The sum of the scores of each of the eight variables results in a total score, which represents the likelihood of TB, with a higher score indicating a higher probability of MTB infection.

Model assessment in the retrospective cohort

The score distribution of 598 HIV-infected patients with TB or non-TB pulmonary infection in this retrospective cohort ranged between 2.5 and 32 (Fig. 2A, C and E). The total score of the TB group was 16.64 ± 6.00, significantly higher than that of the non-TB group (7.74 ± 3.59, p < 0.01). As shown in the Fig. 3, the specificity increased while sensitivity decreased gradually, when decision threshold increased, with the AUC of the ROC curve being 0.902 (p < 0.001, Fig. 3). We chose a total score greater than 12 as the optimal cut-off score. When this cut-off value was applied to the data from the cohort of 598 HIV-infected patients, the sensitivity and specificity of our scoring model was 76.4% (95% CI, 70.9%-81.1%) and 87.7% (95% CI, 83.4%-91.1%), respectively, and its Youden index {(sensitivity + specificity)-100}, which measures the performance of our scoring system, was 64.13%, indicating that our novel scoring model is effective for differentiating TB from non-TB pulmonary infection in HIV-infected patients.

Fig. 2
figure 2

The score distribution of HIV-infected patients with TB and non-TB pulmonary infection in the retrospective and prospective cohorts. A, C and E: Retrospective cohort (n = 598); B, D and F: Prospective cohort (n = 336); G and H: Retrospective cohort (n = 560) and prospective cohort (n = 319), 38 cases and 17 cases respectively who were diagnosed as TB by smear-positivity and clinical response after anti-TB treatment, were excluded

Full size image
Fig. 3
figure 3

Receiver operator characteristic (ROC) curve for the scoring system. Each data point on the ROC curve represents a sensitivity/specificity pair corresponding to a particular decision threshold. The area under the ROC curve is a measure of how well a parameter can distinguish between two groups (TB/non-TB). AUC area under the ROC curve

Full size image

Furthermore, to facilitate the application of this scoring model in a clinical context, we stratified 598 HIV-infected patients into three groups (“TB unlikely”, “suspected TB”, “highly-suspected TB”), depending on their respective likelihood ratios (Table 4). “TB unlikely” was defined by patient scores ≤ 7.5, where the corresponding negative likelihood ratios were below 0.1 (0.08). As shown in Fig. 4A, there were 188 patients whose scores were ≤ 7.5 in the retrospective cohort, 175 (93.1%) of which were confirmed as non-TB patients. On the other hand, “highly-suspected” TB was defined by patient scores > 13.5, where the corresponding positive likelihood ratios were above 10 (10.55). There were 216 “highly-suspected TB” cases in the retrospective cohort, 196 (90.7%) of which were proven to be TB patients (Fig. 4A). However, when the score was located in the range between 8.0 and 13.5, the category of patients proved difficult to define using our scoring model, and these patients were defined as “suspected TB”.

Table 4 Parameters of the scoring model using different cut-off scores as decision thresholds
Full size table
Fig. 4
figure 4

Number of patients in the three groups (TB unlikely, suspected TB, highly-suspected TB). TB unlikely: scores ≤ 7.5; suspected TB: scores 8–13.5; highly-suspected TB: scores > 13.5. A Retrospective cohort (n = 598); B Prospective cohort (n = 336)

Full size image

When each group was stratified according to CD4+ T-cell count, it was found that cavitation was significantly less common in those HIV-infected persons with CD4+ T-cell counts < 200 cells/μL than those with CD4+ T-cell counts ≥ 200 cells/μl, in both the TB group (10.86 vs 33.33%) and the non-TB group (2.55 vs 5.56%). For those with CD4+ T-cell counts < 200 cells/μl, as shown in Fig. 2C, the total score of the TB group was 16.94 ± 5.94, which is significantly higher than that of the non-TB group (7.84 ± 3.65, p < 0.01). The sensitivity and specificity of our scoring model for this specific subgroup was 77.90 and 86.5% respectively. For those with CD4+ T-cell counts ≥ 200 cells/μl, the total score of the TB group was 12.79 ± 5.37, which is also significantly higher than that of the non-TB group (7.03 ± 2.93, p < 0.01). The sensitivity and specificity of the scoring model in this subgroup was 57.14% and 97.22%.

It is worth noting that there were seven cases of non-tuberculous mycobacteria (NTM) in our cohort, and they were all identified as non-TB cases according to our scoring system, as their scores were not greater than 12. Moreover, once the 38 cases who were diagnosed as TB by smear-positivity and clinical response after anti-TB treatment were excluded, 76.40% of TB participants were identified as TB cases according to our scoring system (Fig. 2G), indicating that whether the 38 cases were excluded or not, the sensitivities were virtually identical {76.40% (191/250) vs 76.39% (220/288)}.

Model Assessment in the prospective cohort

In order to establish the validity of the scoring model, 336 HIV-infected patients were included in a prospective cohort, of which 142 were confirmed as TB co-infection (HIV/TB patients) and 194 were non-TB pulmonary infections (HIV/non-TB patients). The majority of TB cases confirmation (125/142) was based on combined positive culture and positive smear results, and that of the remaining 17 cases was based on positive smear results only. All 142 patients had a positive response to diagnostic anti-tuberculosis treatment. In this prospective cohort, 47.89% in TB group and 30.41% in the non-TB group were treated with ART when they were admitted. Regarding CD4+ T-cell counts, 91.55% of cases (130/142) in the TB group and 89.69% of cases (174/194) in the non-TB group were highly immunodeficient.

Similar to the retrospective cohort, the total risk score in the TB group was significantly higher than that of the non-TB group (Fig. 2B, D, F and H, p < 0.01). When a total score of > 12 was used as the identifying criterion, the sensitivity and specificity of our scoring model was 85.2% and 80.9%, respectively, and its Youden index was 66.10%, further indicating that our scoring model is indeed effective for differentiating TB from non-TB pulmonary infection in HIV-infected patients.

Furthermore, these 336 patients were divided into a “TB unlikely” group, a “suspected TB” group, and a “highly-suspected” TB group. In the “suspected TB” group (7.5 < score ≤ 13.5), it remained difficult to identify TB from non-TB infections using our scoring model. However, our scoring system has been validated, with high predictive accuracy in the “TB unlikely” group and the “highly-suspected TB” group. There were 75 patients in the “TB unlikely” group (scores ≤ 7.5), of which 62 (82.7%) were confirmed as non-TB patients (Fig. 4B). Of the 134 patients in the “highly-suspected TB” group whose scores were > 13.5, 116 (86.6%) patients were confirmed as TB patients (Fig. 4B).

In this prospective cohort, cavitations were also associated with CD4+ T-cell counts. Compared to those HIV-infected individuals with CD4+ T-cell counts < 200 cells/μl, those with CD4+ T-cell counts ≥ 200 cells/μl were more likely to present with cavitations, either in the TB group (41.67 vs 13.80%) or the non-TB group (5.00% vs 4.60%). For the those with CD4 + T-cell counts < 200 cells/μl, the total score of the TB group was 19.39 ± 7.13, which was significantly higher than that of the non-TB group (9.16 ± 3.32, p < 0.01). The sensitivity and specificity was 86.2% and 79.3%, respectively, when the scoring model was applied in this subclass. Regarding those with CD4+ T-cell counts ≥ 200 cells/μl, the total score of the TB group was 18.71 ± 8.47, which was also significantly higher than that of the non-TB group (7.95 ± 3.15, p < 0.01). The sensitivity and specificity of the scoring model was 75.0% and 95.0%, respectively, for this population.

Discussion

This study aimed to establish a diagnostic scoring system to accurately differentiate a possible diagnosis of pulmonary TB from a possible diagnosis of non-TB infection in HIV-infected patients. Although Xpert®MTB/RIF and sputum smear in concentrated form can distinguish between MTB and other infections, these technologies are not available in many resource-limited regions, and our proposed scoring system is useful in such scenarios. Several risk variables with different weights were incorporated and used in this model. The scoring model has been validated, and shows high specificity and sensitivity in the retrospective cohort as well as in the prospective validation cohort. Moreover, it is possible that all variables utilized by the scoring model can be acquired on the first day of hospital admission, making our scoring model a rapid and accurate diagnostic method. This novel scoring system could be used as an auxiliary diagnostic pathway, and effectively circumvent the limitations of current diagnostic technologies in a clinical setting, especially so in resource-limited settings.

In clinic, culture of MTB is considered the current reference standard for TB diagnosis [10]. However, culture requires sophisticated laboratory infrastructure and trained personnel [11, 12]. Moreover, the time required for culture growth is tediously long (10–21 days), which may unduly delay "timeous" critical decisions concerning patient treatment, especially in HIV-infected patients whose immunity is already compromised [11]. Smear microscopy is an inexpensive and rapid test with high specificity for TB diagnosis, while its sensitivity is disappointingly low, ranging between 35 and 80% [12,13,14]. Beside these conventional laboratory diagnostic techniques, molecular diagnostic tests, including the loop-mediated amplification test (LAMP), the GeneXpert assay, and the urine lipoarabinomannan (LAM) lateral flow assay have also been developed, and are used in establishing a diagnosis of TB in HIV-infected patients [15,16,17,18]. However, these molecular tests also have some limitations, such as requiring high-quality samples or sophisticated infrastructure, and lacking sensitivity. A study by Yuan et al. [19] (reporting in a meta-analysis that included 10 studies, with1920 suspected TB specimens), indicated an 80.0% sensitivity and 96.0% specificity for LAMP in the diagnosis of pulmonary TB. However, in HIV-infected patients, a lower sensitivity of 65% (95%CI: 48–79%) was observed when using LAMP [20]. Furthermore, diagnostic therapy using anti-tuberculosis agents is time-consuming and has low sensitivity, as these agents, such as rifampicin and pyrazinamide, are antibiotics, and their antimicrobial spectrum extends beyond MTB. Thus, in addition to current diagnostic techniques, the establishment of a simple, rapid, accurate and sensitive clinical diagnostic method for the early diagnosis of TB in HIV patients has become a research priority.

Diagnostic scoring systems are generally used to diagnose diseases or conditions without specific, disease-defining symptoms or signs, such as autoimmune hepatitis (AIH), disseminated intravascular coagulation (DIC), and the estimation of bleeding risk [21,22,23,24,25,26,27]. For HIV-infected patients, it is more difficult to differentiate pulmonary TB from non-TB pulmonary infections. Jarvis et al. reported a case of HIV-associated pulmonary cryptococcosis who was misdiagnosed as smear-negative pulmonary tuberculosis, which unfortunately had fatal consequences [28]. Shi et al. reported 24 HIV-infected patients who were misdiagnosed with lung cancers, of which 19 patients (79.2%) had tuberculosis [29].

In our study, we have developed and validated a diagnostic scoring system whose sensitivity and specificity exceeded 75%, in order to differentiate pulmonary TB from non-TB pulmonary infections in the context of pre-existing HIV infection. In this model, the risk variable of “miliary nodules” is assigned the largest scoring weight, with a score of 9.5. Miliary nodules have been described as a typical radiological manifestation of disseminated TB. They can also occur in a wide variety of other conditions [30,31,32,33]. In South Korea, a TB endemic region, the most common differential diagnoses for radiological miliary nodules are miliary TB (54%) and miliary metastases of malignancies (26%) [34]. A study in the US, which has low TB endemicity, also revealed that TB is the most common etiology for radiological miliary nodules (28.3%), followed by sarcoidosis, silicosis, and extra-thoracic malignancies [35]. Our results included 78 patients who had miliary nodules, 76 of whom were confirmed to have TB, and two who were confirmed as having non-TB pulmonary infection. Thus, the identification of miliary nodules was recognized as an important diagnostic factor for TB in our model. Moreover, pulmonary cavitation is also a classic hallmark of TB, and they are frequently present in patients diagnosed with pulmonary TB [36, 37]. These cavities offer an ideal growth environment for MTB, as the cavitary wall can limit drug penetration, and the presence of cavitary lesions has been shown to be associated with longer times for sputum culture conversion, and higher rates of treatment failure and relapse [38,39,40,41]. It is worth noting that cavitation is presented with thinner wall and is less prevalent in HIV-infected individuals with TB, and the incidence has been reported to range between 16 and 48% in this cohort, whereas more than 50% of immunocompetent pulmonary TB patients present with cavities [42,43,44,45,46]. Nevertheless, pulmonary cavitation is a distinct feature of patients with TB infection. In the present study, the incidence of pulmonary cavities in HIV-infected patients with TB (ranging between 10.86 and 41.67%) was significantly higher than that in non-TB subgroups (ranging between 2.55 and 5.56%), and thus this variable was allocated the second largest weight in our scoring model, with a score of 5.0. Other than miliary nodules and pulmonary cavities, the other 6 TB-associated variables which were obviously statistically different between the TB group and the non-TB group, were incorporated in our model, including fever, highest body temperature, ESR, cervical lymphadenopathy, hilar and/or mediastinum lymphadenopathy, and pleural effusion.

Based on our data, we propose that, using our diagnostic scoring system, patients with a total score greater than 12 have a significantly higher probability to have TB, and clinicians should consider initiating anti-tuberculous therapeutic drug regimens to these patients even if smear or culture positivity has not been established, thereby not delaying treatment. Conversely, patients with a score of no more than 12 have a relatively lower likelihood of a diagnosis of pulmonary TB, suggesting that clinicians exercise due diligence in the quest for other potential pulmonary pathogens. In addition, our diagnostic scoring system may be combined with the results of the likelihood ratio calculations, which reflects both sensitivity and specificity. When the positive likelihood ratio is above 10 (scores > 13.5), the diagnosis of TB is highly reliable, and when the negative likelihood ratio is lower than 0.1 (scores ≤ 7.5), this indicates that the patient is more likely infected with a lung pathogen other than MTB.

We acknowledge that our study has limitations, as the scoring system is less efficacious when the scores of patients ranged between 7.5 and 13, and if a patient’s score lies within this range, clinicians should resort to other, more specific, diagnostic methods to establish a definitive diagnosis. In addition, as the establishment of the scoring system was based on a retrospective design, some bias might exist. Moreover, as the diagnosis of TB was based on microbiological evidence and the effectiveness of diagnostic anti-tuberculosis treatment, we nevertheless may not have completely eliminated all false-positive errors. Finally, all the study participants were infected by MTB or by another opportunistic pathogenic microorganism, and thus were admitted to our hospital. All of the participants were AIDS patients, thus CD4+ T-cell counts for these patients were expectedly low (1–1252 cells/μl) in this study. Collectively, this study suggests that our scoring system is a viable means to distinguish between TB and other infections in Chinese AIDS patients.

Conclusions

In this study, we developed a rapid diagnostic scoring system which could be helpful in differentiating pulmonary TB from non-TB pulmonary infections in HIV-infected patients. This novel scoring system could be used as an auxiliary diagnostic pathway, and effectively circumvent the limitations of current diagnostic technologies in a clinical setting, especially in the absence of facilities for MTB culture or Xpert®MTB/RIF. It has been validated, and showed high specificity and sensitivity in the retrospective cohort as well as in the prospective validation cohort. However, the clinical implications of this scoring model should be assessed in larger cohorts, and should include HIV positive and negative participants from different age groups and ethnicities. In addition, further investigations should be conducted to differentiate and ascertain the causes of pulmonary infections in HIV-infected patients when the scoring system does not support a TB diagnosis.

Availability of data and materials

The datasets studied and/or analyzed during the present study is available from the corresponding author on reasonable request.

Abbreviations

ART:

Antiretroviral therapy

AUC:

Area under the curve

AIH:

Autoimmune hepatitis

DIC:

Disseminated intravascular coagulation

ESR:

Erythrocyte sedimentation rate

HIV:

Human immunodeficiency virus

LAM:

Lipoarabinomannan

LAMP:

Loop-mediated amplification test

MTB:

Mycobacterium tuberculosis

PCT:

Procalcitonin

ROC:

Receiver operating characteristic

TB:

Tuberculosis

References

  1. WHO. Global tuberculosis report 2020. 2020. https://apps.who.int/iris/bitstream/handle/10665/336069/9789240013131-eng.pdf. Accessed 5 Feb 2021.

  2. Rebouças MC, Silva MOD, Haguihara T, Brites C, Netto EM. Tuberculosis incidence among people living with HIV/AIDS with virological failure of antiretroviral therapy in Salvador, Bahia, Brazil. Braz J Infect Dis. 2017;21(5):562–6.

    Article  PubMed  Google Scholar 

  3. Bell LCK, Noursadeghi M. Pathogenesis of HIV-1 and Mycobacterium tuberculosis co-infection. Nat Rev Microbiol. 2018;16(2):80–90.

    Article  CAS  PubMed  Google Scholar 

  4. Shankar EM, Vignesh R, Ellegård R, Barathan M, Chong YK, Bador MK, et al. HIV-Mycobacterium tuberculosis co-infection: a “danger-couple model” of disease pathogenesis. Pathog Dis. 2014;70(2):110–8.

    Article  CAS  PubMed  Google Scholar 

  5. Elliott AM, Halwiindi B, Hayes RJ, Luo N, Tembo G, Machiels L, et al. The impact of human immunodeficiency virus on presentation and diagnosis of tuberculosis in a cohort study in Zambia. J Trop Med Hyg. 1993;96(1):1–11.

    CAS  PubMed  Google Scholar 

  6. [Chinese guidelines for diagnosis and treatment of HIV/AIDS (2018)]. Zhonghua Nei Ke Za Zhi. 2018;57(12):867–84.

  7. WHO. Latent tuberculosis infection-Updated and consolidated guidelines for programmatic management. 2018. http://apps.who.int/iris/bitstream/handle/10665/260233/9789241550239-eng.pdf?sequence=1. Accessed 10 Dec 2020.

  8. Glazer GM, Gross BH, Quint LE, Francis IR, Bookstein FL, Orringer MB. Normal mediastinal lymph nodes: number and size according to American Thoracic Society mapping. AJR Am J Roentgenol. 1985;144(2):261–5.

    Article  CAS  PubMed  Google Scholar 

  9. Hansell DM, Bankier AA, MacMahon H, McLoud TC, Müller NL, Remy J. Fleischner Society: glossary of terms for thoracic imaging. Radiology. 2008;246(3):697–722.

    Article  PubMed  Google Scholar 

  10. Turnbull L, Bell C, Child F. Tuberculosis (NICE clinical guideline 33). Arch Dis Child Educ Pract Ed. 2017;102(3):136–42.

    Article  PubMed  Google Scholar 

  11. Méndez-Samperio P. Diagnosis of tuberculosis in HIV Co-infected individuals: current status, challenges and opportunities for the future. Scand J Immunol. 2017;86(2):76–82.

    Article  PubMed  Google Scholar 

  12. Carriquiry G, Otero L, González-Lagos E, Zamudio C, Sánchez E, Nabeta P, et al. A diagnostic accuracy study of Xpert®MTB/RIF in HIV-positive patients with high clinical suspicion of pulmonary tuberculosis in Lima, Peru. PLoS ONE. 2012;7(9):e44626.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Mathew P, Kuo YH, Vazirani B, Eng RH, Weinstein MP. Are three sputum acid-fast bacillus smears necessary for discontinuing tuberculosis isolation? J Clin Microbiol. 2002;40(9):3482–4.

    PubMed  PubMed Central  Google Scholar 

  14. Desikan P. Sputum smear microscopy in tuberculosis: is it still relevant? Indian J Med Res. 2013;137(3):442–4.

    PubMed  PubMed Central  Google Scholar 

  15. Ling DI, Flores LL, Riley LW, Pai M. Commercial nucleic-acid amplification tests for diagnosis of pulmonary tuberculosis in respiratory specimens: meta-analysis and meta-regression. PLoS ONE. 2008;3(2):e1536.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  16. Zumla A, Raviglione M, Hafner R, von Reyn CF. Tuberculosis. N Engl J Med. 2013;368(8):745–55.

    Article  CAS  PubMed  Google Scholar 

  17. LaCourse SM, Pavlinac PB, Cranmer LM, Njuguna IN, Mugo C, Gatimu J, et al. Stool Xpert MTB/RIF and urine lipoarabinomannan for the diagnosis of tuberculosis in hospitalized HIV-infected children. AIDS (London, England). 2018;32(1):69–78.

    Article  Google Scholar 

  18. Mthiyane T, Peter J, Allen J, Connolly C, Davids M, Rustomjee R, et al. Urine lipoarabinomannan (LAM) and antimicrobial usage in seriously-ill HIV-infected patients with sputum smear-negative pulmonary tuberculosis. J Thorac Dis. 2019;11(8):3505–14.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Yuan LY, Li Y, Wang M, Ke ZQ, Xu WZ. Rapid and effective diagnosis of pulmonary tuberculosis with novel and sensitive loop-mediated isothermal amplification (LAMP) assay in clinical samples: a meta-analysis. J Infect Chemother. 2014;20(2):86–92.

    Article  PubMed  Google Scholar 

  20. Nliwasa M, MacPherson P, Chisala P, Kamdolozi M, Khundi M, Kaswaswa K, et al. The sensitivity and specificity of loop-mediated isothermal amplification (LAMP) assay for tuberculosis diagnosis in adults with chronic cough in Malawi. PLoS ONE. 2016;11(5):e0155101.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  21. Czaja AJ. Diagnosis and management of autoimmune hepatitis: current status and future directions. Gut and liver. 2016;10(2):177–203.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. McFarlane IG. Autoimmune hepatitis: clinical manifestations and diagnostic criteria. Can J Gastroenterol Hepatol. 2001;15(2):107–13.

    CAS  Google Scholar 

  23. Uchida G, Nakamura M, Watanabe O, Yamamura T, Ishikawa T, Furukawa K, et al. Development and validation of a new scoring system to determine the necessity of small-bowel endoscopy in obscure gastrointestinal bleeding. Dig Liver Dis. 2017;49(11):1218–24.

    Article  PubMed  Google Scholar 

  24. Cauchie P, Cauchie C, Boudjeltia KZ, Carlier E, Deschepper N, Govaerts D, et al. Diagnosis and prognosis of overt disseminated intravascular coagulation in a general hospital—meaning of the ISTH score system, fibrin monomers, and lipoprotein-C-reactive protein complex formation. Am J Hematol. 2006;81(6):414–9.

    Article  CAS  PubMed  Google Scholar 

  25. Mitrovic M, Suvajdzic N, Bogdanovic A, Kurtovic NK, Sretenovic A, Elezovic I, et al. International Society of Thrombosis and Hemostasis Scoring System for disseminated intravascular coagulation ≥ 6: a new predictor of hemorrhagic early death in acute promyelocytic leukemia. Med Oncol. 2013;30(1):478.

    Article  PubMed  CAS  Google Scholar 

  26. Subherwal S, Bach RG, Chen AY, Gage BF, Rao SV, Newby LK, et al. Baseline risk of major bleeding in non-ST-segment-elevation myocardial infarction: the CRUSADE (Can Rapid risk stratification of Unstable angina patients Suppress ADverse outcomes with Early implementation of the ACC/AHA Guidelines) Bleeding Score. Circulation. 2009;119(14):1873–82.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Zheng Y, Huang Y, Cheng G, Zhang C, Wu J, Qin C, et al. Developing a new score system for patients with PSA ranging from 4 to 20 ng/mL to improve the accuracy of PCa detection. Springerplus. 2016;5(1):1484.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  28. Jarvis JN, Wainwright H, Harrison TS, Rebe K, Meintjes G. Pulmonary cryptococcosis misdiagnosed as smear-negative pulmonary tuberculosis with fatal consequences. Int J Infect Dis. 2010;14(Suppl 3):e310–2.

    Article  PubMed  Google Scholar 

  29. Shi W, Zhou L, Peng X, Ren H, Wang Q, Shan F, et al. HIV-infected patients with opportunistic pulmonary infections misdiagnosed as lung cancers: the clinicoradiologic features and initial application of CT radiomics. J Thorac Dis. 2019;11(6):2274–86.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Bostantzoglou C, Samitas K, Gkogkou C, Zervas E, Gaga M. Mediastinal widening and miliary chest radiograph pattern in a middle aged man: could it be sarcoidosis? BMJ Case Rep. 2014. https://0-doi-org.brum.beds.ac.uk/10.1136/bcr-2014-204884.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Song JY, Park CW, Kee SY, Choi WS, Kang EY, Sohn JW, et al. Disseminated Mycobacterium avium complex infection in an immunocompetent pregnant woman. BMC Infect Dis. 2006;6:154.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Sampsonas E, Kaparianos A, Tzelepi V, Zolota V, Karkoulias K, Tsiamita M, et al. Miliary pattern due to occupational lung disease in a patient with laryngeal cancer. Eur Rev Med Pharmacol Sci. 2010;14(1):43–5.

    CAS  PubMed  Google Scholar 

  33. Togashi Y, Masago K, Kubo T, Sakamori Y, Kim YH, Hatachi Y, et al. Association of diffuse, random pulmonary metastases, including miliary metastases, with epidermal growth factor receptor mutations in lung adenocarcinoma. Cancer. 2011;117(4):819–25.

    Article  PubMed  Google Scholar 

  34. Jin SM, Lee HJ, Park EA, Lee HY, Lee SM, Yang SC, et al. Frequency and predictors of miliary tuberculosis in patients with miliary pulmonary nodules in South Korea: a retrospective cohort study. BMC Infect Dis. 2008;8:160.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Salahuddin M, Karanth S, Ocazionez D, Estrada YMRM, Cherian SV. Clinical characteristics and etiologies of miliary nodules in the US: a single-center study. Am J Med. 2019;132(6):767–9.

    Article  PubMed  Google Scholar 

  36. Gomes M, Saad Júnior R, Stirbulov R. Pulmonary tuberculosis: relationship between sputum bacilloscopy and radiological lesions. Rev Inst Med Trop Sao Paulo. 2003;45(5):275–81.

    Article  PubMed  Google Scholar 

  37. Cohen JR, Amorosa JK, Smith PR. The air-fluid level in cavitary pulmonary tuberculosis. Radiology. 1978;127(2):315–6.

    Article  CAS  PubMed  Google Scholar 

  38. Kempker RR, Vashakidze S, Solomonia N, Dzidzikashvili N, Blumberg HM. Surgical treatment of drug-resistant tuberculosis. Lancet Infect Dis. 2012;12(2):157–66.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Kaplan G, Post FA, Moreira AL, Wainwright H, Kreiswirth BN, Tanverdi M, et al. Mycobacterium tuberculosis growth at the cavity surface: a microenvironment with failed immunity. Infect Immun. 2003;71(12):7099–108.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Ahmad N, Javaid A, Basit A, Afridi AK, Khan MA, Ahmad I, et al. Management and treatment outcomes of MDR-TB: results from a setting with high rates of drug resistance. Int J Tuberc Lung Dis. 2015;19(9):1109–14.

    Article  CAS  PubMed  Google Scholar 

  41. Zhang P, Cao W, Ye T, Deng G. Closure of pulmonary cavity of a multidrug-resistant tuberculosis patient with catheter insertion—a case report. J Clin Tuberc Other Mycobact Dis. 2020;19:100146.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Chaisson RE, Schecter GF, Theuer CP, Rutherford GW, Echenberg DF, Hopewell PC. Tuberculosis in patients with the acquired immunodeficiency syndrome. Clinical features, response to therapy, and survival. Am Rev Respir Dis. 1987;136(3):570–4.

    Article  CAS  PubMed  Google Scholar 

  43. Picon PD, Caramori ML, Bassanesi SL, Jungblut S, Folgierini M, Porto Nda S, et al. Differences in the clinical and radiological presentation of intrathoracic tuberculosis in the presence or absence of HIV infection. JBP. 2007;33(4):429–36.

    Google Scholar 

  44. Elliott AM, Luo N, Tembo G, Halwiindi B, Steenbergen G, Machiels L, et al. Impact of HIV on tuberculosis in Zambia: a cross sectional study. BMJ. 1990;301(6749):412–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Laissy JP, Cadi M, Boudiaf ZE, Casalino E, Crestani B, Bouvet E, et al. Pulmonary tuberculosis: computed tomography and high-resolution computed tomography patterns in patients who are either HIV-negative or HIV-seropositive. J Thorac Imaging. 1998;13(1):58–64.

    Article  CAS  PubMed  Google Scholar 

  46. Raviglione MC, Narain JP, Kochi A. HIV-associated tuberculosis in developing countries: clinical features, diagnosis, and treatment. Bull World Health Organ. 1992;70(4):515–26.

    CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We are highly grateful to the study participants for their contribution

Funding

This work was supported by the National Science and Technology Major Project During the 13th Five-year Plan Period (2018ZX10302104), the Basic Research Project (cstc2018jcyjAX0272) of Chongqing Science & Technology Commission, the Medical Research Project (2016HBRC008) of Chongqing Municipal Health and Family Planning Commission, and the Joint Medical Research Project (2020GDRC010) of Chongqing Science & Technology Bureau and Chongqing Health Commission. The funding bodies played no role in the design of the study and collection, analysis, interpretation of data and in writing the manuscript.

Author information

Author notes

  1. Jing Ouyang and Jing Yuan contributed equally to this work

Authors and Affiliations

  1. Clinical Research Center, Chongqing Public Health Medical Center, Chongqing, China

    Jing Ouyang, Jing Yuan, Yaling Chen, Yanming Zeng, Vijay Harypursat, Yanqiu Lu & Yaokai Chen

  2. Division of Infectious Diseases, Chongqing Public Health Medical Center, Chongqing, China

    Jing Yuan & Yaokai Chen

  3. School of Biomedical Engineering, Capital Medical University, No. 10 Youanmenwai Road, Fengtai, Beijing, 100069, China

    Hui Chen

Authors
  1. Jing Ouyang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jing Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yaling Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yanming Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Vijay Harypursat
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yanqiu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Hui Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Yaokai Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JO and JY contributed to data collection and manuscript writing. YC1 (Yaling Chen) and YZ analyzed the data and provided comments on the manuscript, VH and YL reviewed critical preliminary results and commented on the manuscript, YC2 (Yaokai Chen) and HC conceived and designed the study. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Hui Chen or Yaokai Chen.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Ethics Committee of Chongqing Public Health Medical Center (Approval Number 2017GWZX007). In the retrospective cohort, the requirement of informed consent from study participants was waived because of the retrospective and anonymized nature of this study. In the prospective cohort, all study participants provided written consent for enrollment before participation. The study was conducted in accordance with the precepts of the declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ouyang, J., Yuan, J., Chen, Y. et al. The development and validation of a diagnostic scoring system to differentiate pulmonary tuberculosis from non-tuberculosis pulmonary infections in HIV-infected patients with severe immune suppression. BMC Infect Dis 21, 863 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12879-021-06552-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12879-021-06552-3

Keywords

BMC Infectious Diseases

ISSN: 1471-2334

Contact us