Skip to main content

Nasopharyngeal carriage of Streptococcus pneumoniae serotypes among children in India prior to the introduction of pneumococcal conjugate vaccines: a cross-sectional study

Abstract

Background

Streptococcus pneumoniae is a major cause of pneumonia, meningitis, and other serious infections among children in India. India introduced the 13-valent pneumococcal conjugate vaccine (PCV) in several states in 2017, and is expected to expand to nationwide coverage in the near future. To establish a baseline for measuring the impact of PCV in India, we assessed overall and serotype-specific nasopharyngeal carriage in two pediatric populations.

Methods

A cross-sectional study was conducted in Palwal District, Haryana, from December 2016 to July 2017, prior to vaccine introduction. Children 2–59 months of age with clinical pneumonia seeking healthcare and those in the community with no clear illness were targeted for enrollment. A nasopharyngeal swab was collected and tested for pneumococcus using conventional culture and sequential multiplex PCR. Isolates were tested for antimicrobial resistance using an E test. Children were considered colonized if pneumococcus was isolated by culture or PCR. The prevalence of pneumococcal and serotype-specific colonization was compared between groups of children using log-binomial regression.

Results

Among 601 children enrolled, 91 had clinical pneumonia and 510 were community children. The proportion colonized with S. pneumoniae was 74.7 and 54.5% among children with clinical pneumonia and community children, respectively (adjusted prevalence ratio: 1.38; 95% confidence interval: 1.19, 1.60). The prevalence of PCV13 vaccine-type colonization was similar between children with clinical pneumonia (31.9%) and community children (28.0%; p = 0.46). The most common colonizing serotypes were 6A, 6B, 14, 19A, 19F, and 23F, all of which are included in the PCV13 vaccine product. Antimicrobial resistance to at least one drug was similar between isolates from children with clinical pneumonia (66.1%) and community children (61.5%; p = 0.49); while resistance to at least two drugs was more common among isolates from children with clinical pneumonia (25.8% vs. 16.4%; p = 0.08). Resistance for all drugs was consistently higher for PCV13 vaccine-type serotypes compared to non-vaccine serotypes in both groups.

Conclusion

This study provides baseline information on the prevalence of serotype-specific pneumococcal colonization among children prior to the introduction of PCV in India. Our results suggest a role for pneumococcal vaccines in reducing pneumococcal colonization and antimicrobial resistant isolates circulating in India.

Peer Review reports

Background

Streptococcus pneumoniae (pneumococcus) is a major cause of pneumonia, meningitis, and other serious infections in children. In 2015, there were an estimated 294,000 deaths in children 1–59 months due to pneumococcus globally [1]. A majority of these deaths occurred in low- and middle-income countries. India accounted for an estimated 68,700 pneumococcal deaths in this age group in 2015 [2]. Increasing antibiotic resistance prevalence threatens to make treatment for pneumococcal disease more challenging and expensive in countries such as India [3].

Pneumococcal nasopharyngeal colonization commonly precedes pneumococcal disease [4]. High nasopharyngeal colonization with pneumococcus has been observed in several studies from India [5,6,7]. The high prevalence and early acquisition of pneumococcal nasopharyngeal colonization in children in India is likely due to the high prevalence of risk factors for bacterial nasopharyngeal colonization, including household crowding, socioeconomic status, and indoor air pollution [8]. In addition to serving as a reservoir for respiratory infections and invasive diseases, colonization of the nasopharynx is also a source of transmission of pneumococcus to other individuals.

Pneumococcal conjugate vaccine (PCV) has contributed to substantial reductions in pneumococcal disease in children in a variety of epidemiologic settings [9,10,11]. The direct protection provided by PCV is largely mediated by the ability of the vaccine to reduce acquisition and density of vaccine-type pneumococcal nasopharyngeal colonization [4]. This reduces the spread of vaccine-type pneumococci to others in the community, including those who have not been immunized with PCV, resulting in indirect protection as well.

Given its high prevalence in low- and middle-income countries and its relationship with disease, there is growing interest in using nasopharyngeal colonization with vaccine-type pneumococcus as a surrogate endpoint for monitoring PCV impact. Such data are less expensive to collect and are not prone to the same biases as community-based invasive disease surveillance studies conducted in such settings. Analyses assessing serotypes found in the nasopharynx, however, are complicated by the relationship between colonization duration and serotype invasiveness. Some serotypes commonly found to cause invasive disease are not often isolated from the nasopharynx of healthy children, suggesting these serotypes colonize for a short duration [12, 13]. Nevertheless, methods for estimating the impact of PCV on pneumococcal disease using nasopharyngeal colonization data have been described [14].

India introduced the 13-valent PCV product in 6 states in 2017–19 (Himachal Pradesh, Uttar Pradesh, Bihar, Rajasthan, Madhya Pradesh and Haryana) with plans to extend to additional districts and states beyond 2019. With the aim of establishing a baseline in the pre-PCV period that could be used to measure the impact of PCV in India, we assessed serotype-specific nasopharyngeal carriage in two pediatric populations, namely children with signs and symptoms of pneumonia presenting at healthcare clinics and community-based children without signs of pneumonia or other acute infections, prior to vaccine introduction.

Methods

Ethics statement

This study was approved by the institutional review boards at the Johns Hopkins Bloomberg School of Public Health (Baltimore, United States) and the INCLEN Trust International (New Delhi, India).

Setting, design, and procedures

This study was conducted as part of an ongoing multisite study called Baseline Assessment for Streptococcus pneumoniae of India Serotypes (BASIS). The overall objective of the BASIS study was to establish a platform for characterizing the pneumococcal serotypes circulating and causing disease among children in India. The current study was conducted at the SOMAARTH Demographic Development and Environmental Surveillance Site (DDESS) in Palwal District, Haryana [15]. The under-five and infant mortality rates for Haryana are 52 and 42 per 1,000 live births, respectively [16]. The SOMAARTH DDESS is a peri-urban area within Palwal district with a population of approximately 200,000 people living in 51 villages [15]. The population is served by one district-level public hospital and several private healthcare facilities and primary care clinics. Haryana introduced PCV in December 2017.

A cross-sectional study was conducted in the SOMAARTH DDESS from December 2016 to July 2017, prior to vaccine introduction. A convenience sample of two groups of children were targeted for enrollment: children with clinical pneumonia presenting at healthcare clinics and children in the community. The total target enrollment for the study was 600 children; each group was enrolled until the total target was met. Children with clinical pneumonia were recruited from the district hospital, two private hospitals with pediatric clinics and five primary care clinics with a high volume of pediatric patients. On recruitment days, children identified by clinic staff with respiratory symptoms were screened by study staff for enrollment in the study. Children were eligible and considered to have clinical pneumonia if: 1) they were 2–59 months of age; and 2) they had evidence of a fever (either documented at > 38.0 °C or reported); and 3) they had tachypnea, one or more danger signs (altered consciousness, convulsions, poor feeding, bulging fontanelle or stiff neck), or if they were suspected to have sepsis. Children were excluded if there was a strong suspicion of viral infection or their symptoms were consistent with acute bronchiolitis. Children in the community were enrolled from one of the primary care clinics, the immunization clinic at the district hospital, and several anganwadi (daycare) centers (under the Integrated Child Development Scheme). Children were eligible if they were 2–59 months of age and had not experienced symptoms of acute respiratory infection, diarrhea, or rash in the past 48 h. For both groups of children, only one child per family was enrolled. If more than one sibling was present and eligible, then the younger sibling was enrolled.

For all children, written informed consent was obtained from the primary caregiver before enrollment in the study. After enrollment, a questionnaire was administered to the primary caregiver by trained study staff to collect information on demographics, vaccine history (by immunization card or self-report), and medical history (children with clinical pneumonia only). For children with clinical pneumonia, receipt of antibiotics in the past 48 h was assessed through discussion with the caregiver and review of medication brought with them. Based on the information available, the interviewer assessed the likelihood of antibiotic receipt. In addition, a nasopharyngeal swab was collected from all children using a sterile flocked flexible nylon swab (FloQSwab, Copan Diagnostics, Murrieta, CA). Swabs were immediately placed in skim milk-tryptone-glucose-glycerol (STGG) medium, transported on ice to the study laboratory, and stored at -70 °C.

Laboratory methods

STGG media was prepared at the INCLEN laboratory. Each batch of STGG underwent quality control procedures to ensure that it was sterile and supported the recovery of viable pneumococci.

Nasopharyngeal swabs were shipped to the Central Reference Laboratory at Christian Medical College, Vellore for bacterial culture, antimicrobial susceptibility testing, serotyping and PCR testing. Conventional culture was performed according to the United States Centers for Disease Control and Prevention (US CDC) recommended broth enrichment method [17]. Briefly, 200 μL of the STGG medium was inoculated onto Supplemented Todd Hewitt broth with sterile rabbit serum, incubated for 6 h at 37 °C in a 5–7% CO2 incubator, and then plated on to blood agar. After overnight incubation, the plates were screened for alpha hemolytic colonies that were morphologically similar to S. pneumoniae and sub-cultured. If more than one morphologically non-identical colony was found, all non-identical colonies were sub-cultured. After confirmation of S. pneumoniae using standard protocols [18], isolates were serotyped with the Quellung reaction using pneumococcal antisera from Staten’s Serum Institute (Copenhagen, Denmark) according to standard protocols [18].

All samples were also tested by sequential multiplex (SM) PCR. Briefly, the primary blood agar plate was washed with brain heart infusion broth with 10% glycerol. All colonies present on the plate were harvested. After inactivating DNAse [19], the genomic DNA was purified using the QIAamp DNA mini kit (Qiagen, Hilden, Germany) according to the standardized US CDC protocol [18]. Conventional SM PCR was performed for serotyping of S. pneumoniae using the standard protocol [20], with modifications developed by the laboratory [20, 21]. All samples SM PCR positive for S. pneumoniae serotypes were also subjected to real time PCR using probe and primers targeting the lytA gene as recommended by US CDC [18].

Antimicrobial susceptibility of isolates identified by conventional culture was tested by establishing the minimum inhibitory concentration value using an E test (BioMérieux, Capronne, France) for penicillin, chloramphenicol, cotrimoxazole, erythromycin, vancomycin and cefotaxime. Interpretation of results as susceptible, intermediate, or resistant was based on the cutoff values defined by the Clinical and Laboratory Standard Institute [22].

Definitions

For the analysis, a child was considered colonized if S. pneumoniae was isolated from the nasopharynx by either culture or SM PCR. Serotype coverage, or the proportion of all isolates that were of a type included in a pneumococcal vaccine product, was calculated for existing vaccines, including PCV10 (1, 4, 5, 6B, 7F, 9 V, 14, 18C, 19F and 23F) and PCV13 (PCV10 plus 3, 6A, 19A), and vaccines in development, including a 10-valent product by a manufacturer in India (1, 5, 6A, 6B, 7F, 9 V, 14, 19A, 19F, 23F) [23], PCV15 (PCV13 plus 22F, 33F) [24], and PCV24 (PCV15 plus 2, 8, 9 N, 10A, 11A, 12F, 15B, 17F, 20) [25]. Cross-protection between serotypes 6A and 6B for PCV10 was assumed based on immunologic [26] and epidemiologic data [26,27,28,29,30,31]. When SM PCR produced a serogroup (e.g. 6A/B/C/D) instead of a vaccine serotype (e.g. 6B), the serogroup was assumed to be nonvaccine-type (i.e. minimum coverage) for the primary analysis. As a secondary analysis, serogroups were assumed to be vaccine-type (i.e. maximum coverage).

Weight-for-age, length-for-age, and weight-for-length Z-scores were calculated using the World Health Organization child growth standards [32]. Receipt of antibiotics in the past 48 h was defined as ‘no’ if the child had not received any drugs or the child had received drugs and the interviewer assessed antibiotic receipt as ‘unlikely’, was defined as ‘yes’ if the child had received drugs and the interviewer assessed antibiotic receipt as ‘definite’ or ‘likely’, and was defined as ‘unknown’ if receipt of drugs was unknown or the child received drugs but the interviewer could not assess the likelihood of antibiotic receipt.

Analysis

Data were collected on paper and entered in duplicate into a REDCap database. Discrepancies in data entry were identified and resolved by reviewing the paper forms. The analysis was performed using SAS version 9.4 (SAS Institute Inc., Cary, NC).

Descriptive statistics were used to summarize the characteristics of participants in each group. Comparisons between groups and between those colonized and not colonized were made using chi-square tests for categorical variables and Wilcoxon rank-sum tests for continuous variables. Log-binomial regression was used to compare the overall prevalence of colonization, as well as serotype-specific colonization, between groups (reference group = community children) and adjusted for relevant characteristics found to differ significantly (p < 0.05) between groups. As the number colonized with individual serotypes was small, only crude serotype-specific prevalence ratios were calculated.

The performance of culture and SM PCR in detecting S. pneumoniae was compared using the Kappa statistic. The sensitivity of each method alone for detecting S. pneumoniae was calculated in comparison to using both culture and SM PCR using the capture-recapture method for estimating the total number of colonized children [33].

Results

Among the 610 children enrolled during the study period, 91 were children with clinical pneumonia and 510 were community children. The characteristics of both groups of children are presented in Table 1.

Table 1 Characteristics of children 2–59 months of age in Palwal, India and correlates of pneumococcal colonization

Prevalence and correlates of pneumococcal colonization

Among children with clinical pneumonia, 74.7% (68/91; 95% confidence interval [CI]: 64.5, 83.3%) were colonized with S. pneumoniae (by culture or PCR). Among those colonized, 18 children (26.2%) were colonized with multiple serotypes (16 children with two serotypes and two children with three serotypes; 88 total isolates were identified). Among community children, 54.5% (278/510; 95% CI: 50.1, 58.9%) were colonized with S. pneumoniae (see Additional File 1 for the prevalence of colonization by age). Among those colonized, 29 children (26.5%) were colonized with two serotypes (24 children with two serotypes and five children with three serotypes; 312 total isolates were identified). Children with clinical pneumonia were significantly more likely to be colonized with S. pneumoniae (Fig. 1; Additional File 2), even after adjusting for age and weight-for-length z-score (adjusted prevalence ratio: 1.38; 95% CI: 1.19, 1.60).

Fig. 1
figure 1

Serotype-specific prevalence of nasopharyngeal colonization among children 2–59 months of age in Palwal, India. Note: * indicates a serotype included in PCV13; NT refers to non-typeable pneumococcus; 10vPCV refers to the 10-valent pneumococcal conjugate vaccine manufactured in India (included serotypes differ from PCV10); Error bars represent 95% confidence intervals

Among children with clinical pneumonia, the prevalence of colonization was significantly lower among those who reported having received antibiotics in the past 48 h (yes: 55.6% vs. no: 84.8% vs. unknown: 70.4%; p = 0.04; Table 1). Age, sex, nutrition status, presence of danger signs or tachypnea, duration of illness, and hospitalization were not observed to be associated with colonization (Table 1). Among community children, no characteristics were observed to be associated with colonization.

Serotype distribution and serotype-specific colonization

While the serotype distributions were different between children with clinical pneumonia (n = 88 isolates) and community children (n = 312 isolates), there was overlap in common serotypes (see Additional File 3). The six most common serotypes among isolates from children with clinical pneumonia were 23F (8/88; 9.1%), 19A (7/88; 8.0%), 34 (7/88; 8.0%), 14 (6/88; 6.8%), 19F (5/88; 5.7%), and 10A (5/88; 5.7%). The six most common serotypes among isolates from community children were 14 (26/312; 8.3%), 6A (23/312; 7.4%), 19F (22/312; 7.1%), 6B (21/312; 6.7%), 23F (20/312; 6.4%), and 19A (15/312; 4.8%). Serotype coverage for PCV13 was 34.1% (30/88) among children with clinical pneumonia and 48.4% (151/312) among community children. Results for maximum serotype coverage are presented in Additional File 4.

The prevalence of PCV13 vaccine-type colonization among children with clinical pneumonia was 31.9% (29/91) and 28.0% (143/510) among community children (prevalence ratio: 1.14; 95% CI: 0.82, 1.58; Fig. 1 and Additional File 2; see Additional File 4 for maximum colonization prevalence). The prevalence of colonization with serotypes 10A, 16F, 19A, 23F, 33B, 34, and 35A was significantly higher among children with clinical pneumonia compared to community children (Fig. 1 and Additional File 2).

Comparison of SM PCR and culture for detection of S. pneumoniae

The performance of SM PCR was similar to culture in detecting S. pneumoniae (Table 2), with good agreement between the two methods (Kappa: 0.72 among children with clinical pneumonia and 0.89 for community children). The sensitivity of culture and SM PCR alone compared to a combination of culture and SM PCR was 89.1 and 93.5%, respectively, among children with clinical pneumonia, and 96.1 and 92.9%, respectively, among community children. Multiple serotypes were more likely to be detected using SM PCR than culture (Table 2). Among children with clinical pneumonia, 15.4% (14/91) of participants had multiple serotypes detected with SM PCR compared to 1.1% (1/91) with culture. An additional four children with clinical pneumonia had multiple serotypes detected using both culture and SM PCR. Among community children, 4.1% (21/510) of participants had multiple serotypes detected with SM PCR compared to 1.4% (7/510) with culture alone. An additional five children had multiple serotypes detected using both culture and SM PCR.

Table 2 Comparison of PCR and culture results for detecting S. pneumoniae among children in Palwal, India

Antimicrobial resistance

Antimicrobial susceptibility results were available for 62 isolates from children with clinical pneumonia and 272 isolates from community children. Patterns of antimicrobial resistance were similar between isolates from children with clinical pneumonia and community children (Fig. 2a). Resistance to erythromycin (children with clinical pneumonia: 32.3%; community children: 30.6%) and cotrimoxazole (children with clinical pneumonia: 61.7%; community children: 65.2%) were common in both groups of children. Significantly more isolates were resistant to chloramphenicol (3.2% vs. 0.4%; p = 0.03) and significantly fewer isolates were resistant to vancomycin (0% vs. 21.8%; p < 0.0001) among children with clinical pneumonia compared to community children. Resistance to at least one drug was similar between isolates from children with clinical pneumonia (66.1%) and community children (61.5%; p = 0.49). However, more isolates were resistant to at least two drugs (25.8% vs. 16.4%; p = 0.08) among children with clinical pneumonia compared to community children, although this result was not statistically significant. Resistance to all drugs was consistently higher for PCV13 vaccine-type serotypes in both groups of children (Fig. 2b). Serotype-specific antimicrobial resistance is presented in Additional File 5.

Fig. 2
figure 2

Antimicrobial resistance among pneumococcal isolates in Palwal, India, by group (a) and PCV13 vaccine-type (b). Note: P-values from chi-square tests for comparison between study populations (children with clinical pneumonia and community children) (panel a) or between PCV13 vaccine-type (VT) and non-vaccine type (nonVT) serotypes within each study population (panel b); Error bars represent 95% confidence intervals; Resistance to cotrimoxazole was evaluated for only 59 and 112 children with clinical pneumonia and community children, respectively

Discussion

In this community in Haryana, India, approximately three-quarters of children with clinical pneumonia and half of community children were colonized with S. pneumoniae, and approximately a quarter of children in both groups were colonized with PCV13 serotypes. Seven serotypes were significantly more likely to be carried by children with clinical pneumonia compared with community children. Resistance to erythromycin and cotrimoxazole was common among isolates from both groups of children. Resistance was consistently higher among isolates that were PCV13 vaccine serotypes.

Measuring pneumococcal colonization and the distribution of serotypes in the nasopharynx can be used as a way to monitor both the direct and indirect impact of vaccines. Different populations can be targeted for monitoring, including children in the community and children with disease, which were both included in this study. To our knowledge, the current study is the first to describe the prevalence of pneumococcal colonization and distribution of serotypes in children with clinical pneumonia recruited from primary care clinics.

Measuring the prevalence of serotype-specific colonization in the two groups of children allowed us to estimate the serotype-specific disease potential for clinical pneumonia compared to asymptomatic children based in the community. While it cannot be definitively established that colonizing pneumococci played a causal role in the illness among children with clinical pneumonia, this comparison was conducted under the assumption that if the illness was caused by pneumococci, it would likely be of the same serotype as the colonizing pneumococci. We observed that seven serotypes (i.e., 10A, 16F, 19A, 23F, 33B, 34, 35A) were associated with clinical pneumonia without adjusting for possible confounders. A study conducted among children younger than five years in Israel measured the serotype-specific prevalence of pneumococcus in the nasopharynx of radiologically-confirmed pneumonia cases and healthy controls [34]. In that study, serotypes 1, 5, 22F, and 14 had the highest disease potential after adjusting for possible confounders. None of these serotypes was isolated from the nasopharynx of children with clinical pneumonia in the current study, except serotype 14 which was not found to be statistically significantly associated with symptoms in crude analyses. The differences in serotype-specific disease potential between the current study and the study from Israel are likely due to differences in the pneumonia case definitions (i.e., clinical pneumonia versus radiologically confirmed pneumonia) and epidemiological differences between the study settings.

Several studies conducted in India have measured the prevalence of nasopharyngeal colonization with pneumococcus in children younger than five years prior to routine use with PCV. Most studies were conducted in urban areas of South India and enrolled children from hospital outpatient departments or immunization clinics [7, 35,36,37,38]. These studies yielded a wide range of estimates, from 6.5% prevalence of colonization among children 3 to 36 months in a hospital-based study in Delhi [36], to 28% among children 3 to 59 months attending an immunization clinic in Bangalore [38]. Studies that have followed children longitudinally, have found a higher peak prevalence of 70% among children 2–6 months in a community-based study in rural South India [6], and 46% among children 1–11 months [5]. The prevalence of colonization will vary across studies depending on many factors, including the age distribution of the study population, enrollment criteria, prevalence of risk factors for colonization, seasonality, and laboratory methods. The high prevalence of colonization observed among community children in this study may be attributable to these factors, as half the study population was younger than two years of age and enrolled from rural and peri-urban area with low socioeconomic status. In addition, colonization in this study was determined based on both culture and PCR, in contrast to the use of only culture in prior studies [5,6,7, 35,36,37,38], which increased the overall prevalence of colonization.

Few studies from India have reported on the distribution of serotypes found colonizing children. Two studies conducted among asymptomatic children in South India found serotypes/groups 6, 14, 15, 19, and 23 to be the most prevalent [6, 39]. While neither of these studies reports on the proportion of isolates covered by PCV13, PCV7 was estimated to account for 53% of carried isolates in one study [39]. The level of serotype coverage observed in this study (i.e., 48% for PCV13 among community children) and other studies from India corresponds with serotype coverage from many developing countries [40]. Similar to the other studies from India, the most common colonizing serotypes in this study were 6A, 6B, 14, 19A, 19F, and 23F, which are all included in the PCV13 product that was recently introduced, suggesting that the vaccine has the potential to impact pneumococcal colonization and disease. Several studies have also reported on the distribution of serotypes among children younger than 5 years of age with invasive disease in India [41,42,43]. While the common serotypes were similar to those found colonizing children in this study (e.g. 14, 19F, 6A, 6B, 19A, 23F), serotype 1 and 5 were commonly found, which were rare in this study (serotype 5 identified from three community children; serotype 1 not identified from any children). In addition, the proportion of PCV13 vaccine-type serotypes identified from children with invasive disease was higher (74 and 78%) than in this study [41,42,43].

The use of SM PCR in this study in combination with culture increased not only the overall prevalence of colonization but also the number of serotypes detected. Culture followed by the Quellung reaction is currently accepted as the gold-standard method for pneumococcal serotyping [44, 45], but the test has limited ability to detect multiple serotypes within the same sample. Molecular methods, including real-time PCR, have been found to be more sensitive than culture [46, 47], particularly for detecting low density colonization [48, 49], and are better able to detect colonization with multiple serotypes without the need for bacterial culture [50]. The SM PCR protocol used in this study was developed by the US CDC and uses primers targeting serotype- or serogroup-specific regions in the cps loci [51]. The assay allows for the simultaneous detection of capsule specific genes of 40 pneumococcal serotypes, including the most common disease-causing serotypes [52, 53]. However, due to high sequence homology in the pneumococcal capsule region of some serogroups, detection of specific serotypes may be limited in some cases [54]. Given the advantages of molecular methods, future colonization studies should consider their use to better estimate colonization and serotype distributions, particularly after vaccine introduction when colonization density of vaccine serotypes may be reduced.

Resistance to cotrimoxazole and erythromycin were common among both groups of children. This finding is consistent with other pediatric colonization studies from India [35, 38], as well as studies of invasive pneumococcal disease [41, 43], that have found high levels of resistance to cotrimoxazole and potentially increasing resistance to erythromycin. Resistance was higher among PCV13 vaccine-type serotypes, which is consistent with what was observed in countries prior to the introduction of vaccines [55], as these serotypes are successful colonizers that tend to be carried for longer periods of time and are therefore under higher antibiotic pressure. While introduction of PCV leads to declines in vaccine-type serotypes, declines in overall antibiotic resistance may be offset by increasing prevalence and resistance among non-vaccine serotypes [55, 56].

This study had several limitations. First, the sample of children with clinical pneumonia, and thus the number of isolates detected, was relatively small due to the short period of enrollment and the seasonality of respiratory infections in this area. This limited the study’s power to detect correlates of colonization and differences between groups of children. Second, children were enrolled from hospitals and clinics based only on a clinical diagnosis of pneumonia. Chest x-rays were not routinely performed for respiratory infections in this area and infrastructure for performing chest x-rays was not available at the facilities. Therefore, this group may include children who do not have pneumonia and limit the inferences that can be made. Third, colonization with S. pneumoniae detected by SM PCR may have been overestimated, due to the possibility of cross-reaction with non-penumococcal species (e.g. S. mitis) [57, 58]. However, using both lytA and serotype-specific targets, as well as conventional culture should minimize this concern. Lastly, vaccination status of the children was not available. Collection of vaccine history was attempted, but few children had their immunization card available at the time of the study visit and the vaccine history reported by parents was deemed unreliable. At the time the study was conducted, pneumococcal vaccine was only available in the private sector and uptake was very low due to the cost of the vaccine, therefore it was unlikely that any children received the vaccine. After vaccine introduction, however, it will be important for studies to collect accurate information about receipt of routine and pneumococcal vaccines, and strategies will be needed to improve access to immunization cards.

Conclusions

In summary, the majority of children with clinical pneumonia and community children were colonized with S. pneumoniae. Our data suggest that PCV will have an important impact in India. The most commonly identified colonizing serotypes are all included in the PCV13 product as well as the upcoming 10-valent vaccine product from India. This study provides baseline information on the prevalence of colonization, overall and with vaccine serotypes, prior to the introduction of PCV13 in India. Continued studies in these populations will be needed to monitor the impact of vaccine introduction on vaccine and non-vaccine serotypes and antimicrobial susceptibility.

Availability of data and materials

The data that support the findings of this study can be made available from the corresponding author upon reasonable request.

Abbreviations

DDESS :

Demographic Development and Environmental Surveillance Site

PCV:

Pneumococcal conjugate vaccine

SM PCR:

Sequential multiplex polymerase chain reaction

STGG:

Skim milk-tryptone-glucose-glycerol

US CDC:

United States Centers for Disease Control and Prevention

References

  1. Wahl B, O'Brien KL, Greenbaum A, Majumder A, Liu L, Chu Y, Luksic I, Nair H, McAllister DA, Campbell H, et al. Burden of Streptococcus pneumoniae and Haemophilus influenzae type b disease in children in the era of conjugate vaccines: global, regional, and national estimates for 2000-15. Lancet Glob Health. 2018;6(7):e744–57.

    Article  Google Scholar 

  2. Wahl B, Sharan A, Deloria Knoll M, Kumar R, Liu L, Chu Y, McAllister DA, Nair H, Campbell H, Rudan I, et al. National, regional, and state-level burden of Streptococcus pneumoniae and Haemophilus influenzae type b disease in children in India: modelled estimates for 2000-15. Lancet Glob Health. 2019;7(6):e735–47.

    Article  Google Scholar 

  3. Laxminarayan R, Matsoso P, Pant S, Brower C, Rottingen JA, Klugman K, Davies S. Access to effective antimicrobials: a worldwide challenge. Lancet. 2016;387(10014):168–75.

    Article  Google Scholar 

  4. Simell B, Auranen K, Kayhty H, Goldblatt D, Dagan R, O'Brien KL, Pneumococcal Carriage G. The fundamental link between pneumococcal carriage and disease. Expert Rev Vaccines. 2012;11(7):841–55.

    Article  CAS  Google Scholar 

  5. Rupa V, Isaac R, Manoharan A, Jalagandeeswaran R, Thenmozhi M. Risk factors for upper respiratory infection in the first year of life in a birth cohort. Int J Pediatr Otorhinolaryngol. 2012;76(12):1835–9.

    Article  CAS  Google Scholar 

  6. Coles CL, Kanungo R, Rahmathullah L, Thulasiraj RD, Katz J, Santosham M, Tielsch JM. Pneumococcal nasopharyngeal colonization in young south Indian infants. Pediatr Infect Dis J. 2001;20(3):289–95.

    Article  CAS  Google Scholar 

  7. Dhakal R, Sujatha S, Parija SC, Bhat BV. Asymptomatic colonization of upper respiratory tract by potential bacterial pathogens. Indian J Pediatr. 2010;77(7):775–8.

    Article  Google Scholar 

  8. Bogaert D, De Groot R, Hermans PW. Streptococcus pneumoniae colonisation: the key to pneumococcal disease. Lancet Infect Dis. 2004;4(3):144–54.

    Article  CAS  Google Scholar 

  9. Feikin DR, Kagucia EW, Loo JD, Link-Gelles R, Puhan MA, Cherian T, Levine OS, Whitney CG, O'Brien KL, Moore MR, et al. Serotype-specific changes in invasive pneumococcal disease after pneumococcal conjugate vaccine introduction: a pooled analysis of multiple surveillance sites. PLoS Med. 2013;10(9):e1001517.

    Article  Google Scholar 

  10. von Gottberg A, de Gouveia L, Tempia S, Quan V, Meiring S, von Mollendorf C, Madhi SA, Zell ER, Verani JR, O'Brien KL, et al. Effects of vaccination on invasive pneumococcal disease in South Africa. N Engl J Med. 2014;371(20):1889–99.

    Article  Google Scholar 

  11. Scott JAG HL, Bwanaali T: Impact of introducing 10-valent pneumococcal conjugate vaccine in Kenya on invasive pneumococcal disease among children aged <5 years. In: 8th International Symposium on Pneumococci and Pneumococcal Diseases: 2012; Iguacu Falls, Brazil; 2012.

  12. Brueggemann AB, Griffiths DT, Meats E, Peto T, Crook DW, Spratt BG. Clonal relationships between invasive and carriage Streptococcus pneumoniae and serotype- and clone-specific differences in invasive disease potential. J Infect Dis. 2003;187(9):1424–32.

    Article  CAS  Google Scholar 

  13. Sandgren A, Sjostrom K, Olsson-Liljequist B, Christensson B, Samuelsson A, Kronvall G, Henriques Normark B. Effect of clonal and serotype-specific properties on the invasive capacity of Streptococcus pneumoniae. J Inf Dis. 2004;189(5):785–96.

    Article  CAS  Google Scholar 

  14. Weinberger DM, Bruden DT, Grant LR, Lipsitch M, O'Brien KL, Pelton SI, Sanders EA, Feikin DR. Using pneumococcal carriage data to monitor postvaccination changes in invasive disease. Am J Epidemiol. 2013;178(9):1488–95.

    Article  Google Scholar 

  15. Dixit S, Arora NK, Rahman A, Howard NJ, Singh RK, Vaswani M, Das MK, Ahmed F, Mathur P, Tandon N, et al. Establishing a demographic, development and environmental geospatial surveillance platform in India: planning and implementation. JMIR Public Health Surveill. 2018;4(4):e66.

    Article  Google Scholar 

  16. Sample Registration System [http://www.censusindia.gov.in/2011-Common/Sample_Registration_System.html]. Accessed 23 Mar 2018.

  17. da Gloria CM, Pimenta FC, Jackson D, Roundtree A, Ahmad Y, Millar EV, O'Brien KL, Whitney CG, Cohen AL, Beall BW. Revisiting pneumococcal carriage by use of broth enrichment and PCR techniques for enhanced detection of carriage and serotypes. J Clin Microbiol. 2010;48(5):1611–8.

    Article  Google Scholar 

  18. World Health Organization: Laboratory methods for the diagnosis of meningitis caused by Neisseria meningitidis, Streptococcus pneumoniae and Haemophilus influenzae. In., 2nd edn. Geneva, Switzerland: World Health Organization; 2011.

  19. Trzcinski K, Bogaert D, Wyllie A, Chu ML, van der Ende A, Bruin JP, van den Dobbelsteen G, Veenhoven RH, Sanders EA. Superiority of trans-oral over trans-nasal sampling in detecting Streptococcus pneumoniae colonization in adults. PLoS One. 2013;8(3):e60520.

    Article  CAS  Google Scholar 

  20. Pai R, Gertz RE, Beall B. Sequential multiplex PCR approach for determining capsular serotypes of Streptococcus pneumoniae isolates. J Clin Microbiol. 2006;44(1):124–31.

    Article  CAS  Google Scholar 

  21. Veeraraghavan B, Jayaraman R, John J, Varghese R, Neeravi A, Verghese VP, Thomas K. Customized sequential multiplex PCR for accurate and early determination of invasive pneumococcal serotypes found in India. J Microbiol Methods. 2016;130:133–5.

    Article  CAS  Google Scholar 

  22. Clinical and Laboratory Standards Institute: Performance Standards for Antimicrobial Susceptibility Testing, 26th Edition edn. Wayne, PA; 2016.

  23. Lalwani S, Bavdekar A, Venkat Ramanan P, Dhere R, Sethna V: Safety and immunogenicity of a 10-valent pneumococcal conjugate vaccine in health PCV-naive Indian toddlers - a phase 2 double-blind randomized controlled trial. In: 11th International Symposium on Pneumococci & Pneumococcal Diseases: April 15–19 2018; Melbourne, Australia; 2018.

  24. Rupp R, Johnston W, D.H, Petrecz M, Li J, Nolan K, McFetridge R, Hartzel J, Abeygunawardana C, Winters M et al: A dose ranging study of 15-valent pneumococcal conjugate vaccine (PCV-15) in health infants. In: 11th International Symposium on Pneumococci & Pneumococcal Diseases: April 15–19 2018; Melbourne, Australia; 2018.

  25. Skinner J, Kaufhold R, McGuinness D, McHugh P, Winters M, Smith W, Giovarelli C, He J, Zhang Y, Musey L: Immunogenicity of PCV24, a next generation pneumococcal conjugate vaccine, in macaques. In: 11th International Symposium on Pneumococci & Pneumococcal Diseases: April 15–19 2018; Melbourne, Australia; 2018.

  26. Park IH, Moore MR, Treanor JJ, Pelton SI, Pilishvili T, Beall B, Shelly MA, Mahon BE, Nahm MH. Active bacterial Core surveillance T: differential effects of pneumococcal vaccines against serotypes 6A and 6C. J Infect Dis. 2008;198(12):1818–22.

    Article  Google Scholar 

  27. Millar EV, Pimenta FC, Roundtree A, Jackson D, Carvalho Mda G, Perilla MJ, Reid R, Santosham M, Whitney CG, Beall BW, et al. Pre- and post-conjugate vaccine epidemiology of pneumococcal serotype 6C invasive disease and carriage within Navajo and White Mountain apache communities. Clin Infect Dis. 2010;51(11):1258–65.

    Article  Google Scholar 

  28. Whitney CG, Pilishvili T, Farley MM, Schaffner W, Craig AS, Lynfield R, Nyquist AC, Gershman KA, Vazquez M, Bennett NM, et al. Effectiveness of seven-valent pneumococcal conjugate vaccine against invasive pneumococcal disease: a matched case-control study. Lancet. 2006;368(9546):1495–502.

    Article  CAS  Google Scholar 

  29. Dagan R, Givon-Lavi N, Zamir O, Sikuler-Cohen M, Guy L, Janco J, Yagupsky P, Fraser D. Reduction of nasopharyngeal carriage of Streptococcus pneumoniae after administration of a 9-valent pneumococcal conjugate vaccine to toddlers attending day care centers. J Infect Dis. 2002;185(7):927–36.

    Article  Google Scholar 

  30. Eskola J, Kilpi T, Palmu A, Jokinen J, Haapakoski J, Herva E, Takala A, Kayhty H, Karma P, Kohberger R, et al. Efficacy of a pneumococcal conjugate vaccine against acute otitis media. N Engl J Med. 2001;344(6):403–9.

    Article  CAS  Google Scholar 

  31. Hicks LA, Harrison LH, Flannery B, Hadler JL, Schaffner W, Craig AS, Jackson D, Thomas A, Beall B, Lynfield R, et al. Incidence of pneumococcal disease due to non-pneumococcal conjugate vaccine (PCV7) serotypes in the United States during the era of widespread PCV7 vaccination, 1998-2004. J Infect Dis. 2007;196(9):1346–54.

    Article  Google Scholar 

  32. WHO Child Growth Standards [http://www.who.int/childgrowth/en/]. Accessed 13 Nov 2017.

  33. VALID International Ltd. Notes on using capture-recapture techniques to assess the sensitivity of rapid case-finding methods. Oxfort, United Kingdom: VALID International Ltd; 2006.

    Google Scholar 

  34. Greenberg D, Givon-Lavi N, Newman N, Bar-Ziv J, Dagan R. Nasopharyngeal carriage of individual Streptococcus pneumoniae serotypes during pediatric pneumonia as a means to estimate serotype disease potential. Pediatr Infect Dis J. 2011;30(3):227–33.

    Article  Google Scholar 

  35. Raman R, Sankar J, Putlibai S, Raghavan V. Demographic profile of healthy children with nasopharyngeal colonisation of Streptococcus pneumoniae: a research paper. Indian J Med Microbiol. 2017;35(4):607–9.

    Article  Google Scholar 

  36. Wattal C, Oberoi JK, Pruthi PK, Gupta S. Nasopharyngeal carriage of Streptococcus pneumoniae. Indian J Pediatr. 2007;74(10):905–7.

    Article  CAS  Google Scholar 

  37. Kanungo R, d'Lima D, Rajalakshmi B, Natarajan MK, Badrinath S. Throat carriage of pneumococci in healthy school children in the union territory of Pondicherry. Indian J Med Res. 2000;112:100–3.

    CAS  PubMed  Google Scholar 

  38. Kumar KL, Ashok V, Ganaie F, Ramesh AC. Nasopharyngeal carriage, antibiogram & serotype distribution of Streptococcus pneumoniae among healthy under five children. Indian J Med Res. 2014;140(2):216–20.

    CAS  PubMed  PubMed Central  Google Scholar 

  39. Jebaraj R, Cherian T, Raghupathy P, Brahmadathan KN, Lalitha MK, Thomas K, Steinhoff MC. Nasopharyngeal colonization of infants in southern India with Streptococcus pneumoniae. Epidemiol Infect. 1999;123(3):383–8.

    Article  CAS  Google Scholar 

  40. Adegbola RA, DeAntonio R, Hill PC, Roca A, Usuf E, Hoet B, Greenwood BM. Carriage of Streptococcus pneumoniae and other respiratory bacterial pathogens in low and lower-middle income countries: a systematic review and meta-analysis. PLoS One. 2014;9(8):e103293.

    Article  Google Scholar 

  41. Manoharan A, Manchanda V, Balasubramanian S, Lalwani S, Modak M, Bai S, Vijayan A, Shet A, Nagaraj S, Karande S, et al. Invasive pneumococcal disease in children aged younger than 5 years in India: a surveillance study. Lancet Infect Dis. 2017;17(3):305–12.

    Article  Google Scholar 

  42. Balaji V, The Baseline Assessment of Streptococcus pneumoniae of India Serotypes (BASIS) Study Group: Pneumococcal serotype surveillance among children in India: The BASIS study (abstract: 0669). In: The 11th International Symp​o​sium​​ on Pneumococci and Pneumococc​al Diseases (ISPPD 2018) 15-19 April 2018; Melbourne, Australia; 2018.

  43. Balaji V, Jayaraman R, Verghese VP, Baliga PR, Kurien T. Pneumococcal serotypes associated with invasive disease in under five children in India & implications for vaccine policy. Indian J Med Res. 2015;142(3):286–92.

    Article  CAS  Google Scholar 

  44. Satzke C, Turner P, Virolainen-Julkunen A, Adrian PV, Antonio M, Hare KM, Henao-Restrepo AM, Leach AJ, Klugman KP, Porter BD, et al. Standard method for detecting upper respiratory carriage of Streptococcus pneumoniae: updated recommendations from the World Health Organization Pneumococcal Carriage working group. Vaccine. 2013;32(1):165–79.

    Article  Google Scholar 

  45. Sorensen UB. Typing of pneumococci by using 12 pooled antisera. J Clin Microbiol. 1993;31(8):2097–100.

    CAS  PubMed  PubMed Central  Google Scholar 

  46. Thors V, Morales-Aza B, Pidwill G, Vipond I, Muir P, Finn A. Population density profiles of nasopharyngeal carriage of 5 bacterial species in pre-school children measured using quantitative PCR offer potential insights into the dynamics of transmission. Hum Vaccin Immunother. 2016;12(2):375–82.

    Article  Google Scholar 

  47. Carvalho MG, Pimenta FC, Jackson D, Roundtree A, Ahmad Y, Millar EV, O'Brien KL, Whitney CG, Cohen AL, Beall BW. Revisiting pneumococcal carriage by use of broth enrichment and PCR techniques for enhanced detection of carriage and serotypes. J Clin Microbiol. 2010;48(5):1611–8.

    Article  CAS  Google Scholar 

  48. Chien YW, Vidal JE, Grijalva CG, Bozio C, Edwards KM, Williams JV, Griffin MR, Verastegui H, Hartinger SM, Gil AI, et al. Density interactions among Streptococcus pneumoniae, Haemophilus influenzae and Staphylococcus aureus in the nasopharynx of young Peruvian children. Pediatr Infect Dis J. 2013;32(1):72–7.

    Article  Google Scholar 

  49. Olwagen CP, Adrian PV, Madhi SA. Comparison of traditional culture and molecular qPCR for detection of simultaneous carriage of multiple pneumococcal serotypes in African children. Sci Rep. 2017;7(1):4628.

    Article  Google Scholar 

  50. Turner P, Hinds J, Turner C, Jankhot A, Gould K, Bentley SD, Nosten F, Goldblatt D. Improved detection of nasopharyngeal cocolonization by multiple pneumococcal serotypes by use of latex agglutination or molecular serotyping by microarray. J Clin Microbiol. 2011;49(5):1784–9.

    Article  Google Scholar 

  51. Mauffrey F, Fournier E, Demczuk W, Martin I, Mulvey M, Martineau C, Levesque S, Bekal S, Domingo MC, Doualla-Bell F, et al. Comparison of sequential multiplex PCR, sequetyping and whole genome sequencing for serotyping of Streptococcus pneumoniae. PLoS One. 2017;12(12):e0189163.

    Article  Google Scholar 

  52. Morais L, Carvalho Mda G, Roca A, Flannery B, Mandomando I, Soriano-Gabarro M, Sigauque B, Alonso P, Beall B. Sequential multiplex PCR for identifying pneumococcal capsular serotypes from south-Saharan African clinical isolates. J Med Microbiol. 2007;56(Pt 9):1181–4.

    Article  CAS  Google Scholar 

  53. Dias CA, Teixeira LM, Carvalho Mda G, Beall B. Sequential multiplex PCR for determining capsular serotypes of pneumococci recovered from Brazilian children. J Med Microbiol. 2007;56(Pt 9):1185–8.

    Article  CAS  Google Scholar 

  54. Jauneikaite E, Tocheva AS, Jefferies JM, Gladstone RA, Faust SN, Christodoulides M, Hibberd ML, Clarke SC. Current methods for capsular typing of Streptococcus pneumoniae. J Microbiol Methods. 2015;113:41–9.

    Article  CAS  Google Scholar 

  55. Song JH, Dagan R, Klugman KP, Fritzell B. The relationship between pneumococcal serotypes and antibiotic resistance. Vaccine. 2012;30(17):2728–37.

    Article  CAS  Google Scholar 

  56. Danino D, Givon-Lavi N, Ben-Shimol S, Greenberg D, Dagan R. Understanding the evolution of antibiotic-nonsusceptible pneumococcal nasopharyngeal colonization following pneumococcal conjugate vaccines implementation in young children. Clin Infect Dis. 2018.

  57. Carvalho MG, Pimenta FC, Moura I, Roundtree A, Gertz RE Jr, Li Z, Jagero G, Bigogo G, Junghae M, Conklin L, et al. Non-pneumococcal mitis-group streptococci confound detection of pneumococcal capsular serotype-specific loci in upper respiratory tract. PeerJ. 2013;1:e97.

    Article  Google Scholar 

  58. Pimenta F, Gertz RE Jr, Park SH, Kim E, Moura I, Milucky J, Rouphael N, Farley MM, Harrison LH, Bennett NM, et al. Streptococcus infantis, Streptococcus mitis, and Streptococcus oralis strains with highly similar cps5 loci and antigenic relatedness to serotype 5 pneumococci. Front Microbiol. 2018;9:3199.

    Article  Google Scholar 

Download references

Acknowledgements

We thank the study team and the Medical Officers in Palwal for their assistance and the children and their parents for participating in the study.

Funding

This study was supported by a grant from the Bill & Melinda Gates Foundation (OPP1114237). The funder provided input on the design of the study, but had no role in the collection, analysis, and interpretation of the data, or in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

CGS was responsible for designing the study, supervising study implementation, leading the analysis and writing the manuscript. AS was responsible for designing the study, supervising study implementation, and reviewing the manuscript. RK, RKS, AM, and SC were responsible for implementing the study and collecting the data in India and reviewing the manuscript. RV and BV were responsible for performing the laboratory work and reviewing the manuscript. BW was responsible for assisting with data analysis and writing the manuscript. JS was responsible for data analysis and reviewing the manuscript. MS was responsible for study conception and design, securing the funding, and reviewing the manuscript. NKA was responsible for study conception and design, supervising study implementation, and reviewing the manuscript.

Corresponding authors

Correspondence to Catherine G. Sutcliffe or Narendra K. Arora.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the institutional review boards at the Johns Hopkins Bloomberg School of Public Health (Baltimore, United States) and the INCLEN Trust International (New Delhi, India). For all children, written informed consent was obtained from the primary caregiver before enrollment in the study.

Consent for publication

Not applicable.

Competing interests

AS received an institutional research grant from Pfizer Inc. to conduct other related work. All other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Prevalence of pneumococcal colonization by age among children in Palwal, India. The figure depicts the prevalence of pneumococcal colonization by age (in months) among children 2–59 months of age enrolled from the community in Palwal, India from December 2016 to July 2017. Black bars represent the prevalence of colonization with PCV13 serotypes while grey bars represent the prevalence of colonization with non-PCV13 serotypes. (PPTX 58 kb)

Additional file 2:

Serotype-specific prevalence of nasopharyngeal colonization among children 2–59 months of age in Palwal, India. The table shows the prevalence of overall, vaccine-type, and serotype-specific pneumococcal colonization by study population. In addition, the crude prevalence ratio and 95% confidence intervals comparing the prevalence of colonization between children with clinical pneumonia to community children are presented. (DOCX 19 kb)

Additional file 3:

Distribution of serotypes among children colonized with Streptococcus pneumoniae in Palwal, India. The figure depicts the distribution of pneumococcal serotypes found colonizing the nasopharynx by study population. Black bars represent children with clinical pneumonia and white bars represent community children. (PPTX 62 kb)

Additional file 4:

Serotype coverage and nasopharyngeal colonization among children 2–59 months of age in Palwal, India. The table shows the serotype coverage and prevalence of colonization with vaccine-type serotypes for different vaccines. Results are presented by study population. For this analysis, when PCR produced a serogroup (e.g. 6A/B/C/D) instead of a vaccine serotype (e.g. 6B), the serogroup was assumed to be vaccine-type, and thus maximum coverage and colonization are presented. (DOCX 17 kb)

Additional file 5:

Serotype-specific antimicrobial resistance among pneumococcal isolates in Palwal, India. The table shows levels of serotype-specific antimicrobial resistance among all pneumococcal isolates. Results for both study populations were combined. Only serotypes with results from a minimum of 5 children are reported. (DOCX 22 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sutcliffe, C.G., Shet, A., Varghese, R. et al. Nasopharyngeal carriage of Streptococcus pneumoniae serotypes among children in India prior to the introduction of pneumococcal conjugate vaccines: a cross-sectional study. BMC Infect Dis 19, 605 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12879-019-4254-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12879-019-4254-2

Keywords