Hostname: page-component-586b7cd67f-2plfb Total loading time: 0 Render date: 2024-11-27T01:16:50.090Z Has data issue: false hasContentIssue false

Pooled influenza vaccine effectiveness estimates for Australia, 2012–2014

Published online by Cambridge University Press:  29 April 2016

S. G. SULLIVAN*
Affiliation:
WHO Collaborating Centre for Reference and Research on Influenza at the Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, Australia; Department of Epidemiology, University of California, Los Angeles, California, USA; Discipline of General Practice, University of Adelaide, Adelaide, South Australia, Australia; School of Population and Global Health, University of Melbourne, Victoria, Australia;
K. S. CARVILLE
Affiliation:
Victorian Infectious Diseases Reference Laboratory at the Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, Australia;
M. CHILVER
Affiliation:
Discipline of General Practice, University of Adelaide, Adelaide, South Australia, Australia;
J. E. FIELDING
Affiliation:
School of Population and Global Health, University of Melbourne, Victoria, Australia; Victorian Infectious Diseases Reference Laboratory at the Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, Australia; National Centre for Epidemiology and Public Health, Australian National University, Canberra, Australia;
K. A. GRANT
Affiliation:
Victorian Infectious Diseases Reference Laboratory at the Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, Australia;
H. KELLY
Affiliation:
School of Population and Global Health, University of Melbourne, Victoria, Australia; Victorian Infectious Diseases Reference Laboratory at the Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, Australia; National Centre for Epidemiology and Public Health, Australian National University, Canberra, Australia;
A. LEVY
Affiliation:
PathWest Laboratory Medicine, Perth, Western Australia, Australia; School of Pathology and Laboratory Medicine, University of Western Australia, Perth, Western Australia, Australia;
N. P. STOCKS
Affiliation:
Discipline of General Practice, University of Adelaide, Adelaide, South Australia, Australia;
S. S. TEMPONE
Affiliation:
PathWest Laboratory Medicine, Perth, Western Australia, Australia;
A. K. REGAN
Affiliation:
School of Pathology and Laboratory Medicine, University of Western Australia, Perth, Western Australia, Australia; Communicable Diseases Control Directorate, Western Australian Department of Health, Perth, Western Australia, Australia
*
*Author for correspondence: Dr S. G. Sullivan, WHO Collaborating Centre for Reference and Research on Influenza at the Peter Doherty Institute for Infection and Immunity, 792 Elizabeth Street, Melbourne, VIC 3000, Australia. (Email: [email protected])
Rights & Permissions [Opens in a new window]

Summary

Data were pooled from three Australian sentinel general practice influenza surveillance networks to estimate Australia-wide influenza vaccine coverage and effectiveness against community presentations for laboratory-confirmed influenza for the 2012, 2013 and 2014 seasons. Patients presenting with influenza-like illness at participating GP practices were swabbed and tested for influenza. The vaccination odds of patients testing positive were compared with patients testing negative to estimate influenza vaccine effectiveness (VE) by logistic regression, adjusting for age group, week of presentation and network. Pooling of data across Australia increased the sample size for estimation from a minimum of 684 to 3,683 in 2012, from 314 to 2,042 in 2013 and from 497 to 3,074 in 2014. Overall VE was 38% [95% confidence interval (CI) 24–49] in 2012, 60% (95% CI 45–70) in 2013 and 44% (95% CI 31–55) in 2014. For A(H1N1)pdm09 VE was 54% (95% CI–28 to 83) in 2012, 59% (95% CI 33–74) in 2013 and 55% (95% CI 39–67) in 2014. For A(H3N2), VE was 30% (95% CI 14–44) in 2012, 67% (95% CI 39–82) in 2013 and 26% (95% CI 1–45) in 2014. For influenza B, VE was stable across years at 56% (95% CI 37–70) in 2012, 57% (95% CI 30–73) in 2013 and 54% (95% CI 21–73) in 2014. Overall VE against influenza was low in 2012 and 2014 when A(H3N2) was the dominant strain and the vaccine was poorly matched. In contrast, overall VE was higher in 2013 when A(H1N1)pdm09 dominated and the vaccine was a better match. Pooling data can increase the sample available and enable more precise subtype- and age group-specific estimates, but limitations remain.

Type
Original Papers
Copyright
Copyright © Cambridge University Press 2016 

INTRODUCTION

Increasingly, it is recognized that annual estimates of influenza vaccine effectiveness (VE) are necessary given frequent changes to the vaccine composition as well as the circulating strains. In Australia, annual estimates for influenza VE using a general practitioner (GP) sentinel surveillance network have been published from Victoria, Australia, since 2009 [Reference Kelly1]. However, until recently [Reference Sullivan2Reference McAnerney5] these have been the only VE estimates regularly reported from the Southern Hemisphere. The generalizability of estimates from Victoria applied to the rest of Australia is unclear. A further problem with estimating VE from a single surveillance network is that there are often insufficient data generated to provide estimates by influenza type/subtype or age group. There may also be too few data for interim estimates. Thus, there is a need to increase the information available for calculating VE estimates for Australia.

Australia has three sentinel networks for influenza-like illness (ILI) surveillance in general practice. These are the Victorian Sentinel Practice Influenza Network (VicSPIN) [Reference Kelly1], the Australian Sentinel Practices Research Network (ASPREN) [6, Reference Parrella7] and the Sentinel Practitioners Network of Western Australia (SPNWA) [Reference Levy3]. While VicSPIN and SPNWA perform surveillance for their respective states, ASPREN manages surveillance in the remaining six states and territories and also has several GPs in Victoria. VE estimates have previously been published from these networks for 2012 [Reference Sullivan2, Reference Levy3, Reference Sullivan, Tay and Kelly8Reference Sullivan10] and 2013 [Reference Carville11], but not 2014. In those analyses, samples were too small to enable estimates for specific age groups, such as children aged <5 years or the elderly. VE is expected to vary within age groups, given the varying level of exposure across the lifetime, the relative immaturity of the very young immune system [Reference Widdowson, Monto and Wenster12] and immunosenescence in the elderly [Reference Haq and McElhaney13]. Thus there is a compelling need to estimate VE within age groups. Similarly, VE is expected to vary by influenza type and subtype [Reference Sullivan, Feng and Cowling14]. Prior to 2015, influenza vaccines in Australia were all trivalent vaccines, containing an A(H3N2), A(H1N1)pdm09 and B component. So, while it is of public health interest to understand the overall performance of the vaccine, it is also helpful to estimate the effectiveness of each component.

The three Australian influenza surveillance networks use similar methods to collect information on patients presenting with ILI to sentinel GPs and can use the test-negative design to estimate VE [Reference Kelly1Reference Levy3]. These similarities mean the data can be easily pooled for estimation of nationwide VE. Pooling individual data across similarly designed studies has several advantages over individual reports or conventional meta-analyses of published estimates. First, the definitions and categorization of exposure, outcome and important confounders can be standardized [Reference Smith-Warner15]. Moreover, a uniform statistical model can be used, further eliminating analytical inconsistencies [Reference Blettner and Sauerbrei16]. Variations in these parameters may be important sources of heterogeneity in studies of influenza VE [Reference Sullivan, Feng and Cowling14]. Second, pooling data across studies increases the available sample size, which may permit subgroup analyses of the association of interest with greater statistical power than is possible in a single study [Reference Smith-Warner15]. In the case of influenza, pooling may permit estimation for groups which are typically under-represented in individual studies, such as young children and individuals with medical conditions, and importantly can enable evaluation of VE by subtype.

The purpose of the present study was to use data from three surveillance networks to calculate influenza VE estimates for all of Australia, as is regularly done in Europe [Reference Kissling17], Canada [Reference Skowronski18] and the United States [Reference Ohmit19].

METHODS

Study design

Data for 2012, 2013 and 2014 from three influenza surveillance networks were used. Together, these networks included 256 GPs (ASPREN, 100; SPNWA, 64, VicSPIN, 92) in 2012, 262 GPs (ASPREN, 97; SPNWA, 71, VicSPIN, 94) in 2013 and 354 GPs (ASPREN, 177; SPNWA, 82, VicSPIN, 95) in 2014. Surveillance is year-round in ASPREN and SPNWA, but only from May to October (inclusive) in Victoria. Patients presenting with ILI (fever, cough, fatigue) were asked for nasal and throat swabs at the participating GPs’ discretion. GPs collected demographic data (age, sex) and vaccination status. Since 2012, VicSPIN and SPNWA GPs additionally collected information about any comorbidities that could increase the risk of severe influenza, while ASPREN began collecting this information in 2014. Moreover, since 2012, VicSPIN collected patients’ influenza status for the previous year, while ASPREN began collecting these data in 2014 and SPNWA does not collect this information.

Vaccination status was obtained via patient's medical record or patient's self-report. During 2012–2014 vaccines were produced by six manufacturers [20], but manufacturers’ data were not collected in this study so all were assumed to have equal effectiveness. Vaccine components for each year are summarized in Table 1. Patients with an unknown vaccination status were excluded from the study. We could not exclude patients on the basis of presenting too soon after vaccination, as the date of vaccination and date of onset were not collected by SPNWA or ASPREN. However, VicSPIN data suggested these were few in number.

Table 1. Patients’ characteristics by vaccination status, 2012–2014

ASPREN, Australian Sentinel Practices Research Network; VicSPIN: Victoria Sentinel Practices Network; SPNWA, Sentinel Practitioners Network of Western Australia; A(NS), A, not subtyped; LR, low reactor.

Values given are n (%).

P values are for the χ 2 test. No test performed for haemagglutination inhibition data.

* Included in the 2012 vaccine.

Included in the 2013 vaccine.

Included in the 2014 vaccine.

Laboratory methods

Respiratory specimens were collected by GPs using pre-prepared kits. ASPREN doctors collected samples using Copan flocked swabs (Copan Diagnostics, USA) in 3 ml universal transport medium (UTM), SPNWA doctors collected two nasal and one throat swab using Copan Mini Tip flocked swabs in virus transport medium and VicSPIN doctors used Copan flocked swabs in 3 ml UTM. Samples were sent to SA Pathology (for ASPREN), PathWest Laboratory Medicine (for SPNWA) or the Victorian Infectious Diseases Reference Laboratory (VIDRL) (for VicSPIN) for testing. PathWest and VIDRL are national influenza centres, while SA Pathology is the public reference laboratory for the state of South Australia. Influenza was detected by real-time RT–PCR using in-house primers. Both the type and subtype were identified; however, SA Pathology only tested for A(H1N1)pdm09 and not A(H3N2) in 2012. Samples that were ‘type A, not A(H1N1)pdm09’ were treated as A(H3N2), based on virus characterization data available on a subset of these samples.

All influenza-positive specimens from VicSPIN, those with cycle threshold ⩽30 from ASPREN and those able to be isolated in culture at SPNWA were forwarded to the WHO Collaborating Centre for Reference and Research on Influenza in Melbourne where they were further characterized to identify the virus strain using the haemagglutination inhibition (HI) assay, as previously described [Reference Sullivan10, Reference Hobson21]. Isolates were identified as antigenically similar to the cell- or egg-propagated vaccine strain if the test samples had a titre that was ⩽fourfold different compared to the homologous vaccine reference strain. Results were reported against reference antisera raised against the vaccine strains.

Statistical analysis

All analyses were conducted in Stata version 12 (StataCorp., USA). Patients’ characteristics by influenza status and vaccination status were compared by odds ratio (OR) and χ 2 test for categorical variables. All P values were two-sided.

To estimate VE, data were analysed using a test-negative design [Reference Jackson and Nelson22Reference Skowronski24] where the exposure (vaccination) odds among those testing positive for influenza by RT–PCR were compared to those testing negative; i.e. VE = 1 – ORadj × 100%. Estimates were adjusted for known confounders, selected a priori, including age group (<5, 5–17, 18–64, ⩾65 years), date of consultation modelled as a cubic spline with four knots, and network. Estimates were made for the periods of epidemic activity in each network. This period began when a positive case had been reported for two consecutive weeks at least 2 weeks after the annual vaccination campaign (mid-March) and ended after the peak when no case had been reported for at least 3 weeks. Prior to pooling, the data were meta-analysed, using the ‘metan’ command [Reference Harris25], to identify potential heterogeneity issues. The I 2 statistic was inspected and summary estimates were made using both fixed and random effects, where large discrepancies between the two were indicative of poor fit of the summary model [Reference Greenland26, Reference Friedenreich27]. The data were then pooled and modelled as described above, including a fixed effect for the network. Estimates were stratified by type/subtype as well as age group (<18, 18–64, ⩾65 years). In a sensitivity analysis, data were multiply imputed using chained equations and VE estimated using the imputed data (n = 20 imputed datasets). Where there were fewer than four vaccinated cases (or unvaccinated cases) in an analysis or where the imputed model and the complete case model differed by >10 percentage points, the estimates were not reported because of potential sparse data bias [Reference Greenland28].

Ethical considerations

ASPREN data were de-identified and obtained in accordance with National Health Security Act 2007. Therefore, Human Research Ethics Committee approval was not required. VicSPIN data were collected, used and reported under the legislative authorization of the Victorian Public Health and Wellbeing Act 2008 and Public Health and Wellbeing Regulations 2009 and thus did not require Human Research Ethics Committee approval. The SPNWA system is implemented by the Communicable Disease Control Directorate of the WA Department of Health as part of routine public health surveillance. Human Research Ethics Committee approval is not required.

RESULTS

Patients who consented to provide a swab sample for the surveillance networks in 2012, 2013 and 2014 numbered 4115, 2371 and 3570, respectively. Of these, 432, 329 and 496 were excluded (see Supplementary Table S1). In 2012, ILI presentations peaked in week 28 and continued until week 51 (Fig. 1). In contrast, presentations in 2013 peaked much later in week 36 and continued until the end of the year. In 2014, presentations peaked in week 33 and continued until week 48.

Fig. 1. Presentation of cases by influenza status.

Patient characteristics are shown by vaccination status in Table 1 and by influenza status in Table 2. The 2012 season was characterized by a higher percentage of positive tests (40%) than 2013 (22%) or 2014 (29%), and the dominant virus was A(H3N2) (69% of confirmed influenza cases) (Table 2). In 2013, A(H3N2) viruses were least frequent (22%) and the majority of viruses (39%) were influenza B, followed closely by A(H1N1)pdm09 (36%). In 2014, A(H1N1)pdm09 was dominant (46%), followed by A(H3N2) (39%). HI assays suggested that most viruses were antigenically similar to their relevant influenza A vaccine strain (Table 1), but in 2013 and 2014 were poorly matched to the influenza B strain. In addition, in 2013 and 2014, A(H3N2) viruses showed good antigenic match to the cell-propagated strain (Table 1) but all were low reactors to the egg-propagated strain (data not shown).

Table 2. Patients’ characteristics by influenza status, 2012–2014

ASPREN, Australian Sentinel Practices Research Network; VicSPIN, Victoria Sentinel Practices Network; SPNWA, Sentinel Practitioners Network of Western Australia; Values given are n (%).

The proportion of vaccinated patients ranged from 23% in 2012 to 29% in 2013 and was generally higher in women than men (Table 1). In addition, vaccine coverage increased with increasing age, being very low in young children (<5 years) at 3–5% and relatively high in the elderly (>65 years) at 68–77%.

Preliminary analysis indicated moderate heterogeneity, with I 2 ranging from 35% in 2012 to 54% in 2014 (Fig. 2). The fixed- and random-effects estimates were consistent and did not highlight any major heterogeneity problems. Based on these two metrics, data were pooled for VE estimation. VE estimates for each age group with type/subtype are presented in Figure 3. Estimates and their sample sizes are shown in Supplementary Table S2. VE estimates obtained using the imputed data were generally within a percentage point of the complete-case analysis. Thus, they did not suggest any substantial bias in the complete-case analysis.

Fig. 2. Forest plots showing results of the initial exploration of heterogeneity by meta-analysis of unpooled data against all influenza types. Data for each year suggested moderate heterogeneity of around 35–54% according to I 2. I 2 represents variation in vaccine effectiveness attributable to heterogeneity. This statistic measures overlap between the confidence intervals and point estimates among studies. For example, the heterogeneity in 2012 has resulted from failure of the confidence interval of ASPREN to overlap the point estimate of SPNWA (and vice versa). Random-effects model from the DerSimonian & Laird method [Reference Harris25]. Fixed-effects estimate from the Mantel–Haenszel method. Cochran's P value not shown as it is underpowered. ASPREN, Australian Sentinel Practices Research Network; VicSPIN, Victorian Sentinel Practice Influenza Network; SPNWA, Sentinel Practitioners Network of Western Australia.

Fig. 3. Vaccine effectiveness and 95% confidence interval [VE (95% CI)] estimates by age group within types/subtypes.

VE for any type of influenza for all patients was 38% [95% confidence interval (CI) 24–49] in 2012, 60% (95% CI 45–70) in 2013 and 44% (95% CI 31–55) in 2014. For influenza A(H1N1)pdm09, VE estimates were similar across the seasons studied at 54% (95% CI –28 to 83) in 2012, 59% (95% CI 33–74) in 2013 and 55% (95% CI 39–67) in 2014. There were insufficient data available to make estimates for this subtype for children or the elderly in 2012 or 2013.

For influenza A(H3N2), VE for all age groups was low in 2012 at 30% (95% CI 14–44) and in 2014 at 26% (95% CI 1–45), but higher in 2013 at 67% (95% CI 39–82). Point estimates were lowest for the elderly in 2014 and highest for working-age adults in 2013. There were too few data to make a reliable estimate for the elderly or children in 2013, nor were there sufficient data to make estimates for children aged <5 years in 2014.

For influenza B, VE point estimates were similar in all years, despite the change in dominant lineage. Estimates for all ages were 56% (95% CI 37–70) in 2012, 57% (95% CI 30–73) in 2013 and 54% (95% CI 21–73) in 2014. There were too few vaccinated cases to estimate VE for children aged <5 years in any year, or for children aged <18 years in 2013 and 2014, and there were too few unvaccinated cases to estimate VE in the elderly in 2014.

DISCUSSION

In this study, data from three influenza surveillance schemes were pooled to increase the sample used and enable estimation of influenza VE within types/subtypes and age groups. This permitted estimation of VE for A(H1N1)pdm09 in 2012, which had not previously been possible using only the VicSPIN or ASPREN data [Reference Sullivan2, Reference Sullivan10] and permitted type-/subtype-specific estimation within some age groups, which had not previously been reported for the years studied [Reference Sullivan2, Reference Levy3, Reference Sullivan10, Reference Carville11]. In 2012, the VE estimates reported by these three networks were 23% (95% CI –4 to 43) for ASPREN, 45% (95% CI 8–66) for VicSPIN, and 49% (95% CI 30–63) for SPNWA, while the summary estimate reported in this study was within this range at 38% (95% CI 24–49). The pooled estimate was within the range of the previous estimate and had higher precision (see Supplementary Table S3). For other comparisons, only an A(H3N2) estimate was previously reported by all these networks in 2012. Again, the pooled estimate fell within the range of the published estimates. For other subtypes and for age groups, only SPNWA and ASPREN were able to report previously. Published estimates were similar to the pooled estimates for influenza B and for the elderly. For children aged <18 years and adults, the pooled estimate fell between the two published estimates. It should be noted that the statistical model used, the exclusion criteria applied and the statistical power in the published studies varied. Exploration of heterogeneity for the overall estimates revealed moderate heterogeneity. Heterogeneity was not explored within types/subtypes and may have been greater in these subgroups given the reduced sample size. However, this may not be reflected in the metrics used to detect heterogeneity, which would have reduced power in subgroup analysis.

Our VE estimates compared variably with those reported elsewhere. For example, our VE estimate for A(H1N1)pdm09 was 54% (95% CI –28 to 83) in 2012, which was lower than estimates reported from the United States (VE 65%, 95% CI 44–79) [Reference Ohmit19] and Canada (VE 80%, 95% CI 52–92) [Reference Skowronski18]. Our 2013 estimate for A(H1N1)pdm09 was 59% (95% CI 33–74) and not substantially different from New Zealand's (49%, 95% CI –90 to 86) [Reference Turner4], Europe's (50%, 95% CI 28–66) [Reference Kissling29] or Canada's (59%, 95% CI 16–80%) [Reference Skowronski30]. The 2014 estimate of 55% (95% CI 39–67) was close to New Zealand's (VE 59%, 95% CI 36–74) [Reference Pierse31] and Greece's (VE 57%, 95% CI 23–76) [Reference Lytras32]. For A(H3N2), our 2012 estimate was 30% (95% CI 14–44), and similar to the UK's estimate (VE 26%, 95% CI –4 to 48) [Reference Andrews33] and Canada's (VE 41%, 95% CI 17–59). The 2013 estimate at 67% (95% CI 39–82) was similar to the estimate from New Zealand (VE 61%, 95% CI 32–77), but higher than several estimates from the Northern Hemisphere 2012/2013 season [Reference Kissling29, Reference Andrews33, Reference Yang34]. The 2014 A(H3N2) estimate was low (VE 26%, 95% CI 1–45), which was in line with other reports for that season [Reference Pierse31, Reference Jimenez-Jorge35]. In all years, most point estimates for influenza B, including ours, were around 50–60% [Reference Turner4, Reference Ohmit19, Reference Kissling29, Reference Pierse31, Reference Andrews33, Reference Castilla36].

Despite pooling, there remained too few cases for some of the analyses attempted. For example, vaccination coverage was too low in young children aged <5 years to permit estimation for A(H1N1)pdm09 in 2012 or for any influenza type/subtype in 2013 or 2014. Vaccination coverage in young children in Australia is generally very low. In Western Australia, the government began subsidising influenza vaccination for children aged <5 years in 2008, which substantially increased uptake; surveillance data indicated uptake around 50% in 2008–2009 [Reference Blyth37]. However, serious adverse reactions to the 2010 vaccine in some children led to a loss of consumer confidence [Reference Kelly38], and in 2012 only 10·1% of children were vaccinated, half of whom were only partially vaccinated [Reference Blyth37]. At such low coverage, the power to see a modest effect (e.g. 50%) is extremely limited and a sample consisting of at least 365 influenza-positive cases is required to gain statistical significance (assuming a case-control ratio of 3:1, at α = 0·05, β = 0·2). Infections in children are proportionally more common than infections in adults and the health and economic costs of infection in this group are significant [Reference Ampofo39Reference Poehling43]. However, reliable information on the effectiveness of the inactivated vaccine in children is scant [Reference Jefferson44]. In this study, despite pooling data across networks estimation of type-/subtype-specific VE in young children was not possible. Thus, there is a compelling need to scale up influenza surveillance activities in children and other groups with low vaccination uptake.

There were also insufficient cases of A(H1N1)pdm09 in the elderly to permit estimation. Low A(H1N1)pdm09 infection rates in the elderly have been reported since the pandemic in 2009 [Reference Booy45], a phenomenon attributed to prior infection with a similar influenza strain many years earlier [Reference Hancock46, Reference Miller47]. In contrast, A(H3N2) viruses tend to exhibit more rapid antigenic and genetic drift than A(H1N1)pdm09 viruses [Reference Hay48, Reference Neuzil and Bright49], resulting in continued vulnerability throughout an individual's lifetime. Indeed, in this study the proportion of elderly patients with A(H3N2) in 2012 was similar to the overall proportion of patients testing positive for A(H3N2) and that for children, at around 30%. For A(H3N2), VE was modest in the elderly in 2012 and was not estimated in 2013 due to the low number of vaccinated cases, again highlighting that pooling has not adequately overcome sample size limitations for subtype-/age group-specific estimates using current surveillance programmes in Australia.

Despite the change to the B lineage included in the vaccine between 2012 and 2013 (i.e. from Victoria to Yamagata), VE point estimates were the same. In contrast, VE against A(H3N2) was poor in 2012 when A(H3N2) dominated and most viruses were antigenically similar to the vaccine strain, A/Perth/16/2009. Estimates were paradoxically moderate in 2013 when all isolated A(H3N2) viruses were low reactors to the egg-propagated reference strain. Egg-acquired adaptations in the vaccine's A(H3N2) strain resulted in poor VE globally in 2012 [Reference Skowronski30], so VE was expected to be similarly low in Australia in 2013 and 2014. Genetic analysis was not routinely performed in these networks, so it was not possible to perform a thorough examination of clade variation that may have explained the relatively high VE for influenza A(H3N2) in 2013 compared to Northern Hemisphere estimates for the previous and following seasons. Limited genetic information from Victoria in 2012 [Reference Sullivan10] suggested about half of viruses fell into a genetic clade that differed from the vaccine clade, but no clustering by vaccination status was observed. Increasingly, evidence is surfacing that both antigenic and genetic matches between the vaccine and circulating strains correlates poorly with VE estimates and may vary with the virus type/subtype [Reference Sullivan10, Reference Skowronski50, Reference Tricco51]. Great efforts are being made to explore alternative options for measuring antigenic match [Reference Barr52].

This study had several limitations. First, the decision to pool was made retrospectively, so the data collection instruments did not collect exactly the same information across networks. For example, not all networks collected the date of vaccination so we were unable to exclude patients who presented too soon after vaccination, and who may have been misclassified as vaccinated. Moreover, how vaccination status was ascertained was not recorded and in many cases may have been by self-report. This may be an underappreciated source of measurement error in studies of influenza VE [Reference Sullivan, Feng and Cowling14]. Study coordinators are investigating the use of abstracting vaccination status and testing results from GP practice software for the purpose of measuring VE [Reference Regan53]. Second, the date of symptom onset was also not routinely collected, so we were unable to remove patients presenting too late after onset. GPs were instructed to only sample patients presenting within 4 days of illness onset, but study coordinators are aware that this stipulation is not strictly adhered to. Exclusion of patients who present too late can have quite an impact on VE point estimates [Reference Sullivan, Feng and Cowling14]. In theory, non-differential misclassification of outcome status due to poor sensitivity should only minimally bias estimates [Reference Sullivan, Feng and Cowling14]. This has been the case in VicSPIN, where applying a restriction reduced adjusted VE estimates by 7–15% in 2007 [Reference Fielding54], 5–35% in 2008 [Reference Fielding54], 0–3% in 2010 [Reference Fielding55], 2–14% in 2011 [Reference Fielding56] and 7% in 2013 [Reference Carville11]. Third, we were unable to adjust for the presence of comorbidities which might increase a person's likelihood of vaccination and infection. Although this information was collected by all networks in 2014, collection was inconsistent and precluded its use. In any case, interim estimates from Canada in 2013 and 2014 suggested that the inclusion of a variable indicating the presence of comorbid conditions resulted in minimal changes to point estimates and confidence intervals [Reference Skowronski57, Reference Skowronski58]. Moreover, many conditions included in this category affect susceptibility to a severe infection, but not infection itself and thus do not fulfil the conditions for confounding.

We did not combine estimates across the seasons studied. Figure 1 clearly shows that the severity of the season and predominant strains for each season differed substantially, so the outcomes of interest differed across seasons. Moreover, there were changes made to the vaccine between 2012 and 2014, so the exposure of interest also differed by season. Such differences are the justification for estimating VE each season, and this rationale should be equally applied to the pooling of VE estimates. While meta-analyses have reported summary estimates that combine data across seasons [Reference Osterholm59, Reference Darvishian60], this may not be sensible practice. Similarly, although reported here, there may be limited value in reporting an overall VE estimate combining data for A(H1N1)pdm09, A(H3N2) and B viruses. There is substantial evidence that VE varies by type/subtype [Reference Sullivan, Feng and Cowling14], and the estimation of an overall effect masks problems with the vaccine, particularly for the A(H3N2) viruses [Reference Skowronski30]. However, this is often the estimate of interest to public health practitioners and provides a single estimate comparable across seasons.

Analogously, it could be argued that combining data across geographically disparate areas could result in too much heterogeneity to enable reliable estimation of effect. This might be particularly true if there are latitudinal variations. Australia experiences a range of climates, from tropical to temperate to alpine. The epidemic period can vary between such climates [Reference Tamerius61Reference Koul63], and in Northern Australia, there is often influenza activity around March, far earlier than the winter season. However, the population density in the far north of Australia is low. There were only six SPNWA and 11 ASPREN GPs obtaining samples in tropical regions. In addition, the main epidemic period in the Northern Territory tends to coincide with that of southern, temperate regions of the country [64]. Finally, cases from March would be excluded in this analysis as they precede or coincide with the roll-out of the vaccine. If people infected in March were then more likely to get vaccinated, it could inflate VE estimates, because their natural immunity would protect them, not the vaccine. However, because their populations are small, it is unlikely these geographical variations will have influenced the results here.

In summary, pooling of Australia-wide data enabled estimation of subtype-specific VE estimates, although there continued to be insufficient sample for some age group-specific subtype estimates. Increased study power arising from pooling of data may eventually mean other VE strata can be considered, such as vaccine brand, which is not routinely collected by any of the three networks but may be possible to obtain through abstraction of data from GP practice software and the recent establishment of an adult vaccination register in Australia. Data pooling may also prove useful for improving the precision of interim VE estimates. Australia currently does not routinely publish interim VE estimates, but does contribute data to the vaccine strain selection meeting [Reference Barr52]. Harmonization of the data collected by the networks has already begun which will also enable better integration of the data, reduce residual heterogeneity, and permit adjustment for variables, such as comorbidity status.

SUPPLEMENTARY MATERIAL

For supplementary material accompanying this paper visit http://dx.doi.org/10.1017/S0950268816000819.

ACKNOWLEDGEMENTS

We gratefully acknowledge all practices and general practitioners who participated in sentinel surveillance. We thank the laboratory staff of the SA Pathology, PathWest, the Victorian Infectious Diseases Reference Laboratory, and the WHO Collaborating Centre for Reference and Research on Influenza. Thanks also to Shuo Feng for assistance with Figure 3.

The Australian Sentinel Practices Research Network and the Melbourne WHO Collaborating Centre for Reference and Research on Influenza are supported by the Australian Government Department of Health. The Sentinel Practitioners Network of Western Australia is funded by the Western Australian Department of Health. The Victorian Sentinel Practice Influenza Network is funded by the Victorian Government Department of Health and Human Services.

DECLARATION OF INTEREST

None.

References

REFERENCES

1. Kelly, H, et al. Estimation of influenza vaccine effectiveness from routine surveillance data. PLoS ONE 2009; 4: e5079.Google Scholar
2. Sullivan, SG, et al. Influenza vaccine effectiveness in Australia: results from the Australian Sentinel Practices Research Network. Medical Journal of Australia 2014; 201: 109111.Google Scholar
3. Levy, A, et al. Influenza vaccine effectiveness estimates for Western Australia during a period of vaccine and virus strain stability, 2010 to 2012. Vaccine 2014; 32: 63126318.CrossRefGoogle ScholarPubMed
4. Turner, N, et al. Effectiveness of seasonal trivalent inactivated influenza vaccine in preventing influenza hospitalisations and primary care visits in Auckland, New Zealand, in 2013. Eurosurveillance 2014; 19.Google Scholar
5. McAnerney, JM, et al. Effectiveness and knowledge, attitudes and practises of seasonal influenza vaccine in primary health care settings in South Africa, 2010–2013. Influenza and Other Respiratory Viruses 2015; 9: 143150.Google Scholar
6. Anon. Surveillance systems reported in CDI, 2011. Communicable Diseases Intelligence Quarterly Report 2011; 35: 5559.Google Scholar
7. Parrella, A, et al. ASPREN surveillance system for influenza-like illness – a comparison with FluTracking and the National Notifiable Diseases Surveillance System. Australian Family Physician 2009; 38: 932936.Google Scholar
8. Sullivan, SG, Tay, EL, Kelly, H. Variable definitions of the influenza season and their impact on vaccine effectiveness estimates. Vaccine 2013; 31: 42804283.CrossRefGoogle ScholarPubMed
9. Sullivan, SG, Kelly, H. Late season interim estimates of influenza vaccine effectiveness reliably predict end of season estimates in Victoria, Australia, 2007–2012. Eurosurveillance 2013; 18: pii = 20605.CrossRefGoogle Scholar
10. Sullivan, SG, et al. Influenza vaccine effectiveness during the 2012 influenza season in Victoria, Australia: influences of waning immunity and vaccine match. Journal of Medical Virology 2014; 86: 10171025.Google Scholar
11. Carville, KS, et al. Understanding influenza vaccine protection in the community: an assessment of the 2013 influenza season in Victoria, Australia. Vaccine 2015; 33: 341345.CrossRefGoogle ScholarPubMed
12. Widdowson, MA, Monto, AS. Epidemiology of influenza. In: Wenster, RG, et al., eds. Textbook of Influenza, 2nd edn. Chichester, West Sussex, UK: Wiley Blackwell, 2013, pp. 254255.Google Scholar
13. Haq, K, McElhaney, JE. Immunosenescence: influenza vaccination and the elderly. Current Opinions in Immunology 2014; 29: 3842.Google Scholar
14. Sullivan, SG, Feng, S, Cowling, BJ. Potential of the test-negative design for measuring influenza vaccine effectiveness: a systematic review. Expert Review of Vaccines 2014; 13: 15711591.CrossRefGoogle ScholarPubMed
15. Smith-Warner, SA, et al. Methods for pooling results of epidemiologic studies: the Pooling Project of Prospective Studies of Diet and Cancer. American Journal of Epidemiology 2006; 163: 10531064.Google Scholar
16. Blettner, M, Sauerbrei, W. Influence of model-building strategies on the results of a case-control study. Statistics in Medicine 1993; 12: 13251338.Google Scholar
17. Kissling, E, et al. ‘I-MOVE’ towards monitoring seasonal and pandemic influenza vaccine effectiveness: lessons learnt from a pilot multi-centric case-control study in Europe, 2008–9. Euroaurveillance 2009; 14.Google Scholar
18. Skowronski, DM, et al. Influenza A/subtype and B/lineage effectiveness estimates for the 2011–2012 trivalent vaccine: cross-season and cross-lineage protection with unchanged vaccine. Journal of Infectious Diseases 2014; 210: 126137.CrossRefGoogle Scholar
19. Ohmit, SE, et al. Influenza vaccine effectiveness in the 2011–2012 season: protection against each circulating virus and the effect of prior vaccination on estimates. Clinical Infectious Diseases 2014; 58: 319327.CrossRefGoogle ScholarPubMed
20. Australian Government Department of Health and Ageing. Part 4: Vaccine-preventable diseases. In: The Australian Immunisation Handbook, 10th edn. Canberra: National Health and Medical Research Council, 2015, pp. 251256.Google Scholar
21. Hobson, D, et al. The role of serum haemagglutination-inhibiting antibody in protection against challenge infection with influenza A2 and B viruses. Journal of Hygiene 1972; 70: 767777.Google Scholar
22. Jackson, ML, Nelson, JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine 2013; 31: 21652168.Google Scholar
23. Orenstein, EW, et al. Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. International Journal of Epidemiology 2007; 36: 623631.Google Scholar
24. Skowronski, D, et al. Effectiveness of vaccine against medical consultation due to laboratory-confirmed influenza: results from a sentinel physician pilot project in British Columbia, 2004–2005. Canada Communicable Disease Report 2005; 31: 181191.Google Scholar
25. Harris, R, et al. metan: fixed- and random-effects meta-analysis. Stata Journal 2008; 8: 328.Google Scholar
26. Greenland, S. Invited commentary: a critical look at some popular meta-analytic methods. American Journal of Epidemiology 1994; 140: 290296.Google Scholar
27. Friedenreich, CM. Methods for pooled analyses of epidemiologic studies. Epidemiology 1993; 4: 295302.Google Scholar
28. Greenland, S. Bayesian perspectives for epidemiological research. II. Regression analysis. International Journal of Epidemiology 2007; 36: 195202.Google Scholar
29. Kissling, E, et al. Influenza vaccine effectiveness estimates in Europe in a season with three influenza type/subtypes circulating: the I-MOVE multicentre case-control study, influenza season 2012/13. Eurosurveillance 2014; 19.Google Scholar
30. Skowronski, DM, et al. Low 2012–13 influenza vaccine effectiveness associated with mutation in the egg-adapted H3N2 vaccine strain not antigenic drift in circulating viruses. PLoS ONE 2014; 9: e92153.Google Scholar
31. Pierse, N, et al. Influenza vaccine effectiveness for hospital and community patients using control groups with and without non-influenza respiratory viruses detected, Auckland, New Zealand 2014. Vaccine 2016; 34: 503509.Google Scholar
32. Lytras, T, et al. Influenza vaccine effectiveness against laboratory confirmed influenza in Greece during the 2013–2014 season: a test-negative study. Vaccine 2015; 33: 367373.CrossRefGoogle ScholarPubMed
33. Andrews, N, et al. Effectiveness of trivalent seasonal influenza vaccine in preventing laboratory-confirmed influenza in primary care in the United Kingdom: 2012/13 end of season results. Eurosurveillance 2014; 19: 513.CrossRefGoogle ScholarPubMed
34. Yang, P, et al. Influenza vaccine effectiveness against medically-attended influenza illness during the 2012–2013 season in Beijing, China. Vaccine 2014; 32: 52855289.Google Scholar
35. Jimenez-Jorge, S, et al. Interim influenza vaccine effectiveness: A good proxy for final estimates in Spain in the seasons 2010–2014. Vaccine 2015; 33: 32763280.Google Scholar
36. Castilla, J, et al. Decline in influenza vaccine effectiveness with time after vaccination, Navarre, Spain, season 2011/12. Eurosurveillance 2013; 18: pii = 20388.Google ScholarPubMed
37. Blyth, CC, et al. Effectiveness of trivalent flu vaccine in healthy young children. Pediatrics 2014; 133: e12181225.Google Scholar
38. Kelly, HA, et al. Adverse events associated with 2010 CSL and other inactivated influenza vaccines. Medical Journal of Australia 2011; 195: 318320.Google Scholar
39. Ampofo, K, et al. Epidemiology, complications, and cost of hospitalization in children with laboratory-confirmed influenza infection. Pediatrics 2006; 118: 24092417.Google Scholar
40. Bhat, N, et al. Influenza-associated deaths among children in the United States, 2003–2004. New England Journal of Medicine 2005; 353: 25592567.CrossRefGoogle ScholarPubMed
41. Grijalva, CG, et al. Estimating the undetected burden of influenza hospitalizations in children. Epidemiology and Infection 2007; 135: 951958.Google Scholar
42. Ji, W, et al. The epidemiology of hospitalized influenza in children, a two year population-based study in the People's Republic of China. BMC Health Services Research 2010; 10: 82.Google Scholar
43. Poehling, KA, et al. The underrecognized burden of influenza in young children. New England Journal of Medicine 2006; 355: 3140.Google Scholar
44. Jefferson, T, et al. Vaccines for preventing influenza in healthy children. Cochrane Database of Systematic Reviews 2012; 8: CD004879.Google Scholar
45. Booy, R, et al. Cross-reacting antibodies against the pandemic (H1N1) 2009 influenza virus in older Australians. Medical Journal of Australia 2011; 194: 1923.Google Scholar
46. Hancock, K, et al. Cross-reactive antibody responses to the 2009 pandemic H1N1 influenza virus. New England Journal of Medicine 2009; 361: 19451952.CrossRefGoogle Scholar
47. Miller, E, et al. Incidence of 2009 pandemic influenza A H1N1 infection in England: a cross-sectional serological study. Lancet 2010; 375: 11001108.Google Scholar
48. Hay, AJ, et al. The evolution of human influenza viruses. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences 2001; 356: 18611870.Google Scholar
49. Neuzil, KM, Bright, RA. Influenza vaccine manufacture: keeping up with change. Journal of Infectious Diseases 2009; 200: 835837.Google Scholar
50. Skowronski, DM, et al. Estimating vaccine effectiveness against laboratory-confirmed influenza using a sentinel physician network: results from the 2005–2006 season of dual A and B vaccine mismatch in Canada. Vaccine 2007; 25: 28422851.CrossRefGoogle Scholar
51. Tricco, AC, et al. Comparing influenza vaccine efficacy against mismatched and matched strains: a systematic review and meta-analysis. BMC Medicine 2013; 11: 153.Google Scholar
52. Barr, IG, et al. WHO recommendations for the viruses used in the 2013–2014 Northern Hemisphere influenza vaccine: Epidemiology, antigenic and genetic characteristics of influenza A(H1N1)pdm09, A(H3N2) and B influenza viruses collected from October 2012 to January 2013. Vaccine 2014; 32: 47134725.Google Scholar
53. Regan, A, et al. Electronic health record extraction from general practice for monitoring influenza vaccine coverage and effectiveness. Communicable Diseases Control Conference. Brisbane, Australia: Public Health Association of Australasia, 2015, pp. 52.Google Scholar
54. Fielding, JE, et al. Estimation of type- and subtype-specific influenza vaccine effectiveness in Victoria, Australia using a test negative case control method, 2007–2008. BMC Infectious Diseases 2011; 11: 170.CrossRefGoogle ScholarPubMed
55. Fielding, JE, et al. Effectiveness of seasonal influenza vaccine against pandemic (H1N1) 2009 virus, Australia, 2010. Emerging Infectious Diseases 2011; 17: 11811187.Google Scholar
56. Fielding, JE, et al. Moderate influenza vaccine effectiveness in Victoria, Australia, 2011. Eurosurveillance 2012; 17: pii = 20115.Google Scholar
57. Skowronski, D, et al. Interim estimates of influenza vaccine effectiveness in 2012/13 from Canada s sentinel surveillance network, January 2013. Eurosurveillance 2013; 18: pii = 20394.Google Scholar
58. Skowronski, D, et al. Interim estimates of 2013/14 vaccine effectiveness against influenza A(H1N1)pdm09 from Canada s sentinel surveillance network, January 2014. Eurosurveillance 2014; 19.CrossRefGoogle Scholar
59. Osterholm, MT, et al. Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. Lancet Infectious Diseases 2012; 12: 3644.CrossRefGoogle ScholarPubMed
60. Darvishian, M, et al. Effectiveness of seasonal influenza vaccine in community-dwelling elderly people: a meta-analysis of test-negative design case-control studies. Lancet Infectious Diseases 2014; 14: 12281239.Google Scholar
61. Tamerius, J, et al. Global influenza seasonality: reconciling patterns across temperate and tropical regions. Environmental Health Perspectives 2011; 119: 439445.Google Scholar
62. Tamerius, JD, et al. Environmental predictors of seasonal influenza epidemics across temperate and tropical climates. PLoS Pathogens 2013; 9: e1003194.Google Scholar
63. Koul, PA, et al. Differences in influenza seasonality by latitude, northern India. Emerging Infectious Diseases 2014; 20: 17461749.Google Scholar
64. Australian Government Department of Health. Australian Influenza Surveillance Report. No. 8, 2014, 27 September to 10 October 2014. Canberra: Australian Government Department of Health, 2014.Google Scholar
Figure 0

Table 1. Patients’ characteristics by vaccination status, 2012–2014

Figure 1

Fig. 1. Presentation of cases by influenza status.

Figure 2

Table 2. Patients’ characteristics by influenza status, 2012–2014

Figure 3

Fig. 2. Forest plots showing results of the initial exploration of heterogeneity by meta-analysis of unpooled data against all influenza types. Data for each year suggested moderate heterogeneity of around 35–54% according to I2. I2 represents variation in vaccine effectiveness attributable to heterogeneity. This statistic measures overlap between the confidence intervals and point estimates among studies. For example, the heterogeneity in 2012 has resulted from failure of the confidence interval of ASPREN to overlap the point estimate of SPNWA (and vice versa). Random-effects model from the DerSimonian & Laird method [25]. Fixed-effects estimate from the Mantel–Haenszel method. Cochran's P value not shown as it is underpowered. ASPREN, Australian Sentinel Practices Research Network; VicSPIN, Victorian Sentinel Practice Influenza Network; SPNWA, Sentinel Practitioners Network of Western Australia.

Figure 4

Fig. 3. Vaccine effectiveness and 95% confidence interval [VE (95% CI)] estimates by age group within types/subtypes.

Supplementary material: File

Sullivan supplementary material

Sullivan supplementary material

Download Sullivan supplementary material(File)
File 40.9 KB