Concordance of interim and final estimates of influenza vaccine effectiveness: a systematic review

The World Health Organization's Global Influenza Surveillance and Response System meets twice a year to generate a recommendation for the composition of the seasonal influenza vaccine. Interim vaccine effectiveness (VE) estimates provide a preliminary indication of influenza vaccine performance during the season and may be useful for decision making. We reviewed 17 pairs of studies reporting 33 pairs of interim and final estimates using the test-negative design to evaluate whether interim estimates can reliably predict final estimates. We examined features of the study design that may be correlated with interim estimates being substantially different from their final estimates and identified differences related to change in study period and concomitant changes in sample size, proportion vaccinated and proportion of cases. An absolute difference of no more than 10% between interim and final estimates was found for 18 of 33 reported pairs of estimates, including six of 12 pairs reporting VE against any influenza, six of 10 for influenza A(H1N1)pdm09, four of seven for influenza A(H3N2) and two of four for influenza B. While we identified inconsistencies in the methods, the similarities between interim and final estimates support the utility of generating and disseminating preliminary estimates of VE while virus circulation is ongoing.