Nothing Special   »   [go: up one dir, main page]
Skip to main content
PMC home page
Vaccines logoLink to Vaccines
. 2021 Jun 1;9(6):582. doi: 10.3390/vaccines9060582

Efficacy and Safety of COVID-19 Vaccines in Phase III Trials: A Meta-Analysis

Haoyue Cheng 1,2,†, Zhicheng Peng 1,2,†, Wenliang Luo 1,2, Shuting Si 1,2, Minjia Mo 1,2, Haibo Zhou 1,2, Xing Xin 1,2, Hui Liu 3, Yunxian Yu 1,2,*
Editors: Soo-Hong Lee, Hansoo Park, Jagathesh Chandra Rajendran, KS Jaganathan
PMCID: PMC8228087  PMID: 34206032

Abstract

Nowadays, the vaccination with COVID-19 vaccines is being promoted worldwide, professionals and common people are very concerned about the efficacy and safety of COVID-19 vaccines. No published systematic review and meta-analysis has assessed the efficacy and safety of the COVID-19 vaccines based on data from phase III clinical trials. Therefore, this study has estimated the efficacy and safety of COVID-19 vaccines and the differences between vaccine types. PubMed, Embase, the Cochrane Library, CNKI, Wanfang, medRxiv databases and two websites were used to retrieve the studies. Random-effects models were used to estimate the pooled efficacy and safety with risk ratio (RR). A total of eight studies, seven COVID-19 vaccines and 158,204 subjects were included in the meta-analysis. All the vaccines had a good preventive effect on COVID-19 (RR = 0.17, 95% CI: 0.09–0.32), and the mRNA vaccine (RR = 0.05, 95% CI: 0.03–0.09) was the most effective against COVID-19, while the inactivated vaccine (RR = 0.32, 95% CI: 0.19–0.54) was the least. In terms of safety, the risk of overall adverse events showed an increase in the vaccine group after the first (RR = 1.46, 95% CI: 1.03–2.05) or second (RR = 1.52, 95% CI: 1.04–2.20) injection. However, compared with the first injection, the risk of local (RR = 2.64, 95% CI: 1.02–6.83 vs. RR = 2.25, 95% CI: 0.52–9.75) and systemic (RR = 1.33, 95% CI: 1.21–1.46 vs. RR = 1.59, 95% CI: 0.84–3.01) adverse events decreased after the second injection. As for the mRNA vaccine, the risk of overall adverse events increased significantly, compared with the placebo, no matter whether it was the first (RR = 1.83, 95% CI = 1.80–1.86) or the second (RR = 2.16, 95% CI = 2.11–2.20) injection. All the COVID-19 vaccines that have published the data of phase III clinical trials have excellent efficacy, and the risk of adverse events is acceptable. The mRNA vaccines were the most effective against COVID-19, meanwhile the risk and grade of adverse events was minimal, compared to that of severe symptoms induced by COVID-19.

Keywords: COVID-19, vaccine, efficacy, safety, meta-analysis

1. Introduction

In late 2019, a highly transmissible and pathogenic coronavirus emerged, designated as syndrome coronavirus 2 (SARS-CoV-2) and there followed a pandemic of acute respiratory disease, named “coronavirus disease 2019” (COVID-19) [1,2]. As of 28 May 2021, there were over 168 million confirmed COVID-19 cases and over 3.5 million deaths worldwide, affecting 192 countries and regions (Johns Hopkins University Coronavirus Resource Center, https://coronavirus.jhu.edu/map.html, accessed on 28 May 2021). Vaccines, which can protect people from viral infections in an efficient and sustainable manner [3], play a critical role in human history against infectious diseases. As the COVID-19 pandemic continues to rage, promoting the development of effective vaccines is critical to prevent further morbidity and mortality and, hopefully, limit and even stop the worldwide spread of COVID-19 [4,5].

The rapid increase in morbidity and mortality of the COVID-19 pandemic has led to a drastic shift in the conventional vaccine development paradigm and timelines from a time frame of 10–15 years to 1–2 years [6]. As of 25 May 2021, there are 101 vaccine candidates in clinical development, by use of a broad range of technology platforms from traditional to novel approaches [7,8]. At least 10 vaccines are in phase III clinical trials, 3 of them have ended phase III with positive results [9]. Among them, at least eight COVID-19 vaccines have been granted emergency use and/or full marketing authorization by the regulatory authorities, namely CoronaVac, HB02 (BBIBP-CorV), AZD1222 (ChAdOx1-S), Sputnik V (Gam-COVID-Vac), Ad26.COV2.S, BBV152, BNT162b2 and mRNA-1273 [4,9,10]. Up to now, most countries are promoting vaccination against COVID-19, such as USA, China, India, and Brazil.

To our knowledge, although COVID-19 vaccines have been widely vaccinated all over the world, no comprehensive systematic review and meta-analysis has been published, focusing on the efficacy and safety of them, based on data from phase III clinical trials. Our study will be the first one summarizing the clinical trials of COVID-19 vaccines that are currently widely vaccinated to compare their efficacy and safety, providing useful reference for vaccine selection and promotion.

2. Materials and Methods

2.1. Search Strategy and Protocol

The protocol was designed according to the Cochrane Handbook [11] and the Preferred Reporting Items for Systematic Reviews and Meta-analyses for Protocols (PRISMA-P) [12]. The search was performed in PubMed, Embase, the Cochrane Library, CNKI, Wanfang and medRxiv to identify all published and prepublication studies. Detailed search strategies for all four databases were provided in the Supplementary Materials (Tables S1–S4). Other sources selected to provide required studies included two vaccine-related websites called “COVID-19 vaccine tracker” (https://vac-lshtm.shinyapps.io/ncov_vaccine_landscape/, accessed on 14 April 2021) and “Up-to-date mapping of COVID-19 treatment and vaccine development” (https://covid19-help.org/, accessed on 14 April 2021). The references of previously published reviews were browsed to check if there were more pertinent clinical trials.

2.2. Eligibility Criteria

PICOS (population, intervention, comparator, outcome, and study) design approach was used to defined study eligibility criteria [13]:

  • Population—subjects participated in clinical trials related to COVID-19 vaccines;

  • Intervention—COVID-19 vaccination;

  • Comparator(s)—COVID-19 vaccine or placebo;

  • Outcomes—vaccine efficacy for prevention of COVID-19 (primary outcome) was assessed on the basis of incidences from randomized controlled trials. Secondary outcome was vaccine safety, including adverse events at the injection site (e.g., pain, swelling, induration, erythema), systemic adverse events (e.g., fever, headache, fatigue, muscle pain, joint pain, nausea and/or vomiting, chill) and serious adverse events (e.g., dehydration, syncope, atrial fibrillation, pulmonary embolism, acute kidney injury and so on). During day 0 to 7, 14, or 28 after injections, subjects were asked to record any adverse events.

  • Study designs—randomized controlled trials were eligible for inclusion. Animal studies, case reports, reviews, editorials, letters and conference abstracts were excluded. Articles describing the results of phase III COVID-19 vaccine trials were included first. If there were no safety-related outcomes in the above articles, the results of phase I/II trials of the same vaccine would be included. Studies were excluded if there was an overlap in subjects with another study within the same analysis.

2.3. Data Extraction and Quality Assessment

Two authors (Haoyue Cheng and Zhicheng Peng) were independently responsible for data extraction, and disagreements were determined by the third author (Yunxian Yu). For each study, we extracted data on study characteristics (e.g., date of publication, study design, sample size, country, duration of follow-up), population demographics (e.g., ethnicity, sex ratio, mean age, age range) and outcome measures (including COVID-19 incidence in each group and adverse events).

Risk of bias in each study was appraised by pairs of authors using the Cochrane Handbook of Systematic Reviews of Interventions [14]. Only authors experienced in using the tool were involved at this step.

2.4. Outcomes

Outcome measures of the meta-analysis included efficacy and safety of COVID-19 vaccines. Vaccine efficacy was evaluated by comparing the difference in the number of COVID-19 cases between the vaccine group and the placebo group after vaccination. The safety outcomes were evaluated through the numbers of adverse events, including local adverse events, systemic adverse events and serious adverse events extracted from the original studies. However, due to the differences in the scope of adverse events in the included clinical trials, the original data of each clinical trial were used without any processing when analyzing the overall adverse events. Meanwhile, the data of the same specific adverse events (e.g., pain at injection site, fever, headache, fatigue, muscle pain, joint pain, nausea or vomiting and chill) in each clinical trial were also extracted for analysis. Besides, because adverse events of HB02 and WIV04 were not separately counted according to the number of injections, these two vaccines lacked the safety outcomes except for serious adverse events.

2.5. Data Synthesis and Statistical Analysis

Eight studies were included in the meta-analysis. The magnitude of between-study heterogeneity was estimated using the I2 statistical parameter, an estimate of the proportion of the total observed variance that is attributed to between-study variance [15]. The differences in incidence of COVID-19 and adverse events with vaccine versus placebo were pooled, stratified across studies or types of vaccines, and all pooled outcome measures were determined using random-effects models with inverse variance weighting.

Pooled effects on vaccine efficacy and adverse events were presented as odds ratio (OR) with corresponding 95% CI. To examine potential publication bias, we produced a funnel plot for outcomes including all studies. All the statistical analyses were conducted using R statistical software VERSION 4.0.0 (R Foundation for Statistical Computing, Vienna, Austria).

3. Results

3.1. Characteristics of the Studies

A total of 7697 articles from PubMed (807), Embase (1355), the Cochrane Library (301), medRxiv (4920), CNKI (94), Wanfang (102) and other sources (142) were included initially. After screening 3665 titles and abstracts and 37 full text articles, 8 studies [16,17,18,19,20,21,22,23] (one was published on SSRN) providing data on seven COVID-19 vaccines and 158,204 subjects met the eligibility criteria (Figure 1). The eight studies were all randomized, placebo-controlled trials: two mRNA vaccines (mRNA-1273 and BNT162b2), two virus-vectored vaccines (ChAdOx1-S and Gam-COVID-Vac) and three inactivated vaccines (CoronaVac, HB02 and WIV04). The baseline characteristics of the subjects and the design of each study are summarized in Table 1. The vaccination protocols were similar in these studies, including the injection site, number of vaccine injections, the period of follow-up, primary end-point events, and the recorded adverse events. As shown in Figure 2, the risk of bias was low in most studies.

Figure 1.

Figure 1

Open in a new tab

Flow diagram showing the progress through the stages of meta-analysis.

Table 1.

Characteristics of the clinical studies included in the network meta-analysis.

Study and Year Trial Number Study Characteristics Vaccine Developer Dose and Route of Administration Number of Scheduled Doses (Time of Inoculations) Type of Candidate Vaccine Study Duration Characteristics of Vaccine Recipients Participating Countries Age (Mean/Median and Range/SD) Male (%)
Baden et al., 2021 NCT04470427 Phase III, multicenter, randomized, observer-blind, placebo-controlled Moderna/National Institute of Allergy and Infectious Diseases’ Vaccine Research Center mRNA-1273 (100 μg IM) Prime and boost inoculation (0, 28 days) mRNA vaccine 27 July 2020 to 21 November 2020 Persons 18 years of age or older with no known history of SARS-CoV-2 infection and with locations or circumstances that put them at an appreciable risk of SARS-CoV-2 infection USA 51.4 (18–95) 52.7
Ramasamy et al., 2020 NCT04400838 Phase II/III, multicenter, randomized, single-blind, placebo-controlled University of Oxford/AstraZeneca ChAdOx1-S (3.5–6.5 × 1010 viral particles IM) Prime and boost inoculation (0, 28 days) Virus-vectored vaccine May 30, 2020 to 26 October 2020 Adults aged 18–55 years, then adults aged 56–69 years, and then adults aged 70 years and older, without severe or uncontrolled medical comorbidities UK 18–55 years: 43.2 (22–55); 56–69 years: 60.4 (56–69.4); ≥70 years: 73 (70–82) 18–55 years: 36.4; 56–69 years: 55.0; ≥70 years: 64.3
Voysey et al., 2021 NCT04324606, NCT04400838, NCT04444674, ISRCTN89951424 Phase II/III, multicenter, randomized, single-blind, placebo-controlled University of Oxford/AstraZeneca ChAdOx1-S (3.5–6.5 × 1010 viral particles IM) Prime and boost inoculation (0, 28 days) Virus-vectored vaccine 23 April 2020 to 6 November 2020 Health adults aged 18 or older UK Brazil South Africa ≥18 43.6
Walsh et al., 2020 NCT04368728 Phase I, multicenter, randomized, observed-blind, placebo-controlled BioNTech/Fosun Pharma/Pfizer BNT162b2 (30 µg IM) Prime and boost inoculation (0, 21 days) mRNA vaccine 4 May 2020 to 22 June 2020 Healthy adults 18 to 55 years of age or 65 to 85 years of age USA 18–55 years: 36.1 (19–54); 65–85 years: 69.1 (65–77) 18–55 years: 38.1; 65–85 years: 47.6
Polack et al., 2020 NCT04368728 Phase III, multicenter, randomized, observed-blind, placebo-controlled BioNTech/Fosun Pharma/Pfizer BNT162b2 (30 µg IM) Prime and boost inoculation (0, 21 days) mRNA vaccine 27 July 2020 to 14 November 2020 Adults 16 years of age or older who were healthy or had stable chronic medical conditions USA Argentina Brazil South Africa 52 (16–91) 50.6
Logunov et al., 2021 NCT04530396 Phase III, multicenter, randomized, double-blind, placebo-controlled Gamaleya Research Institute Gam-COVID-Vac (1 ± 0.5 × 1011 viral particles IM) Prime and boost inoculation (0, 21 days) Virus-vectored vaccine 7 September 2020 to 24 November 2020 Adults aged 18 or older with no known history of SARS-CoV-2 infection, and without severe or uncontrolled medical comorbidities Russia 45.3 (12.0) 61.2
Palacios et al., 2021 NCT04456595 Phase III, multicenter, randomized, double-blind, placebo-controlled Sinovac CoronaVac (3 μg IM) Prime and boost inoculation (0, 14 days) Inactivated vaccine 21 July 2020 to 16 December 2020 Participants aged 18 or older without previous SARS-CoV-2 infection Brazil 39.5 (10.8) 35.8
Kaabi et al., 2021 NCT04510207 Phase III, multicenter, randomized, double-blind, placebo-controlled The Beijing Institute of Biological Products Co, Ltd., HB02 (4 μg IM) or WIV04 (5 μg IM) Prime and boost inoculation (0, 21 days) Inactivated vaccine 16 July 2020 to 20 December 2020 Participants aged 18 or older without previous SARS-CoV-2 infection United Arab Emirates (Abu Dhabi Sharjahand Bahrain) 36.1 (9.3) 84.4
Open in a new tab

Figure 2.

Figure 2

Open in a new tab

Overall risk of bias assessment using the Cochrane tool and risk of bias assessment by individual trials. (A) Overall risk of bias assessment using the Cochrane tool. (B) Risk of bias assessment by individual trials.

3.2. COVID-19 Vaccine Efficacy

For the meta-analysis, the COVID-19 vaccines were divided into three categories according to their types to compare the efficacy based on vaccine versus placebo injection. In general, all the vaccines had good preventive effect on COVID-19 among those who followed the vaccination procedure and received two injections (RR = 0.17, 95% CI: 0.09–0.32) (Figure 3). Besides, the result implied that mRNA vaccine (RR = 0.05, 95% CI: 0.03–0.09) was the most effective against COVID-19, while inactivated vaccine (RR = 0.32, 95% CI: 0.19–0.54) was the least effective among the three types of vaccines.

Figure 3.

Figure 3

Open in a new tab

Meta-analysis of efficacy of vaccine between vaccine and placebo groups by type of vaccine (from 7/14 days after dose 2).

Taking into account the actual situation, although some subjects only received one injection of vaccination, the meta-analysis finally included the subjects who received at least one dose of the vaccines (Figure 4). Similar to the above result, the vaccines reduced the risk of COVID-19 in the vaccine group relative to the placebo group by 78%. Type-specific efficacy showed that at least one injection of mRNA vaccines (RR = 0.12, 95% CI: 0.05–0.30) was less effective against COVID-19 than two injections of mRNA vaccines (RR = 0.05, 95% CI: 0.03–0.09). However, vaccine efficacy of virus-vectored vaccines and inactivated vaccine was not significantly related to the number of injections.

Figure 4.

Figure 4

Open in a new tab

Meta-analysis of efficacy of vaccine between vaccine and placebo groups by type of vaccine (from 7/14 days after dose 1).

3.3. COVID-19 Vaccine Safety

Generally, total adverse events (RR = 1.46, 95% CI: 1.03–2.05), solicited local adverse events (RR = 2.64, 95% CI: 1.02–6.83) and solicited systemic adverse events (RR = 1.33, 95% CI: 1.21–1.46) showed an increased and statistically significant risk in the vaccine group compared with placebo group after the first injection (Figure 5). Especially, compared with placebo, the risk ratio of local adverse events caused by mRNA vaccine (mRNA-1273) and virus-vectored vaccine (ChAdOx1-S) was 4.26 (4.12–4.40) and 1.62 (1.27–2.05), respectively. It indicated that the risk of local adverse events caused by mRNA vaccine was higher than that of virus-vectored vaccine. Meanwhile, there was no significantly higher risk of systemic adverse events between the vaccine group and the placebo group. In the analysis of specific solicited adverse events, only the risk of pain at the injection site was significantly increased in the vaccine group (RR = 3.67, 95% CI: 1.60–8.43) (Figure S1 in the Supplementary Materials). Moreover, among all types of vaccines, the risks of all the adverse events induced by the mRNA vaccine were relatively higher, compared with the placebo.

Figure 5.

Figure 5

Open in a new tab

Meta-analysis of effect of vaccine on overall adverse events between vaccine and placebo groups after dose 1.

Similarly, after the second injection, total adverse events were significantly higher in the vaccine group than in the placebo group (RR = 1.52, 95% CI: 1.04–2.20) (Figure 6). However, the risk of local (RR = 2.25, 95% CI: 0.52–9.75) or systemic (RR = 1.59, 95% CI: 0.84–3.01) adverse events was not significantly different between the vaccine group and the placebo group. The main reason for this change was that, compared with the first injection, the risk of adverse events among subjects receiving virus-vectored vaccine became lower. The risks of specific adverse events were similar to that of the first injection (Figure S2 in the Supplementary Materials).

Figure 6.

Figure 6

Open in a new tab

Meta-analysis of effect of vaccine on overall adverse events between vaccine and placebo groups after dose 2.

In addition to solicited adverse events, the risk of serious adverse events is also one of the foci of vaccine safety. Compared with the placebo, the COVID-19 vaccines did not increase the risk of serious adverse events (RR = 0.94, 95% CI: 0.71–1.25) (Figure 7). Especially, virus-vectored vaccines reduced the risk of serious adverse events (RR = 0.79, 95% CI: 0.63–0.99).

Figure 7.

Figure 7

Open in a new tab

Meta-analysis of effect of vaccine on serious adverse events between vaccine and placebo groups by type of vaccine.

4. Discussion

In this meta-analysis of RCTs, we found that the seven COVID-19 vaccines had excellent efficacy and safety. Among them, the mRNA vaccines were the most effective against COVID-19, while the risk of adverse events was also relatively the highest. Meanwhile, the efficacy of the inactivated vaccines was not as good as the mRNA vaccines, while the safety of them was the best among all types of vaccines.

In fact, all of the COVID-19 vaccines did not increase the risk of serious adverse events. Therefore, there is no firm rule that a certain type of vaccine must be used. Each type of vaccine could be used according to the actual situation of each country and the characteristics of different types of vaccines.

Effective and safe vaccination against COVID-19 is the best strategy to stop viral spread and control the pandemic [24]. After the genetic sequence of SARS-CoV-2 was published, extensive global efforts for COVID-19 vaccine development began. From the traditional platforms, such as inactivated, live attenuated virus, viral protein subunit and replicating or non-replicating viral vectors, to the novel platforms, based on DNA or mRNA, global efforts have brought about the diverse vaccine development platforms [8,24,25]. Our meta-analysis included seven COVID-19 vaccines, namely mRNA-1273, BNT162b2, ChAdOx1-S, Gam-COVID-Vac, CoronaVac, HB02 and WIV04, including both traditional vaccines and novel vaccines. In fact, some vaccines (e.g., BBV152, AD5-nCOV, Ad26.COV2.S) are also undergoing phase III trials and their efficacy has been announced, but the specific data has not been published.

As the results showed, all the COVID-19 vaccines exhibited excellent efficacy, but it was affected by the type of vaccine. After the outbreak of SARS-CoV, the spike (S) protein was quickly identified as the immunodominant antigen of the virus, and the receptor-binding domain of the S1 subunit was the primary target of SARS-COV-2 which can bind and neutralize antibodies [26,27,28]. However, different types of vaccines have different principles for inducing antibodies, which results in the differences in vaccine efficacy [29]. For example, inactivated vaccines stem from virus grown in culture and then chemically inactivated, which may deliver stably expressed, conformationally native antigenic epitopes to induce antibodies [26,30]. Inactivated viruses provide a stable expression of antibodies and can be easily produced in large quantities, so inactivated vaccines are widely used in the prevention of infectious diseases [31]. It is worth noting that after the inactivated virus is injected, there is a certain probability that it cannot induce immune memory [32]. As an emerging type of vaccine, mRNA vaccines have developed rapidly in recent years because of their potency, ability for rapid development, and cost-efficient production [33,34]. After the injection of mRNA vaccine, the host uses the prefusion-stabilized S protein–encoding mRNA to produce the target protein, which induces the immune response [26,35]. Although our study shows that mRNA vaccines had, relatively, the highest risk of adverse events compared to the other types of vaccines, they can be produced rapidly and have potent efficacy, making them ideal for a rapid response to newly emerging pathogens [36]. Consequently, for countries with high transmission rates to stop the spread of COVID-19 in a timely and effective way, mRNA vaccines are a worthy candidate for consideration. Therefore, the efficacy of the inactivated vaccines was the worst in the present study, which can be explained theoretically. Furthermore, the results of the present study showed that regardless of the types of vaccines, the vaccine efficacy in subjects who received two injections was similar to that in subjects who received at least one injection. However, previous meta-analysis indicated that multiple vaccinations of COVID-19 vaccines always showed greater immunogenicity than single vaccinations [15]. The main reason is that subjects who received at least one injection overlapped with those who actually received two injections. However, since the original clinical trials did not provide relevant data, there was no way of distinguishing the subjects according to the number of vaccinations.

Another influencing factor that needs to be considered is the incidence of COVID-19 in different countries. Some clinic trials of different vaccines were conducted in different countries, which would increase the heterogeneity. Prior to widespread vaccination, the cumulative incidence of COVID-19 in Argentina, Brazil, Russia, South Africa, UK, USA and United Arab Emirates was about 38.53, 249.06, 284.29, 579.29, 368.10, 574.28 and 355.82 per 100,000 people, respectively (The cumulative incidence was calculated by using the total number of COVID-19 cases as of June 2020, https://www.worldometers.info/, accessed on 28 May 2021), which meant that the risk of COVID-19 for subjects in different countries was inconsistent. We extracted a portion of the data from the included studies, which were about the results of different vaccines in the same country and similar time period, to compare their efficacy. In Brazil, the efficacy of BNT162b2, and inactivated vaccine CoronaVac was 87.7% (8.1–99.7%) [20] and 50.7% (35.9–62.0%) [22], respectively, which implied that the mRNA vaccine was actually the most efficient.

The results of this study showed that vaccination inevitably induced adverse events, while the risk of serious adverse events was not increased. Besides, the risk of local and systemic adverse events of the second injection was lower than that of the first injection, which may be due to the tolerance of the host. Previous studies also reassured that those serious adverse events, such as immune-mediated adverse reactions, were rare events for most known vaccines [37]. In addition, we concluded that the risks of all the adverse events induced by inactivated vaccine were the lowest. This is because inactivated vaccines cannot replicate in the vaccine recipient, they are thus not capable of causing any significant adverse events, resulting in very few contraindications for their use [32]. Among the mRNA vaccines, few studies discussed the reasons related to the increased risk of adverse events caused by them. Only the COVID-19 vaccine has been approved for marketing, so more studies are still needed to evaluate its safety [38]. Therefore, vaccines should be selected according to personal conditions.

Therefore, the present study summarized the efficacy and safety of the vaccines against COVID-19. However, it has several limitations. First, some studies (phase I/II trials) included insufficient numbers of participants without a broad age range, which indicated there was a potential risk of overestimating or underestimating the vaccine safety. Besides, up to now, most of the clinical trials of the COVID-19 vaccines were conducted in USA, Europe and Latin America, and most of the included subjects were middle-aged. Thus, the results of the trials may differ from the real world. It is necessary to consider more population factors, including adding older adults or children, subjects with special conditions such as pregnancy, and individuals with ethnic and geographical diversity. Second, as some vaccines were not included in the present study, due to a lack of public data, there may exist publication bias. Third, there are several differences in the scope of adverse events in the clinical trials of COVID-19 vaccine. For example, diarrhea is a systemic adverse event in the study of CoronaVac, while it is an unsolicited adverse event in the study of mRNA-1273. Therefore, the risk of adverse events of some vaccines might be underestimated. Fourth, in view of the severity of the epidemic, the follow-up time of all the clinical trials of COVID-19 vaccine is less than half a year, which means the long-term efficacy of the vaccines remain to be verified.

In general, our study is the first meta-analysis summarizing the results of phase III trials in the COVID-19 vaccines. Although the development of COVID-19 vaccines has made great progress, there are still many problems waiting for the efforts of scientists and doctors, such as the efficacy of the vaccines against more transmissible SARS-CoV-2 variants [39,40]. Besides, it is worth noting that the development of vaccines in a very short time necessarily implies that is not yet possible to know their long-term efficacy [9].

5. Conclusions

As of now, all the COVID-19 vaccines that have published data of phase III clinical trials have excellent efficacy, and the risk of adverse events is acceptable. The mRNA vaccines were the most effective against COVID-19, while the risk of adverse events induced by them could not be ignored. However, the risk and grade of adverse events induced by the vaccines were minimal compared to those of the severe symptoms induced by COVID-19. We suggest that the type of vaccine could be selected according to the severity of the COVID-19 epidemic and personal conditions.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/vaccines9060582/s1, Table S1: Literature search terms used for PubMed. The final search strategy applied to conduct this meta-analysis is reported at step #21, Table S2: Literature search terms used for the Cochrane Library. The final search strategy applied to conduct this meta-analysis is reported at step #23, Table S3: Literature search terms used for Embase. The final search strategy applied to conduct this meta-analysis is reported at step #19, Table S4: Literature search terms used for Medrxiv, Wanfang and CNKI, Figure S1: Meta-analysis of effect of vaccine on specific adverse events between vaccine and placebo groups after dose 1, Figure S2: Meta-analysis of effect of vaccine on specific adverse events between vaccine and placebo groups after dose 2.

Click here for additional data file. (372.8KB, zip)

Author Contributions

Y.Y., H.C., Z.P. and S.S. contributed substantially to the study topic and designed the search strategy. W.L. and X.X. developed the search strategy. H.C., Z.P. and Y.Y. contributed to data extract, analysis, and interpretation. H.C., Z.P., S.S., M.M. and H.Z. wrote the first draft of the article. H.L. and Y.Y. critically revised the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by Chinese National Natural Science Foundation, grant number 81973055; Major research and development projects of Zhejiang science and Technology Department, grant number 2018C03010 and the Fundamental Research Funds for the Central Universities.

Data Availability Statement

The data presented in this study are available in the article.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Hu B., Guo H., Zhou P., Shi Z.L. Characteristics of SARS-CoV-2 and COVID-19. Nat. Rev. Microbiol. 2021;19:141–154. doi: 10.1038/s41579-020-00459-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Novelli G., Biancolella M., Mehrian-Shai R., Erickson C., Pollitt K.J.G., Vasiliou V., Watt J., Reichardt J.K.V. COVID-19 update: The first 6 months of the pandemic. Hum. Genom. 2020;14:48. doi: 10.1186/s40246-020-00298-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Luyten J., Beutels P. The Social Value Of Vaccination Programs: Beyond Cost-Effectiveness. Health Aff. 2016;35:212–218. doi: 10.1377/hlthaff.2015.1088. [DOI] [PubMed] [Google Scholar]
  • 4.Rogliani P., Chetta A., Cazzola M., Calzetta L. SARS-CoV-2 Neutralizing Antibodies: A Network Meta-Analysis across Vaccines. Vaccines. 2021;9:227. doi: 10.3390/vaccines9030227. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Alturki S.O., Alturki S.O., Connors J., Cusimano G., Kutzler M.A., Izmirly A.M., Haddad E.K. The 2020 Pandemic: Current SARS-CoV-2 Vaccine Development. Front. Immunol. 2020;11:1880. doi: 10.3389/fimmu.2020.01880. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Lurie N., Saville M., Hatchett R., Halton J. Developing Covid-19 Vaccines at Pandemic Speed. N. Engl. J. Med. 2020;382:1969–1973. doi: 10.1056/NEJMp2005630. [DOI] [PubMed] [Google Scholar]
  • 7.World Health Organization Draft Landscape of COVID-19 Candidate Vaccines. [(accessed on 28 May 2021)]; Available online: https://www.who.int/publications/m/item/draft-landscape-of-covid-19-candidate-vaccines.
  • 8.Thanh Le T., Andreadakis Z., Kumar A., Gómez Román R., Tollefsen S., Saville M., Mayhew S. The COVID-19 vaccine development landscape. Nat. Rev. Drug Discov. 2020;19:305–306. doi: 10.1038/d41573-020-00073-5. [DOI] [PubMed] [Google Scholar]
  • 9.Forni G., Mantovani A., Forni G., Mantovani A., Moretta L., Rappuoli R., Rezza G., Bagnasco A., Barsacchi G., Bussolati G., et al. COVID-19 vaccines: Where we stand and challenges ahead. Cell Death Differ. 2021;28:626–639. doi: 10.1038/s41418-020-00720-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Up-To-Date Mapping of COVID-19 Treatment and Vaccine Development. [(accessed on 28 May 2021)]; Available online: https://covid19-help.org/
  • 11.Higgins J., Green S., editors. The Cochrane Collaboration; 2011. [(accessed on 28 May 2021)]. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. Available online: www.cochrane-handbook.org. [Google Scholar]
  • 12.Shamseer L., Moher D., Clarke M., Ghersi D., Liberati A., Petticrew M., Shekelle P., Stewart L.A. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. BMJ. 2015;350:g7647. doi: 10.1136/bmj.g7647. [DOI] [PubMed] [Google Scholar]
  • 13.Stone P.W. Popping the (PICO) question in research and evidence-based practice. Appl. Nurs Res. 2002;15:197–198. doi: 10.1053/apnr.2002.34181. [DOI] [PubMed] [Google Scholar]
  • 14.Higgins J.P., Thomas J., Chandler J., Cumpston M., Li T., Page M.J., Welch V.A. Cochrane Handbook for Systematic Reviews of Interventions. John Wiley & Sons; Hoboken, NJ, USA: 2019. [Google Scholar]
  • 15.Yuan P., Ai P., Liu Y., Ai Z., Wang Y., Cao W., Xia X., Zheng J.C. Safety, Tolerability, and Immunogenicity of COVID-19 Vaccines: A Systematic Review and Meta-Analysis. medRxiv Prepr. Serv. Health Sci. 2020:4998. doi: 10.1101/2020.11.03.20224998. [DOI] [Google Scholar]
  • 16.Baden L.R., El Sahly H.M., Essink B., Kotloff K., Frey S., Novak R., Diemert D., Spector S.A., Rouphael N., Creech C.B., et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N. Engl. J. Med. 2021;384:403–416. doi: 10.1056/NEJMoa2035389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Ramasamy M.N., Minassian A.M., Ewer K.J., Flaxman A.L., Folegatti P.M., Owens D.R., Voysey M., Aley P.K., Angus B., Babbage G., et al. Safety and immunogenicity of ChAdOx1 nCoV-19 vaccine administered in a prime-boost regimen in young and old adults (COV002): A single-blind, randomised, controlled, phase 2/3 trial. Lancet. 2021;396:1979–1993. doi: 10.1016/S0140-6736(20)32466-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Voysey M., Costa Clemens S.A., Madhi S.A., Weckx L.Y., Folegatti P.M., Aley P.K., Angus B., Baillie V.L., Barnabas S.L., Bhorat Q.E., et al. Single-dose administration and the influence of the timing of the booster dose on immunogenicity and efficacy of ChAdOx1 nCoV-19 (AZD1222) vaccine: A pooled analysis of four randomised trials. Lancet. 2021;397:881–891. doi: 10.1016/S0140-6736(21)00432-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Walsh E.E., Frenck R.W., Jr., Falsey A.R., Kitchin N., Absalon J., Gurtman A., Lockhart S., Neuzil K., Mulligan M.J., Bailey R., et al. Safety and Immunogenicity of Two RNA-Based Covid-19 Vaccine Candidates. N. Engl. J. Med. 2020;383:2439–2450. doi: 10.1056/NEJMoa2027906. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Polack F.P., Thomas S.J., Kitchin N., Absalon J., Gurtman A., Lockhart S., Perez J.L., Pérez Marc G., Moreira E.D., Zerbini C., et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N. Engl. J. Med. 2020;383:2603–2615. doi: 10.1056/NEJMoa2034577. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Logunov D.Y., Dolzhikova I.V., Shcheblyakov D.V., Tukhvatulin A.I., Zubkova O.V., Dzharullaeva A.S., Kovyrshina A.V., Lubenets N.L., Grousova D.M., Erokhova A.S., et al. Safety and efficacy of an rAd26 and rAd5 vector-based heterologous prime-boost COVID-19 vaccine: An interim analysis of a randomised controlled phase 3 trial in Russia. Lancet. 2021;397:671–681. doi: 10.1016/S0140-6736(21)00234-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Palacios R., Batista A.P., Albuquerque C.S.N., Patiño E.G., Santos J.D.P. Efficacy and Safety of a COVID-19 Inactivated Vaccine in Healthcare Professionals in Brazil: The PROFISCOV Study. SSRN. 2021:66. doi: 10.2139/ssrn.3822780. [DOI] [Google Scholar]
  • 23.Al Kaabi N., Zhang Y., Xia S., Yang Y., Al Qahtani M.M., Abdulrazzaq N., Al Nusair M., Hassany M., Jawad J.S., Abdalla J., et al. Effect of 2 Inactivated SARS-CoV-2 Vaccines on Symptomatic COVID-19 Infection in Adults: A Randomized Clinical Trial. JAMA. 2021;324:951–960. doi: 10.1001/jama.2021.8565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Chen Y., Klein S.L., Garibaldi B.T., Li H., Wu C., Osevala N.M., Li T., Margolick J.B., Pawelec G., Leng S.X. Aging in COVID-19: Vulnerability, immunity and intervention. Ageing Res. Rev. 2021;65:101205. doi: 10.1016/j.arr.2020.101205. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Parker E.P.K., Shrotri M., Kampmann B. Keeping track of the SARS-CoV-2 vaccine pipeline. Nat. Rev. Immunol. 2020;20:650. doi: 10.1038/s41577-020-00455-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Creech C.B., Walker S.C., Samuels R.J. SARS-CoV-2 Vaccines. JAMA. 2021;325:1318–1320. doi: 10.1001/jama.2021.3199. [DOI] [PubMed] [Google Scholar]
  • 27.Du L., He Y., Zhou Y., Liu S., Zheng B.J., Jiang S. The spike protein of SARS-CoV—a target for vaccine and therapeutic development. Nat. Rev. Microbiol. 2009;7:226–236. doi: 10.1038/nrmicro2090. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Premkumar L., Segovia-Chumbez B., Jadi R., Martinez D.R., Raut R., Markmann A., Cornaby C., Bartelt L., Weiss S., Park Y., et al. The receptor binding domain of the viral spike protein is an immunodominant and highly specific target of antibodies in SARS-CoV-2 patients. Sci. Immunol. 2020;5 doi: 10.1126/sciimmunol.abc8413. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Soleimanpour S., Yaghoubi A. COVID-19 vaccine: Where are we now and where should we go? Expert Rev. Vaccines. 2021;20:23–44. doi: 10.1080/14760584.2021.1875824. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Narayanan D.K.L., Kayarohanam S., Fuloria S., Fuloria N.K., Janakiraman A.K., Djearamane S., Wu Y.S., Chakravarthi S., Subramaniyan V. Covid-19 vaccine candidates under clinical evaluation-a review. Int. J. Pharm. Res. 2021;13:4588–4598. doi: 10.31838/ijpr/2021.13.01.666. [DOI] [Google Scholar]
  • 31.Dong Y., Dai T., Wei Y., Zhang L., Zheng M., Zhou F. A systematic review of SARS-CoV-2 vaccine candidates. Signal. Transduct. Target. Ther. 2020;5:237. doi: 10.1038/s41392-020-00352-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Pollard A.J., Bijker E.M. A guide to vaccinology: From basic principles to new developments. Nat. Rev. Immunol. 2021;21:83–100. doi: 10.1038/s41577-020-00479-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Pardi N., Hogan M.J., Porter F.W., Weissman D. mRNA vaccines—A new era in vaccinology. Nat. Rev. Drug Discov. 2018;17:261–279. doi: 10.1038/nrd.2017.243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Wang F., Kream R.M., Stefano G.B. An Evidence Based Perspective on mRNA-SARS-CoV-2 Vaccine Development. Med. Sci. Monit. Int. Med. J. Exp. Clin. Res. 2020;26:e924700. doi: 10.12659/MSM.924700. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Chung Y.H., Beiss V., Fiering S.N., Steinmetz N.F. COVID-19 Vaccine Frontrunners and Their Nanotechnology Design. ACS Nano. 2020;14:12522–12537. doi: 10.1021/acsnano.0c07197. [DOI] [PubMed] [Google Scholar]
  • 36.Maruggi G., Zhang C., Li J., Ulmer J.B., Yu D. mRNA as a Transformative Technology for Vaccine Development to Control Infectious Diseases. Mol. Ther. J. Am. Soc. Gene Ther. 2019;27:757–772. doi: 10.1016/j.ymthe.2019.01.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Stone C.A., Jr., Rukasin C.R.F., Beachkofsky T.M., Phillips E.J. Immune-mediated adverse reactions to vaccines. Br. J. Clin. Pharmacol. 2019;85:2694–2706. doi: 10.1111/bcp.14112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Castells M.C., Phillips E.J. Maintaining Safety with SARS-CoV-2 Vaccines. N. Engl. J. Med. 2020;384:643–649. doi: 10.1056/NEJMra2035343. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Kirby T. New variant of SARS-CoV-2 in UK causes surge of COVID-19. Lancet Respir. Med. 2021;9:e20–e21. doi: 10.1016/S2213-2600(21)00005-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Tang J.W., Toovey O.T.R., Harvey K.N., Hui D.D.S. Introduction of the South African SARS-CoV-2 variant 501Y.V2 into the UK. J. Infect. 2021;82:e8–e10. doi: 10.1016/j.jinf.2021.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Click here for additional data file. (372.8KB, zip)

Data Availability Statement

The data presented in this study are available in the article.

Articles from Vaccines are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES