Europe PMC
Nothing Special   »   [go: up one dir, main page]

Europe PMC requires Javascript to function effectively.

Either your web browser doesn't support Javascript or it is currently turned off. In the latter case, please turn on Javascript support in your web browser and reload this page.

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Malaria remains one of the most significant infectious diseases affecting human populations in developing countries. The quest for an efficacious malaria vaccine has been ongoing for nearly a century with limited success. The identification of malaria parasite antigens focused efforts on the development of subunit vaccines but has so far yielded only one partially efficacious vaccine candidate, RTS/S. The lack of high vaccine efficacy observed to date with subunit vaccine candidates raises doubts that the development of a single antigen or even a multi-antigen malaria subunit vaccine is possible. Fortunately, it has been demonstrated in animal studies and experimental clinical studies that immunizations with live-attenuated sporozoite stages of the malaria parasite confer long lasting, sterile protection against infection, providing a benchmark for vaccine development. These early successful vaccinations with live-attenuated malaria parasites did not however, promote a developmental path forward for such a vaccine approach. The discovery of genetically engineered parasite strains that are fully attenuated during the early asymptomatic liver infection and confer complete sterile protection in animal malaria models support the development of a live attenuated sporozoite vaccine for Plasmodium falciparum and its accelerated safety and efficacy testing in malaria challenge models and in malaria endemic areas.

Free full text 


Logo of nihpaLink to Publisher's site
Hum Vaccin. Author manuscript; available in PMC 2013 May 2.
Published in final edited form as:
Hum Vaccin. 2010 Jan; 6(1): 107–113.
Published online 2010 Jan 29. https://doi.org/10.4161/hv.6.1.9654
PMCID: PMC3641786
NIHMSID: NIHMS373463
PMID: 19838068

Genetically engineered, attenuated whole-cell vaccine approaches for malaria

Abstract

Malaria remains one of the most significant infectious diseases affecting human populations in developing countries. The quest for an efficacious malaria vaccine has been ongoing for nearly a century with limited success. The identification of malaria parasite antigens focused efforts on the development of subunit vaccines but has so far yielded only one partially efficacious vaccine candidate, RTS/S. The lack of high vaccine efficacy observed to date with subunit vaccine candidates raises doubts that the development of a single antigen or even a multi-antigen malaria subunit vaccine is possible. Fortunately, it has been demonstrated in animal studies and experimental clinical studies that immunizations with live-attenuated sporozoite stages of the malaria parasite confer long lasting, sterile protection against infection, providing a benchmark for vaccine development. These early successful vaccinations with live-attenuated malaria parasites did not however, promote a developmental path forward for such a vaccine approach. The discovery of genetically engineered parasite strains that are fully attenuated during the early asymptomatic liver infection and confer complete sterile protection in animal malaria models support the development of a live attenuated sporozoite vaccine for Plasmodium falciparum and its accelerated safety and efficacy testing in malaria challenge models and in malaria endemic areas.

Keywords: malaria, plasmodium, vaccine, elimination, sporozoite, liver stage, pre-erythrocytic stages, mosquito, attenuation

Introduction

Malaria remains a major global cause of disease and death and disproportionately affects developing, resource-poor regions of the world. Annually, 300–500 million clinical malaria cases result in approximately one million deaths, the majority of which are children under the age of five in sub-Saharan Africa.1 Malaria is a mosquito-borne disease and hence it can be controlled at the level of human and mosquito. Currently, drug treatment of infected individuals, preventive drug treatment of populations at high risk of infection as well as insecticide-treated bed nets and indoor-insecticide spraying for mosquito control constitute the main weapons for malaria control.2 However, malaria control is a never-ending battle and requires long-term sustainability and commitment. The complexity of the Plasmodium life cycle, the distinct lifestyle of each parasite life stage and their inherently distinct antigenic makeup, necessitate the development of a portfolio of diverse strategies for malaria vaccine development approaches. The pre-erythrocytic (PE) stages of infection, encompassing the mosquito-transmitted sporozoite (SPZ) stage and the liver stages (LSs) that form after SPZ infection of the liver constitute an attractive target for vaccine development because they are low in numbers, when compared to the blood stages, completely asymptomatic and provide a relatively large window of opportunity for an effective immune response to eliminate the parasites (5–7 days for P. falciparum). Furthermore, to the best of our knowledge, PE stages do not exhibit substantial antigenic variation and antigenic polymorphisms during PE stages might be limited, making it less probable that a vaccine will fail against heterologous parasite strains.

The PE phase of the malaria parasite begins with the bite of an infected Anopheles mosquito when SPZs are injected into the skin of the mammalian host.3,4 SPZs migrate in the skin and when they make contact with a blood vessel, traverse the endothelium of the vessel and enter the blood stream. They are then carried to the liver by blood flow where they exit the blood vessel to infect hepatocytes and form LSs.5 Within a hepatocyte the LS is shielded from the host cell cytoplasm by a vacuole, known as the parasitophorous vacuole (PV). This barrier prevents free access of LS proteins to the hepatocyte proteolytic machinery, however, the parasite does target proteins to the PV membrane (PVM),6,7 and may even export proteins to the hepatocyte cytoplasm and nucleus.8 It is within the liver that a remarkable amplification of parasite numbers occurs—one LS spawns tens of thousands of red blood cell-infectious merozoites. Importantly, re-infection of hepatocytes does not occur and once in the blood, the parasite continuously infects red blood cells, a deadly cycle that causes all malaria-associated pathology.9 The major obstacle for a successful PE vaccine lies in the required threshold for vaccine efficacy: to protect against infection, the PE vaccine must provide complete protection from SPZ infection. Development of a single LS parasite results in full-blown blood stage infection and the immune response against PE stages might not give protection against the blood stage.

The circumsporozoite protein (CSP) is an immunodominant antigen of SPZs.10,11 Most of the early malaria vaccine development efforts were focused on this protein and today several formulations (peptide, recombinant, DNA, viral-vector) encompassing different segment(s) of CSP alone or in combination with other antigens have been evaluated. The most advanced malaria subunit vaccine candidate RTS,S is based on CSP. RTS,S formulated with ASO-type adjuvants has demonstrated efficacy.12 In Phase IIb trials among children living in Mozambique,13-15 RTS,S/ASO2A delayed the time to new infection by 30% and reduced episodes of severe malaria by 58% in the first six months,15 which persisted 21 months after the immunization.14 Two new adjuvant formulations enhanced RTS,S efficacy from a 30% reduction of all malarial episodes to a 56% reduction (RTS,S/ASO1E) in children 1–4 years old16 and 65% (RTS,S/ASO2D) in infants.17 It is unlikely that partially effective vaccines such as RTS/S will eliminate malaria but they might prove useful in combination with existing malaria control strategies. Elimination of malaria will ultimately depend on the development of highly effective vaccines. Do we know whether development of such vaccines is possible? The answer is yes because numerous studies have shown that immunizations with live SPZs confer complete protection against malaria.

Immunizations with live attenuated SPZs damaged by a particular irradiation dose are very effective in inducing complete protection against infectious SPZ challenge.18 Immunizations with inactivated SPZs however, do not confer protection.19,20 Attenuated SPZs infect hepatocytes and form LSs and thus elicit a cellular immune response against the infected hepatocyte.21 Long lasting sterile protection was demonstrated with irradiation-attenuated SPZ vaccines in animal models of malaria and importantly also in malaria naïve human volunteers.18,22,23 These findings provided a powerful paradigm for an anti-infection malaria vaccine. Live SPZs and LSs express thousands of potential antigens and the attenuated SPZ model will be critical in identifying new potential antigens for inclusion into second-generation subunit vaccines. However, it is quite conceivable that sterile protection can only be achieved by a multi-pronged immune response that targets many antigens of the infectious parasite and this might make it difficult to design a fully protective subunit vaccine.

Advances in genetic engineering have allowed the creation of a number of live-attenuated parasite lines using gene knockouts in rodent models. These genetically attenuated parasites (GAPs) confer long lasting, sterile protection against infection in rodents. Importantly, work in the rodent malaria models has demonstrated that GAPs can be created to exhibit distinct biological and antigenic features, thus enabling the design of live-attenuated vaccine strains that are safe and elicit sterile protection with low dose immunizations. The creation of the first P. falciparum GAPs have recently been reported,24 paving the way for the clinical development of a GAP vaccine for human use. Initiatives in production process development for live attenuated sporozoite vaccines (see Hoffman et al. in press in this issue) might overcome roadblocks that currently prevent the large-scale generation of GAPs. Here we review that state of research and development for a live-attenuated malaria vaccine.

Whole Cell Pre-Erythrocytic Parasite Vaccination Approaches

Irradiation-attenuated sporozoites

Ruth Nussenzweig and co-workers demonstrated in 1967 that immunization of mice with irradiation-attenuated sporozoites (irrSPZs) of the rodent malaria parasite P. berghei completely prevented onset of blood stage parasitemia after infectious SPZ challenge.18 This was a landmark finding that set the standards for immunological protection against malaria infection. Irradiation of SPZs introduces random mutations and breaks into their DNA. When dosed adequately the SPZ survives and remains infectious to the hepatocyte. However, LS development terminates during early hepatocyte infection. The safety and efficacy of irrSPZs is dependent on a precise irradiation dose; too little irradiation allows the parasite to complete LS development and cause blood stage infection, too much irradiation inactivates the SPZs and inactivated SPZs do not induce significant protection.25 In mice, irrSPZ-induced protection is mediated mainly by CD8+ T cells, which target the infected hepatocyte but also by antibodies against the major sporozoite surface protein CSP, which block sporozoite infection.3,26 Humans immunized with P. falciparum irrSPZs (immunized by the bite of irrSPZ-infected mosquitoes) have been effectively protected from subsequent challenge with infectious P. falciparum SPZs.22,23,27 Given the high levels of protection achieved by irrSPZ-immunization, the development of a P. falciparum irrSPZ vaccine was proposed by Stephen Hoffman.28 His company Sanaria Inc., (http://www.sanaria.com) has developed a manufacturing process for the aseptic production of irrSPZs in mosquitoes. The irradiation dose is tightly controlled and isolation, purification, formulation and cryopreservation of irrSPZs under good manufacturing practices (GMPs) have been established. A first generation vaccine called the PfSPZ Vaccine has been produced. Currently, the PfSPZ Vaccine administered by intradermal or subcutaneous inoculation by needle and syringe is being tested in a phase 1 clinical study with experimental challenge in malaria naïve volunteers to assess the safety, immunogenicity and protective efficacy of the PfSPZ Vaccine (Stephen Hoffman, Sanaria Inc., MD, personal communication). Calculations based on the previous P. falciparum irrSPZ immunization trials, where >1,000 cumulative infectious mosquito bites confer sterile protection that lasted for at least ten months, approximate the protective dose at >100,000 irrSPZs.28 This is in good agreement with irr-SPZ studies in rodent malaria models, where the inoculation dose can be precisely determined. However, a recently published paper showed that repeated immunizations of mice by the bite of 10–15 irrSPZ-infected mosquitoes conferred protection against infectious SPZ challenge although, this was determined only by assessing a reduction in LS burden, not the occurrence of blood stage patency.29 Furthermore, another recent paper demonstrated that as little as three doses of 750 P. yoelii irrSPZs confer complete sterile protection against challenge with infectious SPZs for at least two weeks in mice.30 Therefore, the minimum dose of irrSPZs required for complete protection might be lower than previously thought. Additionally, immunizations with irrSPZs of one rodent parasite species, P. yoelii partially protected against challenge with SPZs of another species, P. berghei and vice versa,31 giving reason to hope that partial cross-species protection might also occur with human parasite species.

Genetically attenuated sporozoites

The availability of genome sequences for a number of Plasmodium species,32-34 the generation of stage-specific gene expression data and the ability to genetically manipulate the parasite, has enabled the search for genes that play essential roles for parasite survival at distinct points during the life cycle. The identification of such genes has enabled the informed genetic engineering of the parasite to produce GAPs (Fig. 1). Recently, PE stages of the rodent malaria parasite species P. berghei and P. yoelii were attenuated by deletion of PE stage-expressed genes known as UISs (Upregulated in Infectious Sporozoites). The expression of UIS genes is highly upregulated when SPZs gain infectivity for the mammalian host after transitioning from the mosquito midgut to the mosquito salivary glands.35 UIS3 and UIS4,6,36,37 are proteins of the LS PVM, the principal host-parasite interface during liver infection.6,38 Deletion of UIS3 and UIS4 led to complete arrest of LS development soon after hepatocyte infection but uis4 parasites showed occasional breakthrough infections when high numbers of SPZs were used for immunization.6 However, this was not observed with uis3 parasites.36,37 Deletion of a further two sporozoite-expressed genes, P52, which encodes a putative GPI-anchored protein39,40 and P36, a gene encoding a putative secreted protein,40 also resulted in developmental arrest at the early stage of hepatocyte infection but p52 and p36 parasites caused breakthrough infections. However, simultaneous deletion of both genes (p52/p36) resulted in complete attenuation with no breakthrough infections.41 Immunization of mice with uis3, uis4, p52 or p52/p36 SPZs induced complete long-lasting protection against infectious SPZ challenge (Table 1),6,36,37,39,41 demonstrating that rodent malaria GAPs are highly efficacious vaccines. In some instances protection could be achieved with a single dose of 50,000 GAP SPZs, as shown for immunizations with P. yoelii uis4 SPZs37 but this is dependent on the mouse strain used.42 The GAP-induced protection was mediated mainly by CD8+ T cells37,43,44 but antibodies also contributed to protection.37 More recently, research into an additional promising GAP strain was published. Deletion of the sporozoite asparagine-rich protein 1 (SAP1) resulted in early LS developmental arrest. No breakthrough infections occurred when up to two million sap1 SPZs were injected into mice. Mice immunized with three doses of 10,000 sap1 SPZs were completely protected against infectious SPZ challenge for at least 210 days45 and recent unpublished data from our laboratory have shown that mice immunized with as few as three doses of 1,000 sap1 SPZs are completely protected against infectious SPZ challenge for at least 90 days (Aly AS, SBRI, USA, unpublished results). Interestingly, the sap1 SPZs lacked expression of a number of other genes including UIS3, UIS4 and P52, rendering it a quasi-multi-loci attenuated strain.45

An external file that holds a picture, illustration, etc.
Object name is nihms-373463-f0001.jpg

Liver stage (LS) developmental arrest of genetically attenuated parasites (GAPs) in rodent malaria models. Wildtype sporozoites invade hepatocytes with the formation of a parasitophorous vacuole membrane (PVM), transform into LS trophozoites and mature as LS schizonts. Schizonts eventually form infectious exo-erythrocytic merozoites (wildtype). GAP sporozoites successfully invade hepatocytes but do not develop fully as LSs. The p52/p36 GAP arrests without the formation of a PV. The sap1 GAP forms a PVM and then arrests. The uis3 and uis4 GAPs form a PV begin to develop but arrest soon after the transition to early schizogony. The fabb/f GAP develops furthest and enters into late schizogony but is unable to form infectious merozoites.

Table 1

Biological features and protective efficacies of rodent malaria GAP vaccines

Knock
out (KO)
gene*
Localization/
Function
Phenotype of
KO parasite
Mouse
strain
Immunization
dose ×103
(interval in
days)
Challenge
dose ×103
(day after
immunization)
%
Protection
Potential
mediators of
protection
Ref
#
P. berghei
 UIS4PVM*/Critical for
LS development
Development
arrested at early
schizont
Occasional
breakthrough
C57BL/610/10 (14)/10 (28)50 (38)100%Not determined6
 UIS3PVM/Critical for
LS development
Development
arrested at early
schizont
No breakthrough
C57BL/610/10 (34)/10 (45)
10/10 (14)
10 (30)
10 (7)
100%
70%
IFNγ, CD8 T
cells in IFNγ−/−,
or by Ab depletion,
adoptive
transfer
36
36
UIS3 & UIS4
(double KO)
PVM/Critical for
LS development
Development
arrested at early
schizont
No breakthrough
C57BL/610/10 (14)/10 (28)10 (7, 118)100%IFNγ-producing
CD8 T cells in
β2m−/−, or by
intracellular
cytokine stain
ing
43
 P52Micronemal
protein
PVM formation
Development
arrested at
trophozoite
Occasional
breakthrough
BALB/c
C57BL/6
C57BL/6
50
50/20 (7)
50/20 (7)/20 (14)
10 (120)
10 (10)
10 (30)
100%
25%
100%
Not determined39
39
39
P. yoelii
 UIS3PVM/Critical for
LS development
Development
arrested at early
schizont
No breakthrough
BALB/cJ
BALB/cJ
BALB/cJ
10/10 (14)/10 (28)
10/10 (14)/10 (28)
50
10 (60)
10 (180)
10 (7)
100%
75%
0%
CD8 T cells by
Ab depletion
37
37
37
 UIS4PVM/Critical for
LS development
Development
arrested at early
schizont
No breakthrough
BALB/cJ
BALB/cJ
BALB/cJ
BALB/cAn
10/10 (14)/10 (28)
10/10 (14)/10 (28)
50
50
10 (60)
10 (180)
10 (30)
10 (30)
100%
100%
100%
0%
CD8 T cells by
Ab depletion
37
37
37
42
 SAP1Cytoplasm
regulates
expression of UIS
genes
Development
arrested at tro
phozoite
No breakthrough
BALB/cJ10/10 (14)/10 (28)10 (30, 110)100%Not determined45
P52/P36
(double KO)
P52 in
micronemes P36
unknown
PVM formation
Development
arrested at tro
phozoite
No breakthrough
BALB/cJ10/10 (7)/10 (14)10 (30)100%Not determined41
*PVM, Parasitophorous vacuole membrane; LS, liver stage; KO, knockout.

An additional development in GAP research has been the attenuation of LSs by the inactivation of a LS-essential metabolic pathway involved in the synthesis of fatty acids. A bacterial-like type II fatty acid synthesis pathway (FAS II) is encoded by the Plasmodium genome.34 Recent transcriptome and proteome data obtained from P. yoelii LSs demonstrated the presence of FAS II enzymes and transcript abundance of FAS II enzyme-encoding genes was highest in liver stages when compared to other life cycle stages.46 The fatty acid chain elongation module of FAS II consists of four key enzymes—FabB/F, FabG, FabI and FabZ. Deletion of FabI in P. berghei47 and either FabB/F or FabZ in P. yoelii48 had no effect on blood stage replication and gametocytogenesis providing evidence that FAS II was dispensable for this part of the life cycle. During initial LS development, no apparent defect could be observed in any of the FAS II knockout lines. However, late in LS development, the parasite failed to routinely generate exoerythrocytic merozoites. In the P. berghei fabi parasites this caused a severe delay in the onset of blood stage patency47 whereas the P. yoelii fabb/f and fabz parasites failed to cause a blood stage infection altogether.48 Thus, FAS II is necessary only for late liver stage development. The complete developmental arrest of P. yoelii fabb/f parasites without breakthrough infections allowed our laboratory to test whether this GAP strain induces protection. Indeed, mice immunized with three doses of 10,000 fabb/f SPZs were completely protected against infectious SPZ challenge for at least 210 days. Strikingly, a single dose immunization of 10,000 fabb/f SPZs conferred complete protection for a at least month (Vaughan AM, SBRI, USA, unpublished data). Since FAS II knockouts develop significantly and form large LS schizonts, it is possible that they expose more antigens to the immune system and thus induce a broader, more diversified immune response. However, this hypothesis remains to be investigated.

Another major question is whether the route of immunization determines the efficacy of GAP vaccines. Most published GAP immunization/protection data report intravenous immunization regimens. However, there is published evidence that GAPs protect by other routes of administration such as subcutaneous or intradermal immunizations, shown for the P. berghei p52 GAP49 and the P. berghei uis3 GAP.36 Data from our laboratory has demonstrated that subcutaneous immunizations with the P. yoelii sap1 GAP confers complete protection against infectious SPZ challenge (Aly AS, SBRI, USA, unpublished results).

Together, the rodent malaria GAP data demonstrate that safe and protective attenuated malaria parasites can be created by genetic engineering. Is it possible to genetically engineer attenuated human malaria parasites? To that end, the single disruption of P. falciparum P52 was reported50 and in another study the individual deletions and the simultaneous deletion of the P. falciparum P52 and P36 were reported.24 The p52/p36 dual gene deletion parasites, created by double-crossover recombination that leads to the loss of the genes, were normal throughout the initial stages of the life cycle including SPZ production of the attenuated line. However, p52/p36 parasites exhibited complete growth arrest of LSs in vitro in a hepatocytic cell line and in a humanized mouse model carrying human hepatocytes.24 Dual gene deletions might alleviate safety concerns for the use of GAPs as a vaccine in humans. To assess their safety and preliminary efficacy, the P. falciparum p52/p36 GAP line has been selected for advance into phase I/IIa clinical trials through the administration of GAP-infected mosquito bites to human volunteers.24

Together the evidence garnered from vaccination with live-attenuated SPZs using animal models of malaria and P. falciparum demonstrates that the whole-parasite immunization approach elicits immune responses that completely protect against infection for extended periods of time.

Infectious sporozoite vaccination

Why does repeated natural exposure to infectious SPZs in malaria-endemic areas not induce protection against infection? One proposed potential explanation is that normal SPZs are somehow qualitatively different from attenuated SPZs and do not induce or subvert immune responses. However, immunization of mice with infectious SPZs and treatment with chloroquine (a drug that kills blood stages) or primaquine (a drug that kills LSs) confers complete protection against challenge after drugs are cleared from the immunized animals.51,52 Furthermore, vaccination of human volunteers that had been given chloroquine along with three doses of 12–15 bites each from P. falciparum-infected mosquitoes conferred protection against challenge with infected mosquitoes after the drug had waned from volunteers.53 These infection-treatment vaccination experiments indicate that the aforementioned qualitative difference between normal and attenuated SPZs cannot be substantiated. What then is the apparent reason for lack of protection against infection in endemic areas? One proposed mechanism is the suppression of immunity against PEs by blood stage parasites that circulate in many individuals when they become exposed to new infectious mosquito bites. There is evidence from rodent malaria studies that this suppression does indeed occur.54 This mechanism has however been challenged recently by research showing that mice with blood stage infections can develop robust, protective T-cell responses against PE stages.55 An obvious potential reason for lack of protection against infection might lie in the SPZ dose that is received during natural infectious bite. We currently do not know how many SPZs are transmitted per bite in endemic areas. Laboratory transmission experiments with rodent malaria parasites indicate that the dose ranges from a few dozen to a few hundred per mosquito.56 Thus, each individual SPZ inoculation might not be sufficient to elicit any protective response at all and might even induce immune-tolerance. Clearly, much remains unknown in this complex biological puzzle.

Immunological mechanism of protection

Complete, long-lasting protection is provided by both live-attenuated irrSPZs and GAP SPZs.57,58 CD8+ T cells play a critical role in the protection of mice immunized with irrSPZs,26,59 and IL-4-secreting CD4+ T cells are essential for the development of CD8+ T cell responses to LS parasites.60 Loss of protective immunity in β2 microglobulin−/− mice (which lack CD8+ T cells and natural killer T cells) and in mice depleted of CD8+ T cells indicates the indispensable role of CD8+ T cell-mediated effector mechanisms.61,62 Protection in humans conferred by P. falciparum irrSPZ might also depend on CD8+ lymphocytes.63 Since irrSPZ immunizations protected perforin−/− and granzyme B−/− mice (which lack the ability to kill cells through cytolytic activity) from infectious SPZ challenge, it was speculated that CD8+ T cell killing of infected hepatocytes is primarily through interferon-γ (IFNγ)-induced nitric oxide (NO), rather than by direct cytolytic activity.64,65 Indeed, it has been shown that IFNγ responses correlate with protective immunity against the PE stage64 although the importance of CD8+ T cell-derived IFNγ in particular is yet to be fully established.66,67 Sterile protection obtained with a P. berghei GAP was found to correlate with IFNγ producing CD8+ T cells.43 Conversely, IFNγ independent CD8+ T cell-mediated protective immunity has also been demonstrated,68 and IFNγ secretion by CD8+ T cells may not be essential for protecting mice against P. yoelii SPZ challenge.69 It is likely that CD8+ T cell IFNγ induction and cytolytic activity are both involved in the full range of immune responses to irrSPZs and GAP SPZs.

Protective CD8+ T cell priming occurs in skin-draining lymph nodes after immunization by the bite of irrSPZ-infected mosquitoes,70 whereas hepatic CD8+ dendritic cells (DCs) are responsible for priming CD8+ T cells by intravenous immunization with irrSPZs.71 Both wildtype and irrSPZs are processed for class I presentation by DCs. However, DCs pulsed with wildtype SPZs can only stimulate memory CD8+ T cells, whereas DCs pulsed with irrSPZ are capable of activating both effector and memory CD8+ T cells.72

The puzzle of persistence

It is thought that in the irrSPZ model, the maintenance of protective immunity requires persistence of growth-arrested LSs. The evidence supporting this notion comes from experiments in which P. berghei irrSPZ-vaccinated rodents were treated with primaquine, a drug that kills early liver stages.73 This experimental design resulted in gradual loss of protection in immunized rats, 42% loss after one month and 84% loss after three months. The primaquine had to be given within seven days after irrSPZ immunization. If primaquine was given later, it had no impact on protection. The same study detected irrLSs in the liver of immunized rats for up to six months.73 The need of persistent irrLSs was confirmed in another study using P. berghei irrSPZ-vaccinations in mice.74 Treatment of irrSPZ-immunized mice with primaquine had no effect on protection when mice were challenged one week after the last immunization but if challenged at five months after the last immunization, 50% of the mice lost protection.74 For GAP SPZ immunizations, there is currently only one published study that has examined the effect of primaquine treatment on protection,44 which used immunizations with the P. berghei uis3 GAP. The authors found that primaquine treatment of GAP-immunized mice led to complete loss of protection when mice were challenged one month after the last immunization.44 In the P. yoelii GAP models however, growth arrested LSs do not persist, but nevertheless immunizations with these GAPs confer long lasting sterile protection against SPZ challenge.37,41 Thus, the requirement for growth-arrested LSs to persist in immunized animals in order to maintain immune protection might be exclusively associated with the P. berghei model but this important issue will need further investigation. Recent data from our laboratory clearly show that a triple immunization protocol with P. yoelii uis3 SPZs followed by primaquine treatment after each immunization conferred complete protection against infectious SPZ challenge given three months after the last immunization (Mikolajczak SA, SBRI, USA, unpublished data), indicating that persistent LSs are not necessary for the maintenance of immune protection in this GAP model.

Outlook and Conclusions

The limited data available for irrSPZ immunization studies in humans indicate that live-attenuated whole parasites induce sterilizing immunity against challenge with infectious P. falciparum SPZs. The immune protection is strain-transcending and lasts for at least ten months. Furthermore, as discussed earlier, numerous animal studies support the notion that GAP vaccinations confer sterile, long lasting protection. Within the next two years a clinical dose escalation study with a cryopreserved formulation of irrSPZs that is administered intradermally or subcutaneously and a first generation genetically attenuated SPZ vaccine that is administered by mosquito bite will likely yield clear data on the safety and protective efficacy of this class of vaccines. In the future then, the most formidable obstacle for the live-attenuated vaccine approach lies in the current need for vaccine cryopreservation in liquid nitrogen. A cryopreserved malaria vaccine requires a special cold chain and cannot be delivered in the context of the expanded program on immunization (EPI), currently the major platform through which many childhood vaccines are delivered in resource poor nations. Does that imply that live-attenuated vaccine approaches are a dead end and will remain confined within the research arena? In this context, it is of importance to consider that delivery of a malaria vaccine for disease elimination will likely require delivery platforms that are distinct from EPI, possibly mass vaccination campaigns. Furthermore, although no human vaccine is currently delivered in a cryopreserved formulation, it is of interest to note that live whole cell-parasite vaccines for veterinary applications such as a vaccine for African East Coast Fever are delivered in liquid nitrogen in resource poor countries.75 It is conceivable that if subunit vaccine approaches continue to confer only limited protection, the delivery of an efficacious whole cell attenuated malaria vaccine will be the only means by which we can hope to eradicate malaria. If this turns out to be the case, the emphasis is likely to shift from development to delivery of a malaria vaccine in the coming decades.

Acknowledgements

The author’s are funded by grants from the Foundation for the National Institutes of Health through the Grand Challenges in Global Health initiative and the National Institutes of Health.

Abbreviations

GAPgenetically attenuated parasite
irrirradiated
LSliver stage
PEpre-erythrocytic
SPZsporozoite
UISupregulated in infectious sporozoites
PVparasitophorous vacuole
PVMparasitophorous vacuole membrane

References

1. Guerra CA, Gikandi PW, Tatem AJ, Noor AM, Smith DL, Hay SI, et al. The limits and intensity of Plasmodium falciparum transmission: implications for malaria control and elimination worldwide. PLoS Med. 2008;5:38. [Europe PMC free article] [Abstract] [Google Scholar]
2. Greenwood BM. Control to elimination: implications for malaria research. Trends Parasitol. 2008;24:449–54. [Abstract] [Google Scholar]
3. Vanderberg JP, Frevert U. Intravital microscopy demonstrating antibody-mediated immobilisation of Plasmodium berghei sporozoites injected into skin by mosquitoes. Int J Parasitol. 2004;34:991–6. [Abstract] [Google Scholar]
4. Amino R, Thiberge S, Martin B, Celli S, Shorte S, Frischknecht F, et al. Quantitative imaging of Plasmodium transmission from mosquito to mammal. Nat Med. 2006;12:220–4. [Abstract] [Google Scholar]
5. Frevert U, Engelmann S, Zougbede S, Stange J, Ng B, Matuschewski K, et al. Intravital observation of Plasmodium berghei sporozoite infection of the liver. PLoS Biol. 2005;3:192. [Europe PMC free article] [Abstract] [Google Scholar]
6. Mueller AK, Camargo N, Kaiser K, Andorfer C, Frevert U, Matuschewski K, et al. Plasmodium liver stage developmental arrest by depletion of a protein at the parasite-host interface. Proc Natl Acad Sci USA. 2005;102:3022–7. [Europe PMC free article] [Abstract] [Google Scholar]
7. Charoenvit Y, Mellouk S, Sedegah M, Toyoshima T, Leef MF, De la Vega P, et al. Plasmodium yoelii: 17-kDa hepatic and erythrocytic stage protein is the target of an inhibitory monoclonal antibody. Exp Parasitol. 1995;80:419–29. [Abstract] [Google Scholar]
8. Singh AP, Buscaglia CA, Wang Q, Levay A, Nussenzweig DR, Walker JR, et al. Plasmodium circumsporozoite protein promotes the development of the liver stages of the parasite. Cell. 2007;131:492–504. [Abstract] [Google Scholar]
9. Miller LH, Baruch DI, Marsh K, Doumbo OK. The pathogenic basis of malaria. Nature. 2002;415:673–9. [Abstract] [Google Scholar]
10. Dame JB, Williams JL, McCutchan TF, Weber JL, Wirtz RA, Hockmeyer WT, et al. Structure of the gene encoding the immunodominant surface antigen on the sporozoite of the human malaria parasite Plasmodium falciparum. Science. 1984;225:593–9. [Abstract] [Google Scholar]
11. Enea V, Ellis J, Zavala F, Arnot DE, Asavanich A, Masuda A, et al. DNA cloning of Plasmodium falciparum circumsporozoite gene: amino acid sequence of repetitive epitope. Science. 1984;225:628–30. [Abstract] [Google Scholar]
12. Stoute JA, Slaoui M, Heppner DG, Momin P, Kester KE, Desmons P, et al. A preliminary evaluation of a recombinant circumsporozoite protein vaccine against Plasmodium falciparum malaria. RTS,S Malaria Vaccine Evaluation Group. N Engl J Med. 1997;336:86–91. [Abstract] [Google Scholar]
13. Alonso PL. Malaria: deploying a candidate vaccine (RTS,S/AS02A) for an old scourge of humankind. Int Microbiol. 2006;9:83–93. [Abstract] [Google Scholar]
14. Alonso PL, Sacarlal J, Aponte JJ, Leach A, Macete E, Aide P, et al. Duration of protection with RTS,S/AS02A malaria vaccine in prevention of Plasmodium falciparum disease in Mozambican children: single-blind extended follow-up of a randomised controlled trial. Lancet. 2005;366:2012–8. [Abstract] [Google Scholar]
15. Alonso PL, Sacarlal J, Aponte JJ, Leach A, Macete E, Milman J, et al. Efficacy of the RTS,S/AS02A vaccine against Plasmodium falciparum infection and disease in young African children: randomised controlled trial. Lancet. 2004;364:1411–20. [Abstract] [Google Scholar]
16. Bejon P, Lusingu J, Olotu A, Leach A, Lievens M, Vekemans J, et al. Efficacy of RTS,S/AS01E vaccine against malaria in children 5 to 17 months of age. N Engl J Med. 2008;359:2521–32. [Europe PMC free article] [Abstract] [Google Scholar]
17. Aponte JJ, Aide P, Renom M, Mandomando I, Bassat Q, Sacarlal J, et al. Safety of the RTS,S/AS02D candidate malaria vaccine in infants living in a highly endemic area of Mozambique: a double blind randomised controlled phase I/IIb trial. Lancet. 2007;370:1543–51. [Abstract] [Google Scholar]
18. Nussenzweig RS, Vanderberg J, Most H, Orton C. Protective immunity produced by the injection of x-irradiated sporozoites of Plasmodium berghei. Nature. 1967;216:160–2. [Abstract] [Google Scholar]
19. Nussenzweig RS, Vanderberg J, Spitalny GL, Rivera CI, Orton C, Most H. Sporozoite-induced immunity in mammalian malaria. A review. Am J Trop Med Hyg. 1972;21:722–8. [Abstract] [Google Scholar]
20. Alger NE, Harant J. Plasmodium berghei: heat-treated sporozoite vaccination of mice. Exp Parasitol. 1976;40:261–8. [Abstract] [Google Scholar]
21. Doolan DL, Martinez-Alier N. Immune response to pre-erythrocytic stages of malaria parasites. Curr Mol Med. 2006;6:169–85. [Abstract] [Google Scholar]
22. Clyde DF, Most H, McCarthy VC, Vanderberg JP. Immunization of man against sporozite-induced falciparum malaria. Am J Med Sci. 1973;266:169–77. [Abstract] [Google Scholar]
23. Rieckmann KH, Carson PE, Beaudoin RL, Cassells JS, Sell KW. Letter: Sporozoite induced immunity in man against an Ethiopian strain of Plasmodium falciparum. Trans R Soc Trop Med Hyg. 1974;68:258–9. [Abstract] [Google Scholar]
24. Vanbuskirk KM, O’Neill MT, De La, Vega P, Maier AG, Krzych U, Williams J, et al. Preerythrocytic, live-attenuated Plasmodium falciparum vaccine candidates by design. Proc Natl Acad Sci USA. 2009;106:13004–9. [Europe PMC free article] [Abstract] [Google Scholar]
25. Vanderberg JP, Nussenzweig RS, Most H, Orton CG. Protective immunity produced by the injection of x-irradiated sporozoites of Plasmodium berghei II. Effects of radiation on sporozoites. J Parasitol. 1968;54:1175–80. [Abstract] [Google Scholar]
26. Tsuji M, Zavala F. T cells as mediators of protective immunity against liver stages of Plasmodium. Trends Parasitol. 2003;19:88–93. [Abstract] [Google Scholar]
27. Hoffman SL, Goh LM, Luke TC, Schneider I, Le TP, Doolan DL, et al. Protection of humans against malaria by immunization with radiation-attenuated Plasmodium falciparum sporozoites. J Infect Dis. 2002;185:1155–64. [Abstract] [Google Scholar]
28. Luke TC, Hoffman SL. Rationale and plans for developing a non-replicating, metabolically active, radiation-attenuated Plasmodium falciparum sporozoite vaccine. J Exp Biol. 2003;206:3803–8. [Abstract] [Google Scholar]
29. Wong KA, Zhou A, Rodriguez A. Protective immunity induced by daily bites from irradiated mosquitoes infected with Plasmodium yoelii. Parasite Immunol. 2008;30:482–6. [Europe PMC free article] [Abstract] [Google Scholar]
30. Chattopadhyay R, Conteh S, Li M, James ER, Epstein JE, Hoffman SL. The Effects of radiation on the safety and protective efficacy of an attenuated Plasmodium yoelii sporozoite malaria vaccine. Vaccine. 2009;27:3675–80. [Abstract] [Google Scholar]
31. Sedegah M, Weiss WW, Hoffman SL. Cross-protection between attenuated Plasmodium berghei and P. yoelii sporozoites. Parasite Immunol. 2007;29:559–65. [Europe PMC free article] [Abstract] [Google Scholar]
32. Carlton JM, Adams JH, Silva JC, Bidwell SL, Lorenzi H, Caler E, et al. Comparative genomics of the neglected human malaria parasite Plasmodium vivax. Nature. 2008;455:757–63. [Europe PMC free article] [Abstract] [Google Scholar]
33. Carlton JM, Angiuoli SV, Suh BB, Kooij TW, Pertea M, Silva JC, et al. Genome sequence and comparative analysis of the model rodent malaria parasite Plasmodium yoelii yoelii. Nature. 2002;419:512–9. [Abstract] [Google Scholar]
34. Gardner MJ, Hall N, Fung E, White O, Berriman M, Hyman RW, et al. Genome sequence of the human malaria parasite Plasmodium falciparum. Nature. 2002;419:498–511. [Europe PMC free article] [Abstract] [Google Scholar]
35. Mikolajczak SA, Silva-Rivera H, Peng X, Tarun AS, Camargo N, Jacobs-Lorena V, et al. Distinct malaria parasite sporozoites reveal transcriptional changes that cause differential tissue infection competence in the mosquito vector and mammalian host. Mol Cell Biol. 2008;28:6196–207. [Europe PMC free article] [Abstract] [Google Scholar]
36. Mueller AK, Labaied M, Kappe SH, Matuschewski K. Genetically modified Plasmodium parasites as a protective experimental malaria vaccine. Nature. 2005;433:164–7. [Abstract] [Google Scholar]
37. Tarun AS, Dumpit RF, Camargo N, Labaied M, Liu P, Takagi A, et al. Protracted sterile protection with Plasmodium yoelii pre-erythrocytic genetically attenuated parasite malaria vaccines is independent of significant liver-stage persistence and is mediated by CD8+ T cells. J Infect Dis. 2007;196:608–16. [Abstract] [Google Scholar]
38. Mikolajczak SA, Jacobs-Lorena V, MacKellar DC, Camargo N, Kappe SH. L-FABP is a critical host factor for successful malaria liver stage development. Int J Parasitol. 2007;37:483–9. [Abstract] [Google Scholar]
39. van Dijk MR, Douradinha B, Franke-Fayard B, Heussler V, van Dooren MW, van Schaijk B, et al. Genetically attenuated, P36p-deficient malarial sporozoites induce protective immunity and apoptosis of infected liver cells. Proc Natl Acad Sci USA. 2005;102:12194–9. [Europe PMC free article] [Abstract] [Google Scholar]
40. Ishino T, Chinzei Y, Yuda M. Two proteins with 6-cys motifs are required for malarial parasites to commit to infection of the hepatocyte. Mol Microbiol. 2005;58:1264–75. [Abstract] [Google Scholar]
41. Labaied M, Harupa A, Dumpit RF, Coppens I, Mikolajczak SA, Kappe SH. Plasmodium yoelii sporozoites with simultaneous deletion of P52 and P36 are completely attenuated and confer sterile immunity against infection. Infect Immun. 2007;75:3758–68. [Europe PMC free article] [Abstract] [Google Scholar]
42. Kumar KA, Baxter P, Tarun AS, Kappe SH, Nussenzweig V. Conserved protective mechanisms in radiation and genetically attenuated uis3(−) and uis4(−) Plasmodium sporozoites. PLoS ONE. 2009;4:4480. [Europe PMC free article] [Abstract] [Google Scholar]
43. Jobe O, Lumsden J, Mueller AK, Williams J, Silva-Rivera H, Kappe SH, et al. Genetically attenuated Plasmodium berghei liver stages induce sterile protracted protection that is mediated by major histocompatibility complex Class I-dependent interferon-gamma-producing CD8+ T cells. J Infect Dis. 2007;196:599–607. [Europe PMC free article] [Abstract] [Google Scholar]
44. Mueller AK, Deckert M, Heiss K, Goetz K, Matuschewski K, Schluter D. Genetically attenuated Plasmodium berghei liver stages persist and elicit sterile protection primarily via CD8 T cells. Am J Pathol. 2007;171:107–15. [Europe PMC free article] [Abstract] [Google Scholar]
45. Aly AS, Mikolajczak SA, Rivera HS, Camargo N, Jacobs-Lorena V, Labaied M, et al. Targeted deletion of SAP1 abolishes the expression of infectivity factors necessary for successful malaria parasite liver infection. Mol Microbiol. 2008;69:152–63. [Europe PMC free article] [Abstract] [Google Scholar]
46. Tarun AS, Peng X, Dumpit RF, Ogata Y, Silva-Rivera H, Camargo N, et al. A combined transcriptome and proteome survey of malaria parasite liver stages. Proc Natl Acad Sci USA. 2008;105:305–10. [Europe PMC free article] [Abstract] [Google Scholar]
47. Yu M, Kumar TR, Nkrumah LJ, Coppi A, Retzlaff S, Li CD, et al. The fatty acid biosynthesis enzyme FabI plays a key role in the development of liver-stage malarial parasites. Cell Host Microbe. 2008;4:567–78. [Europe PMC free article] [Abstract] [Google Scholar]
48. Vaughan AM, O’Neill MT, Tarun AS, Camargo N, Phuong TM, Aly AS, et al. Type II fatty acid synthesis is essential only for malaria parasite late liver stage development. Cell Microbiol. 2009;11:506–20. [Europe PMC free article] [Abstract] [Google Scholar]
49. Douradinha B, van Dijk MR, Ataide R, van Gemert GJ, Thompson J, Franetich JF, et al. Genetically attenuated P36p-deficient Plasmodium berghei sporozoites confer long-lasting and partial cross-species protection. Int J Parasitol. 2007;37:1511–9. [Abstract] [Google Scholar]
50. van Schaijk BC, Janse CJ, van Gemert GJ, van Dijk MR, Gego A, Franetich JF, et al. Gene disruption of Plasmodium falciparum p52 results in attenuation of malaria liver stage development in cultured primary human hepatocytes. PLoS ONE. 2008;3:3549. [Europe PMC free article] [Abstract] [Google Scholar]
51. Belnoue E, Costa FT, Frankenberg T, Vigario AM, Voza T, Leroy N, et al. Protective T cell immunity against malaria liver stage after vaccination with live sporozoites under chloroquine treatment. J Immunol. 2004;172:2487–95. [Abstract] [Google Scholar]
52. Putrianti ED, Silvie O, Kordes M, Borrmann S, Matuschewski K. Vaccine-like immunity against malaria by repeated causal-prophylactic treatment of liver-stage Plasmodium parasites. J Infect Dis. 2009;199:899–903. [Abstract] [Google Scholar]
53. Roestenberg M, McCall M, Hopman J, Wiersma J, Luty AJ, van Gemert GJ, et al. Protection against a malaria challenge by sporozoite inoculation. N Engl J Med. 2009;361:468–77. [Abstract] [Google Scholar]
54. Ocana-Morgner C, Mota MM, Rodriguez A. Malaria blood stage suppression of liver stage immunity by dendritic cells. J Exp Med. 2003;197:143–51. [Europe PMC free article] [Abstract] [Google Scholar]
55. Hafalla JC, Rai U, Bernal-Rubio D, Rodriguez A, Zavala F. Efficient development of plasmodium liver stage-specific memory CD8+ T cells during the course of blood-stage malarial infection. J Infect Dis. 2007;196:1827–35. [Abstract] [Google Scholar]
56. Jin Y, Kebaier C, Vanderberg J. Direct microscopic quantification of dynamics of Plasmodium berghei sporozoite transmission from mosquitoes to mice. Infect Immun. 2007;75:5532–9. [Europe PMC free article] [Abstract] [Google Scholar]
57. Waters AP, Mota MM, van Dijk MR, Janse CJ. Parasitology. Malaria vaccines: back to the future? Science. 2005;307:528–30. [Abstract] [Google Scholar]
58. Good MF. Genetically modified Plasmodium highlights the potential of whole parasite vaccine strategies. Trends Immunol. 2005;26:295–7. [Abstract] [Google Scholar]
59. Overstreet MG, Cockburn IA, Chen YC, Zavala F. Protective CD8 T cells against Plasmodium liver stages: immunobiology of an ‘unnatural’ immune response. Immunol Rev. 2008;225:272–83. [Europe PMC free article] [Abstract] [Google Scholar]
60. Carvalho LH, Sano G, Hafalla JC, Morrot A, Curotto de Lafaille MA, Zavala F. IL-4-secreting CD4+ T cells are crucial to the development of CD8+ T-cell responses against malaria liver stages. Nat Med. 2002;8:166–70. [Abstract] [Google Scholar]
61. Weiss WR, Sedegah M, Beaudoin RL, Miller LH, Good MF. CD8+ T cells (cytotoxic/suppressors) are required for protection in mice immunized with malaria sporozoites. Proc Natl Acad Sci USA. 1988;85:573–6. [Europe PMC free article] [Abstract] [Google Scholar]
62. White KL, Snyder HL, Krzych U. MHC class I-dependent presentation of exoerythrocytic antigens to CD8+ T lymphocytes is required for protective immunity against Plasmodium berghei. J Immunol. 1996;156:3374–81. [Abstract] [Google Scholar]
63. Wizel B, Houghten RA, Parker KC, Coligan JE, Church P, Gordon DM, et al. Irradiated sporozoite vaccine induces HLA-B8-restricted cytotoxic T lymphocyte responses against two overlapping epitopes of the Plasmodium falciparum sporozoite surface protein 2. J Exp Med. 1995;182:1435–45. [Europe PMC free article] [Abstract] [Google Scholar]
64. Doolan DL, Hoffman SL. The complexity of protective immunity against liver-stage malaria. J Immunol. 2000;165:1453–62. [Abstract] [Google Scholar]
65. Klotz FW, Scheller LF, Seguin MC, Kumar N, Marletta MA, Green SJ, et al. Co-localization of inducible-nitric oxide synthase and Plasmodium berghei in hepatocytes from rats immunized with irradiated sporozoites. J Immunol. 1995;154:3391–5. [Abstract] [Google Scholar]
66. Schofield L, Ferreira A, Altszuler R, Nussenzweig V, Nussenzweig RS. Interferon-gamma inhibits the intrahepatocytic development of malaria parasites in vitro. J Immunol. 1987;139:2020–5. [Abstract] [Google Scholar]
67. Seguin MC, Klotz FW, Schneider I, Weir JP, Goodbary M, Slayter M, et al. Induction of nitric oxide synthase protects against malaria in mice exposed to irradiated Plasmodium berghei infected mosquitoes: involvement of interferon gamma and CD8+ T cells. J Exp Med. 1994;180:353–8. [Europe PMC free article] [Abstract] [Google Scholar]
68. Rodrigues EG, Claassen J, Lee S, Wilson JM, Nussenzweig RS, Tsuji M. Interferon-gamma-independent CD8+ T cell-mediated protective antimalaria immunity elicited by recombinant adenovirus. Parasite Immunol. 2000;22:157–60. [Abstract] [Google Scholar]
69. Chakravarty S, Baldeviano GC, Overstreet MG, Zavala F. Effector CD8+ T lymphocytes against liver stages of Plasmodium yoelii do not require gamma interferon for antiparasite activity. Infect Immun. 2008;76:3628–31. [Europe PMC free article] [Abstract] [Google Scholar]
70. Chakravarty S, Cockburn IA, Kuk S, Overstreet MG, Sacci JB, Zavala F. CD8+ T lymphocytes protective against malaria liver stages are primed in skin-draining lymph nodes. Nat Med. 2007;13:1035–41. [Abstract] [Google Scholar]
71. Jobe O, Donofrio G, Sun G, Liepinsh D, Schwenk R, Krzych U. Immunization with radiation-attenuated Plasmodium berghei sporozoites induces liver cCD8alpha+DC that activate CD8+T cells against liver-stage malaria. PLoS ONE. 2009;4:5075. [Europe PMC free article] [Abstract] [Google Scholar]
72. Plebanski M, Hannan CM, Behboudi S, Flanagan KL, Apostolopoulos V, Sinden RE, et al. Direct processing and presentation of antigen from malaria sporozoites by professional antigen-presenting cells in the induction of CD8 T-cell responses. Immunol Cell Biol. 2005;83:307–12. [Abstract] [Google Scholar]
73. Scheller LF, Azad AF. Maintenance of protective immunity against malaria by persistent hepatic parasites derived from irradiated sporozoites. Proc Natl Acad Sci USA. 1995;92:4066–8. [Europe PMC free article] [Abstract] [Google Scholar]
74. Berenzon D, Schwenk RJ, Letellier L, Guebre-Xabier M, Williams J, Krzych U. Protracted protection to Plasmodium berghei malaria is linked to functionally and phenotypically heterogeneous liver memory CD8+ T cells. J Immunol. 2003;171:2024–34. [Abstract] [Google Scholar]
75. Di Giulio G, Lynen G, Morzaria S, Oura C, Bishop R. Live immunization against East Coast fever—current status. Trends Parasitol. 2009;25:85–92. [Abstract] [Google Scholar]

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/41385911
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/41385911

Smart citations by scite.ai
Smart citations by scite.ai include citation statements extracted from the full text of the citing article. The number of the statements may be higher than the number of citations provided by EuropePMC if one paper cites another multiple times or lower if scite has not yet processed some of the citing articles.
Explore citation contexts and check if this article has been supported or disputed.
https://scite.ai/reports/10.4161/hv.6.1.9654

Supporting
Mentioning
Contrasting
0
83
0

Article citations


Go to all (72) article citations

Similar Articles 


To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.


Funding 


Funders who supported this work.

NIAID NIH HHS (4)