Europe PMC
Nothing Special   »   [go: up one dir, main page]

Europe PMC requires Javascript to function effectively.

Either your web browser doesn't support Javascript or it is currently turned off. In the latter case, please turn on Javascript support in your web browser and reload this page.

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


An attractive approach for designing lead antibody candidates is to mimic natural protein interactions by grafting peptide recognition motifs into the complementarity-determining regions (CDRs). We are using this approach to generate single-domain (VH) antibodies specific for amyloid-forming proteins such as the Alzheimer's Aβ peptide. Here, we use random mutagenesis and yeast surface display to improve the binding affinity of a lead VH domain grafted with Aβ residues 33-42 in CDR3. Interestingly, co-selection for improved Aβ binding and VH display on the surface of yeast yields antibody domains with improved affinity and reduced stability. The highest affinity VH domains were strongly destabilized on the surface of yeast as well as unfolded when isolated as autonomous domains. In contrast, stable VH domains with improved affinity were reliably identified using yeast surface display by replacing the display antibody that recognizes a linear epitope tag at the terminus of both folded and unfolded VH domains with a conformational ligand (Protein A) that recognizes a discontinuous epitope on the framework of folded VH domains. Importantly, we find that selection for improved stability using Protein A without simultaneous co-selection for improved Aβ binding leads to strong enrichment for stabilizing mutations that reduce antigen binding. Our findings highlight the importance of simultaneously optimizing affinity and stability to improve the rapid isolation of well-folded and specific antibody fragments.

Free full text 


Logo of proengLink to Publisher's site
Protein Eng Des Sel. 2015 Oct; 28(10): 339–350.
Published online 2015 Sep 19. https://doi.org/10.1093/protein/gzv050
PMCID: PMC4596281
PMID: 26386257

Co-evolution of affinity and stability of grafted amyloid-motif domain antibodies

Associated Data

Supplementary Materials

Abstract

An attractive approach for designing lead antibody candidates is to mimic natural protein interactions by grafting peptide recognition motifs into the complementarity-determining regions (CDRs). We are using this approach to generate single-domain (VH) antibodies specific for amyloid-forming proteins such as the Alzheimer's Aβ peptide. Here, we use random mutagenesis and yeast surface display to improve the binding affinity of a lead VH domain grafted with Aβ residues 33–42 in CDR3. Interestingly, co-selection for improved Aβ binding and VH display on the surface of yeast yields antibody domains with improved affinity and reduced stability. The highest affinity VH domains were strongly destabilized on the surface of yeast as well as unfolded when isolated as autonomous domains. In contrast, stable VH domains with improved affinity were reliably identified using yeast surface display by replacing the display antibody that recognizes a linear epitope tag at the terminus of both folded and unfolded VH domains with a conformational ligand (Protein A) that recognizes a discontinuous epitope on the framework of folded VH domains. Importantly, we find that selection for improved stability using Protein A without simultaneous co-selection for improved Aβ binding leads to strong enrichment for stabilizing mutations that reduce antigen binding. Our findings highlight the importance of simultaneously optimizing affinity and stability to improve the rapid isolation of well-folded and specific antibody fragments.

Keywords: CDR, directed evolution, scFv, VH, yeast surface display

Introduction

The intense interest in developing antibodies as therapeutics continues to fuel advances in methodologies for discovering and evolving them (Nelson et al., 2010). In vitro methods such as phage and yeast surface display are particularly attractive because of the ease of using them for selecting lead candidates and evolving their binding properties, as well as the high degree of control they afford over antigen presentation (Sidhu, 2000; Gai and Wittrup, 2007). The compatibility of some of these methods with fluorescence-activated cell sorting (FACS) enables quantitative evaluation of antibody fusion proteins during selection, and prior to subcloning and assessment of the autonomous antibody variants (Boder and Wittrup, 1997; Feldhaus et al., 2003). These and other attractive attributes of in vitro display technologies have led to their widespread use for generating high-affinity antibodies (Bradbury et al., 2011).

Nevertheless, a key weakness of such in vitro selection methods is their increased susceptibility to yield antibodies and fragments thereof with modest specificity and/or stability relative to immunization (Bradbury et al., 2011). This is likely due to the reduced quality control (filtering) mechanisms that antibodies are subjected to during in vitro evolution relative to the analogous process in vivo. This has led to many creative approaches to improve the stringency of selection of stable and specific antibody variants in vitro (Jung et al., 1999; Boder and Wittrup, 2000; Orr et al., 2003; Brockmann et al., 2005; Chao et al., 2006; Demarest and Glaser, 2008; Arbabi-Ghahroudi et al., 2009a; Miller et al., 2010; Brockmann, 2012,Buchanan, 2012; Traxlmayr et al., 2012; Traxlmayr and Obinger, 2012; Fennell et al., 2013; Hasenhindl et al., 2013; Kim et al., 2014a; Turner et al., 2014). One widely used approach is to thermally stress antibody libraries displayed on phage or yeast, and then select variants that retain binding to antigen (Jung et al., 1999; Orr et al., 2003; Arbabi-Ghahroudi et al., 2009b; Mabry et al., 2010; Brockmann, 2012; Traxlmayr et al., 2012; Traxlmayr and Obinger, 2012; Fennell et al., 2013; Xu et al., 2013). Another common approach is to perform negative selections to eliminate antibody variants that bind to noncognate antigens (Bradbury et al., 2011; Miersch et al., 2015). A third approach is to use positive selections (typically in the absence of antigen) for binding to conformational ligands (such as Protein A and L) that recognize folded antibody domains and which bind to the frameworks of certain VH/VL subclasses (Bond et al., 2003; Jespers et al., 2004a,b; Barthelemy et al., 2008; Famm et al., 2008; Kim et al., 2014b).

We have developed an approach for generating lead antibody fragments (VH domains) that recognize amyloid-forming polypeptides (such as the Alzheimer's Aβ peptide) by grafting hydrophobic self-recognition peptides into the third complementarity-determining region (CDR3; Perchiacca et al., 2012a). The resulting Grafted AMyloid-Motif AntiBODIES (gammabodies) typically recognize amyloid aggregates with modest (micromolar) affinity and the corresponding monomeric polypeptides with even weaker affinity (Perchiacca et al., 2012a,b, 2014). We reasoned that these lead antibody domains could be readily evolved for improved binding affinity using a directed evolution approach that involves generating mutant VH libraries, displaying them on the surface of yeast, and selecting variants with improved binding via FACS. Therefore, we evaluated the feasibility of this approach for improving the binding of a VH domain with Aβ residues 33–42 in CDR3 (Aβ33-42 VH) to Aβ42 monomer. Here, we report the isolation of unstable and stable VH variants with improved binding to Aβ as well as methods for improving the evolution of stable and specific antibody fragments on the surface of yeast.

Materials and methods

Library construction and cloning

The wild type Aβ33-42 VH gene was PCR amplified from an existing pET-17b bacterial expression plasmid (Novagen) to introduce NheI (5′) and SalI (3′) restriction sites. This gene was ligated into the pCTCON2 yeast display vector with the corresponding restriction sites. Yeast display libraries were generated for the D VH domains (sorted using the conventional display antibody) and P VH domains (sorted using Protein A) using random mutagenesis except for mutagenesis of P3. The error-prone libraries were first generated by PCR amplification with Taq polymerase (M0320L, New England Biolabs) in the presence of MgCl2 as well as both 8-oxo-dGTP and dPTP (N-2034, N-2037, TriLink Biotechnologies). The amplification primers targeted ~45 base pairs upstream and downstream from the VH gene for subsequent homologous recombination. After agarose gel purification, the libraries were amplified further using Taq polymerase. A total of ~12 µg of amplified DNA and ~2 µg of pCTCON2 plasmid digested with NheI and SalI were transformed into the EBY100 Saccharomyces cerevisiae strain using electroporation, and the libraries were generated via homologous recombination (Chao et al., 2006). Transformation efficiencies ranged from 106 to 107 total transformants per library. After 48 h of growth in 250 ml SDCAA media, plasmids were miniprepped from a 1 ml aliquot of yeast culture (D2004, Zymoprep II yeast miniprep kit, Zymo Research) and transformed into electroporation competent XL1-blue bacterial cells (200228, Agilent Technologies). The plasmids were then isolated (QIAprep Spin Miniprep Kit, 27106, Qiagen), and 10–12 random clones were sequenced to assess mutation frequency. On average, 60% of the plasmids in the error-prone libraries contained amino acid mutations in the VH genes with an average mutational rate of ~1.5 residues per VH domain.

For the mutagenesis of the P3 VH domain, the existing gene was amplified from the 5′ end to the end of the CDR3 region with Taq polymerase. The 5′ forward amplification primer contained a 45 base pair overhang for subsequent homologous recombination. Reverse primers encoding two consecutive degenerate (NNK) codons were used to scan CDR3 from residues 100–100i, giving a total of nine unique PCR reactions. The products were then purified using agarose gel electrophoresis and mixed independently with a PCR-amplified fragment of the P3 gene encoding the sequence after residue 100i to include a 20 base pair overhang with the 5′ gene amplifications. These DNA fragments were then combined via a final Taq PCR step. After agarose gel purification, the genes were pooled and transformed as described above, giving a total of 106 transformants from homologous recombination. Analysis of 11 random sequences revealed that 91% contained mutant VH domains. All of the sequenced mutants had two consecutive mutations in CDR3, and 50% had an additional stray mutation outside of CDR3. Additionally, the single and double mutants derived from the D1 VH domain were generated via site-directed mutagenesis using PfuUltra II Fusion Polymerase (600850, Agilent Technologies).

Yeast surface display and library screening

Surface display experiments were performed using the EBY100 S.cerevisiae strain. Cells transformed with pCTCON2 plasmids encoding Aga2-VH fusions were grown overnight at 30°C with agitation in low pH SD-CAA medium (20 g/l dextrose, 6.7 g/l yeast nitrogen base, 5 g/l casamino acids, 14.7 g/l sodium citrate and 4.3 g/l citric acid) to an OD600 of 1–2. Yeast display of Aga2-VH fusions was induced by switching to SG-CAA media (20 g/l galactose, 6.7 g/l yeast nitrogen base, 5 g/l casamino acids, 8.56 g/l NaH2PO4·H2O and 5.4 g/l Na2HPO4·2H2O), and incubated overnight at 30°C with agitation. Both the SD-CAA and SG-CAA were supplemented with 100 µg/ml of ampicillin and kanamycin as well as a 1× dilution of penicillin–streptomycin solution.

For FACS and flow cytometry analysis, 107 cells were pelleted and washed twice with 1 ml of PBS-B (PBS with 1 mg/ml BSA) or PBS-BX (PBS with 10 mg/ml BSA and 1% (v/v) Triton X-100). Washed cells were then labeled with biotinylated antigen and anti-myc IgY antibody (1:200 dilution; A-21280, Life Technologies) for 1–5 h at 25°C. For simultaneous antigen and stability evolution, biotinylated antigen was mixed with 1 µM Protein A (77673, Fisher Scientific) conjugated with AlexaFluor488 (A-20000, Life Technologies) in place of the myc antibody. Cells were pelleted and washed with 1 ml of PBS-B or PBS-BX before labeling with a 1:100 dilution of secondary reagents [AlexaFluor488 conjugated goat anti-chicken IgG, (A-11039, Life Technologies); AlexaFluor647 (A-20006, Life Technologies), conjugated Streptavidin (S-32357, Life Technologies) or NeutrAvidin (PI-31000, Fisher Scientific)] in a 0.2 ml volume for 5 min. Labeled cells were washed again in 1 ml of PBS-B or PBS-BX before being analyzed on a BD LSRII flow cytometer or being sorted on a BD FACSAria. For both flow cytometry and FACS studies, instruments were compensated to reject cross-signal from the AlexaFluor488 and AlexaFluor647 dyes, and 100 000 events were recorded for analysis.

For library screening, the VH D series were obtained via FACS sorting using biotinylated Aβ42 peptide (62-0-15B, American Peptide Company) and the myc antibody. Lower Aβ42 concentrations were used after each successive round of mutagenesis. Details regarding the number of sorts, the number of yeast cells sorted and isolated, Aβ42 concentrations and buffer conditions are summarized in Supplementary Table SI. The VH P series domains were sorted with the same binding procedure except for the replacement of the myc antibody with Protein A (conjugated to AlexaFluor488). However, the myc antibody was used in the initial rounds of the P3 CDR3 library selections to ensure enrichment of full-length VH domains. Yeast cells that were sorted in PBS-BX required one additional day to regrow relative to cells not exposed to 1% (v/v) Triton X-100. Details of the sorting procedure, including the use of myc antibody versus Protein A, are summarized in Supplementary Table SII.

After library enrichment via FACS, VH plasmids were isolated from yeast (D2004, Zymoprep II yeast miniprep kit, Zymo Research) and transformed into electroporation competent XL1-blue bacterial cells (200228, Agilent Technologies). Approximately 10–12 random colonies were miniprepped from bacteria (27106, Qiagen) and sequenced. All unique VH variants obtained from the library were retransformed into yeast (EBY100) and analyzed via flow cytometry for Aβ42 and Protein A binding. Those giving the highest binding signals were selected for subsequent mutagenesis and screening. Nonspecific binding on the surface of yeast was evaluated using biotinylated islet amyloid polypeptide (IAPP; AS-64451-05, Anaspec).

The binding affinity of the P4 variant to Aβ42 was analyzed on the surface of yeast using flow cytometry. Biotinylated Aβ42 was varied from 10 000 to 6 nM in PBS-BX buffer and mixed with 106 yeast cells displaying the P4 variant in 0.2 ml volumes. The cell mixtures were left to equilibrate for 3 h at 25°C, and subsequently labeled with secondary reagents (as described above) before evaluation by flow cytometry. Antigen binding was quantified from the total AlexaFluor647 fluorescence measured on the Allophycocyanin (APC) channel. The mean APC value was fit to a single-site binding model where APC = APCMin + APCSat[Aβ42]/(KD + [Aβ42]) + APCNS[Aβ42]. APCMin is the minimum APC value, APCSat is the APC saturation value, APCNS is the APC signal for the nonspecific binding of Aβ42 to the yeast cell surface, KD is the dissociation equilibrium constant and [Aβ42] is the Aβ42 concentration. Fitting was performed using the solver tool in Excel by minimizing the mean squared error between the data and the model. Final model values were obtained by averaging fits from three independent experiments.

Bacterial expression and purification

VH genes from isolated yeast plasmids were excised via digestion with NheI and SalI, and purified using agarose gels. The genes were then ligated into a pET-17b bacterial expression vector containing the NheI and SalI cloning sites flanked by an N-terminal PelB leader sequence for periplasmic expression and C-terminal peptide tags (3× FLAG tag for detection and heptahistidine tag for purification). Bacterial expression was performed using BL21(DE3) pLysS cells (200132, Agilent Technologies) for 48 h at 30°C in autoinduction media (200 ml) supplemented with ampicillin (100 μg/ml) and chloramphenicol (35 μg/ml) (Studier, 2005). The VH domains in the supernatant were purified via centrifugation of the bacterial cells and overnight incubation of the supernatant with 2.5 ml of Ni-NTA beads (30230, Qiagen) at 4°C with mild agitation. The beads were then collected and washed with PBS before elution at pH 3 (PBS). After neutralization to pH 7.4, the samples were centrifuged (21 000 × g for 5 min) and passed through a 0.2 µm filter (SLGV013SL, Millipore) to remove aggregates. Protein concentrations were obtained via absorbance measurements at 280 nm, and the purity was evaluated via SDS–PAGE under reducing conditions (NuPAGE Novex Midi Gel, 25-0866, Life Technologies).

Circular dichroism

Both circular dichroism (CD) spectra and thermal unfolding curves were measured using a Jasco 815 spectrophotometer. Far-UV CD spectra were collected using VH domains (0.2 mg/ml) diluted in water from stock solutions at 0.7–4 mg/ml (originally in PBS). Data points were collected every 0.5 nm with a scanning speed of 50 nm/min, and the resulting spectra were an average of 10 accumulations. Thermal unfolding was performed by monitoring the CD signal at 235 nm for VH domains (0.1 mg/ml) over a temperature range of 25–95°C (1.5°C/min). The folded and unfolded states were fit to a linear model, and the fraction of folded protein in the transition region was calculated from (ΘT – ΘU)/(ΘF – ΘU), where ΘT is the ellipticity at a given temperature, and ΘF and ΘU refer to the ellipticity at that temperature for the fully folded and unfolded states, respectively (Greenfield, 2006). After one cycle of heating, the solution was left to cool at room temperature (~20 min) and the thermal scan was repeated to evaluate reversibility.

Antibody binding analysis

The binding activity of the VH domains was evaluated using a solution binding assay with immobilized NeutrAvidin for detection. NeutrAvidin (PI-31000, Fisher Scientific) was immobilized overnight at 4°C in Nunc Maxisorp 96-well plates (442404, Fisher Scientific) at 5 µM in PBS. The wells were then blocked for 8 h at 4°C with a 10% (w/v) solution of BSA in PBS. Separately, VH domains were mixed with biotinylated antigen in a PBS solution containing 50 mg/ml BSA and 0.1% (v/v) Triton X-100. Nonspecific binding was evaluated using biotinylated IAPP. The final VH concentration was ~300 nM and the antigen concentration was varied from 0 to 1000 nM. Background solutions consisted of VH only (without antigen). These solutions were incubated for 2 h at room temperature. After washing the blocked wells five times with 300 μl of PBS, 100 μl of the VH–antigen mixtures (as well as the VH control solutions) were added. The samples were allowed to bind to the immobilized NeutrAvidin overnight at room temperature. Bound VH domains were detected via their C-terminal FLAG tags with mouse anti-FLAG M2 IgG (F1804, Sigma Aldrich) and horseradish peroxidase-conjugated goat anti-mouse IgG (32430, Fisher Scientific). Peroxidase activity was quantified using absorbance values at 450 nm after 1 h of incubation with 1-Step Ultra TMB-ELISA (34028, Fisher Scientific) and subsequent quenching with 2 M H2SO4. Binding signals were evaluated by subtracting the background value and were normalized by dividing by the background signal. The observed half-maximal concentration (IC50) value was obtained by fitting the background-normalized data to a three-parameter logistic equation in Excel using the solver tool.

Binding of VH domains to immobilized Aβ42 and Protein A was also evaluated. Aβ42 or Protein A was immobilized in Nunc Maxisorp well plates overnight at 2.5 µM (PBS) and room temperature. After blocking with 10% (w/v) milk in PBS for 8 h at 4°C, the wells were washed as described above. VH domains were then added at various concentrations in PBS solutions (either with 50 mg/ml BSA and 0.1% (v/v) Triton X-100 for Aβ binding or 1 mg/ml BSA for Protein A binding) and were left to bind overnight at room temperature. Background binding was evaluated for VH solutions at each concentration in antigen-free wells, and was subtracted from the signal for VH solutions in wells coated with antigen. Normalized values were obtained by dividing background-subtracted values by the background signal. The plates were developed with anti-FLAG and secondary antibodies, as described above.

Size-exclusion chromatography

Size-exclusion chromatography was performed for VH domains using a Waters 600 high-performance liquid chromatography system equipped with an analytical TSK Gel G3000SWXL column (0.78 × 30 cm, Tosoh Bioscience). Antibody solutions were prepared at 0.5 mg/ml in PBS, and the mobile phase consisted of PBS with 0.2 M arginine (adjusted to pH 7.4). Each sample was injected (20 μl) at a flow rate of 0.5 ml/min. Antibody elution was monitored via absorbance at 280 nm using a Waters 276 series UV absorbance detector.

Results

Evolution of grafted amyloid-motif VH domains using conventional yeast surface display leads to low stability and specificity

Toward our goal of evolving grafted VH domains with amyloidogenic self-recognition peptides in CDR3 for improved binding affinity, we first fused a VH domain [B1a (Barthelemy et al., 2008)] with Aβ residues 33–42 in CDR3 (herein referred to as wild type or WT; Fig. Fig.1)1) to the C-terminus of a yeast surface protein (Aga2). This fusion protein displayed well on the surface of yeast as judged by the presence of a myc tag at the C-terminus of the VH domain (Fig. (Fig.2A,2A, top panel). However, it possessed little binding to Aβ42 monomer at micromolar concentrations. Therefore, we performed random mutagenesis throughout the entire domain and selected variants with improved affinity for Aβ42 monomer. The best VH binder isolated after one round of mutagenesis and selection (D1) was subjected to a second round of mutagenesis and selection to isolate the most improved variant (D2).

An external file that holds a picture, illustration, etc.
Object name is gzv05001.jpg

Sequence of the Aβ33-42 VH antibody and structure of the parent VH domain. (A) Amino acid sequence of the VH domain (B1a) with Aβ residues 33–42 in CDR3. The CDRs are defined using Kabat numbering and underlined residues indicate the grafted CDR3 sequence. (B) Crystal structure of parent VH domain (PDB: 3B9V) in which the original CDR3 is highlighted (without the grafted Aβ peptide).

An external file that holds a picture, illustration, etc.
Object name is gzv05002.jpg

Flow cytometry analysis and secondary structure evaluation of WT and mutant versions of Aβ33-42 VH domains that were evolved using the conventional display (anti-myc) antibody. The WT VH domain was evolved for improved binding to biotinylated Aβ42 using four rounds of mutagenesis and selection to generate four variants (D1–D4). D1 is the first generation VH variant and D4 is the fourth generation variant. (A) Aβ (500 nM) binding and VH yeast display were evaluated using flow cytometry in PBS with 1% (v/v) Triton X-100 and 10 mg/ml BSA. The gated populations highlight the fraction of yeast cells displaying VH domains. (B) Comparison of binding of displayed VH domains to Aβ42 relative to a nonspecific hydrophobic peptide (IAPP) at 500 nM biotinylated peptide in PBS with 1% (v/v) Triton X-100 and 10 mg/ml BSA. The relative binding to each biotinylated peptide was normalized to VH display levels. (C) Level of VH display evaluated using an antibody that recognizes a myc tag at the C-terminus of the Aga2-VH fusion proteins. The error bars represent standard deviations for two independent experiments. (D) Evaluation of the secondary structure of autonomous (nonfusion) WT and mutant Aβ33-42 VH domains. The VH domains were expressed in bacteria and characterized using CD spectroscopy.

This process was repeated two additional times and it yielded four unique VH domains with increasing numbers of mutations. These variants (referred to as ‘D’ for display antibody) possessed 3 (D1), 6 (D2), 9 (D3) and 12 (D4) mutations (Supplementary Fig. S1), including one in the grafted amyloid segment in CDR3 (V100fM in D4, corresponding to V39M in Aβ42), one other in CDR3 (D100jG in D2 and later generations), one in CDR1 (D31G in D2 and later generations), and the rest in the framework regions. Notably, the single disulfide bond in the WT VH that is known to contribute to folding stability (Glockshuber et al., 1992) was eliminated in the second round of mutagenesis and selection (D2 and later generations) due to the acquisition of a cysteine knockout mutation (C22R; Supplementary Fig. S1). Interestingly, even when the mutagenesis was limited to the CDRs (which do not include either cysteine), we still observed strong enrichment of cysteine knockout mutations that occurred at low frequency due to errors in the PCR amplification (data not shown).

The loss of the intramolecular disulfide bond suggested that the evolved VH domains may be destabilized on the surface of yeast and bind nonspecifically to Aβ. To evaluate this possibility, we compared the binding of the WT and evolved VH domains to another hydrophobic amyloid-forming polypeptide (IAPP) relative to Aβ42 (Fig. (Fig.2B2B and Supplementary Fig. S2). While the evolved domains displayed good specificity for Aβ42 in the stringent screening solution (10 mg/ml BSA and 1% (v/v) Triton X-100 in PBS; Fig. Fig.2B),2B), this specificity was reduced when a less stringent solution was used (1 mg/ml BSA in PBS; Supplementary Fig. S2). Moreover, VH display levels were reduced more than 2-fold for the evolved mutants that carry the cysteine knockout mutation (D2, D3 and D4) relative to WT (Fig. (Fig.2C),2C), further suggesting that the evolved VH domains were destabilized on the surface of yeast.

To test whether our observations were due to the intrinsic properties of the evolved VH domains or specific to the Aga2-VH fusion proteins, we isolated the VH antibodies as autonomous domains to evaluate whether they were indeed destabilized. The VH variants expressed in bacteria at moderate levels (~10–50 mg/l) that were lower than WT (~80 mg/l). Moreover, the VH variants containing the cysteine knockout mutation (D2, D3 and D4) ran as multiple diffuse bands on an SDS–PAGE gel, while the WT and D1 VH domains ran as single bands (Supplementary Fig. S3). We observed similar behavior via size-exclusion chromatography, as the D4 variant displayed multiple peaks (some of which are likely degradation products), while the WT was largely monomeric (Supplementary Fig. S3). CD revealed significant differences in secondary structure between the WT and D1 domains relative to the more evolved ones with the cysteine knockout mutation (Fig. (Fig.2D).2D). The loss of β-sheet structure for the D2, D3 and D4 variants strongly suggested that they were largely unfolded. Even the D1 variant that displayed β-sheet structure similar to WT was significantly destabilized, as its melting temperature was reduced from 75°C for the WT to 57°C for the D1 variant (Supplementary Fig. S4). Moreover, we find that the largely unfolded VH variants (D2, D3 and D4) displayed significant nonspecific binding as autonomous domains and little binding to Aβ42 over background (Supplementary Fig. S5).

Protein A binding to VH domains on yeast is a strong predictor of stability and specificity off yeast

Our unsuccessful efforts in evolving VH domains for improved and specific Aβ binding led us to reevaluate our evolution approach. Previous studies have demonstrated that increased stability of antibody fragments and related proteins is correlated with increased yeast display of Aga2 fusion proteins (Shusta et al., 1999, 2000; Feldhaus and Siegel, 2004; Chao et al., 2006; Hackel et al., 2010). This observation is generally consistent with our findings that the most destabilized VH domains (D2, D3 and D4; Fig. Fig.2D)2D) corresponded to those with the lowest yeast display levels (Fig. (Fig.2C).2C). We also evaluated the relationship between display level and VH stability in more detail by generating all possible single and double VH mutants derived from the D1 triple mutant (Fig. (Fig.3A3A and Supplementary Fig. S6). The yeast display levels of these single and double mutants (as well as the WT and D1 domains) show some correlation with their stabilities as autonomous domains (R2 = 0.48). However, it is notable that the display levels changed by only ~1.6-fold for a relatively large change in stability (ΔTm of ~18°C; Fig. Fig.3A).3A). This modest change in display levels for a significant change in stability may explain our difficulty in using display levels to guide the selection of sets of mutations that improve antigen binding without destabilizing the antibody domains.

An external file that holds a picture, illustration, etc.
Object name is gzv05003.jpg

Comparison of the stability of autonomous Aβ33-42 VH domains with their binding to sequence- and conformation-specific probes on the surface of yeast. The melting temperatures of isolated VH domains were compared with (A) antibody binding to a myc tag at the C-terminus of the VH domains, and (B) Protein A binding to a conformational epitope on the framework of the VH domains. The flow cytometry measurements of anti-myc antibody and Protein A (50 nM) binding to displayed VH domains were performed in PBS with 1 mg/ml BSA. The Aβ33-42 VH variants are WT, the D1 mutant (D31G, E46K, Y91S), and single (D31G; E46K; Y91S) and double (D31G, E46K; D31G, Y91S; E46K, Y91S) mutants derived from the D1 variant. The melting temperatures of the VH domains were obtained using CD spectroscopy.

We reasoned that the use of alternative affinity reagents for detecting VH display that are more sensitive to antibody stability is necessary to improve the selection process. Therefore, we evaluated the use of a conformational ligand (Protein A) specific for a discontinuous epitope on the framework of folded VH3 domains (such as the Aβ33-42 VH) that is largely separated from the CDRs (Potter et al., 1996, 1997; Starovasnik et al., 1999; Graille et al., 2000). Previous studies have demonstrated that the relative Protein A binding to VH3 domains is correlated with folding stability (Bond et al., 2003; Chang et al., 2014). Indeed, we also observe a strong correlation between Protein A binding to Aβ33-42 VH mutants on the surface of yeast and their folding stability as autonomous domains (R2 = 0.92; Fig. Fig.3B).3B). Notably, the dynamic range for Protein A binding to displayed VH domains is more than an order of magnitude (12-fold change) for an ~18°C change in melting temperature for isolated VH domains. Moreover, the strongly destabilized VH antibodies that are largely unfolded as autonomous domains (D2, D3 and D4; Fig. Fig.2D)2D) show little binding to Protein A on the surface of yeast (Fig. (Fig.44).

An external file that holds a picture, illustration, etc.
Object name is gzv05004.jpg

Flow cytometry analysis of binding of a conformational ligand (Protein A) to WT and mutant Aβ33-42 VH domains on the surface of yeast. The mutant VH domains (defined in Supplementary Fig. S1) were isolated from yeast display libraries using the conventional display (anti-myc) antibody. The experiments were conducted using 50 nM Protein A in PBS with 10 mg/ml BSA and 1% (v/v) Triton X-100. The gated populations represent yeast cells displaying VH domains.

Use of Protein A for detecting VH display enables co-selection of stable domains with improved Aβ binding

These encouraging results led us to investigate whether we could incorporate Protein A into our selections for sets of mutations that improve antigen binding without destabilizing the VH domains. One conservative approach that we initially attempted was simply to use the conventional display antibody and Aβ to select for mutations that improve antigen binding in the initial library, and then the display antibody and Protein A to select for mutations that improve stability of the subsequent lead clone. However, this approach was not robust because selection with Protein A in the absence of Aβ resulted in significant enrichment in stabilizing mutations that reduced antigen-binding activity (and vice versa for selections with antigen only; data not shown). We were unable to optimize this methodology of alternating the type of selection (antigen or Protein A) to the point that we could reliably identify sets of mutations that improved affinity without reducing stability.

Therefore, we next asked whether Protein A could be used to replace the conventional display antibody to co-select for sets of mutations that improve Aβ binding without destabilizing the VH domains. We reasoned that the Protein A binding site on the framework of VH domains was separated enough from the CDRs such that Protein A and Aβ could bind simultaneously. Therefore, we performed four rounds of mutagenesis and selection—three rounds of random mutagenesis throughout the entire gene and one round focused on CDR3—to select four VH domains with progressively improved Aβ binding. These variants (referred to as ‘P’ for Protein A) possessed 4 (P1), 7 (P2), 9 (P3) and 12 mutations (P4; Supplementary Fig. S7). These mutations include four substitutions in the grafted Aβ peptide in CDR3 (G100dR in P1 and later generations, corresponding to G37R in Aβ42; I100hT in P3 and later generations, corresponding to I41T in Aβ42; V100fI and V100gI in P4, corresponding to V39I and V40I in Aβ42), one other in CDR3 (E98K in P4), three in CDR2 (Y52H and S62R in P2 and later generations; S50R in P3 and later generations) and the rest in the framework regions. Importantly, these mutations do not eliminate the disulfide bond in the WT Aβ33-42 VH domain, and we have not identified such cysteine knockout mutations for any VH variants co-evolved for Protein A and antigen binding (including variants not reported here).

We first evaluated the relative binding of the evolved VH domains to Aβ and Protein A (Figs (Figs55 and and6).6). Aβ binding progressively increased with each VH generation, while Protein A binding was similar or modestly reduced. The specificity of the evolved VH domains was evaluated using a nonspecific hydrophobic antigen (IAPP; Fig. Fig.6A).6A). As with the Aβ33-42 VH variants evolved using the conventional display antibody, we observe good specificity for Aβ42 binding relative to IAPP in the stringent screening solution (10 mg/ml BSA, 1% (v/v) Triton X-100, PBS). However, this strong specificity was also maintained in a less stringent solution (1 mg/ml BSA, PBS; Supplementary Fig. S8), unlike the variants evolved with the display antibody (Supplementary Fig. S2). The yeast display levels (evaluated using the conventional display antibody; Fig. Fig.6B)6B) and Protein A binding (Figs (Figs5B5B and and6C)6C) for the VH variants evolved using Protein A are higher than those evolved using the conventional display antibody, although the differences in display levels are modest.

An external file that holds a picture, illustration, etc.
Object name is gzv05005.jpg

Flow cytometry analysis of WT and mutant Aβ33-42 VH domains isolated from yeast libraries using co-selection with Protein A and Aβ42. Binding of the VH domains (defined in Supplementary Fig. S7) to (A) Aβ42 and (B) Protein A was evaluated on the surface of yeast. The experiments were conducted using 500 nM Aβ42 or 50 nM Protein A in PBS with 10 mg/ml BSA and 1% (v/v) Triton X-100. The gated populations represent yeast cells displaying VH domains. VH display was detected using an antibody that recognizes a myc tag at the C-terminus of the Aga2-VH fusion proteins.

An external file that holds a picture, illustration, etc.
Object name is gzv05006.jpg

Flow cytometry analysis of the WT Aβ33-42 VH domain and mutants thereof isolated from yeast libraries using either sequence-specific (anti-myc mAb) or conformation-specific (Protein A) probes. The WT VH domain was evolved for improved binding to biotinylated Aβ42 and Protein A using four rounds of mutagenesis and selection. P1 is the first generation VH variant and P4 is the fourth generation variant. (A) Aβ42 binding to WT and mutant Aβ33-42 VH domains evolved using Protein A relative to nonspecific binding to a hydrophobic control peptide (IAPP). (B) Conventional display (anti-myc) antibody binding to VH domains co-evolved using the anti-myc antibody (D series) or Protein A (P series). (C) Protein A binding to VH domains co-evolved using the anti-myc antibody (D series) or Protein A (P series). Aβ42, IAPP and Protein A binding were normalized to VH display levels. The flow cytometry analysis was conducted in PBS with 10 mg/ml BSA and 1% (v/v) Triton X-100 as well as 500 nM biotinylated antigen or 50 nM Protein A. Error bars represent standard deviations for two independent replicates.

We next evaluated the properties of the autonomous VH domains co-evolved using Protein A. The four variants expressed at modestly reduced levels in bacteria (~40–60 mg/l) relative to WT (~80 mg/l), and possessed similar size and homogeneity as judged by SDS–PAGE (Supplementary Fig. S9). Importantly, the P4 domain co-evolved with Protein A that binds best to Aβ possesses similar β-sheet secondary structure as WT (Fig. (Fig.7A).7A). Moreover, the P4 variant has only modestly reduced stability relative to WT (Tm of 66°C relative to 75°C for WT; Fig. Fig.7B),7B), it is largely monomeric as judged by size-exclusion chromatography (Fig. (Fig.7C),7C), and it binds similarly to immobilized Protein A as WT (Supplementary Fig. S10), despite that P4 contains 12 mutations.

An external file that holds a picture, illustration, etc.
Object name is gzv05007.jpg

Biophysical analysis of WT and mutant Aβ33-42 VH domains. The D4 VH domain is the fourth generation variant (12 mutations, defined in Supplementary Fig. S1) isolated using the conventional display (anti-myc) antibody, while the P4 domain is the fourth generation variant (12 mutations, defined in Supplementary Fig. S7) isolated using Protein A. (A and B) Characterization of VH domains using CD spectroscopy in terms of their (A) far-UV spectra and (B) thermal unfolding transitions monitored at 235 nm. (C) Evaluation of the homogeneity of VH domains using size-exclusion chromatography. In (B), the first and second thermal unfolding transitions are reported to evaluate reversibility. In (C), the chromatograms are shifted vertically for clarity.

The autonomous P4 VH domain also displays significant improvements in specific binding to Aβ42 (Fig. (Fig.8).8). The IC50 value for P4 binding to Aβ is 199 ± 12 nM, and it displays little nonspecific binding to IAPP. This improved Aβ binding was observed for antigen in solution (Fig. (Fig.8)8) and to a lesser extent for immobilized antigen (Supplementary Fig. S11). Interestingly, nonspecific binding to well plates blocked with milk was significantly lower for the P4 variant than for WT (Supplementary Fig. S12). The dissociation equilibrium constant (as judged by flow cytometry) for P4 binding to Aβ42 monomer was 167 ± 65 nM. Epitope mapping analysis revealed that the P4 domain—which we targeted to the C-terminus of Aβ via the self-recognition peptide in CDR3—retains binding specificity primarily for the C-terminus of Aβ42 (Supplementary Fig. S13).

An external file that holds a picture, illustration, etc.
Object name is gzv05008.jpg

Evaluation of binding of the WT and P4 variants of the Aβ33-42 VH domain to Aβ42 relative to a control hydrophobic peptide (IAPP). The binding analysis was performed in PBS with 50 mg/ml BSA and 0.1% (v/v) Triton X-100. The normalized binding signal was calculated by dividing background-subtracted signals by the background. Error bars represent standard deviations for two duplicate experiments.

Discussion

An unexpected finding of our work is the strong bias toward selection of destabilized VH domains that recognize Aβ using conventional yeast surface display. This seems contradictory to several previous studies demonstrating that evolution of antibody fragments and related proteins on the surface of yeast yields improvements in stability in addition to affinity (Shusta et al., 1999, 2000; Hackel et al., 2010). Indeed, the latter findings are logical because mutations that increase folding stability generally increase expression and reduce degradation (such as intracellular proteolysis in the endoplasmic reticulum) during transit to the surface of yeast (Kowalski et al., 1998; Kieke et al., 1999; Shusta et al., 1999; Coughlan et al., 2004). Thus, it is expected that selection for increased display and antigen binding should favor selection of stable antibody domains with improved binding affinity.

However, our antibody fragments possess several unusual attributes that may explain the lack of strong correlation between VH display and stability. One attribute that may be important is their high solubility, which is due in part to three negatively charged residues (DED) at each edge of the WT CDR3 loop. The WT Aβ33-42 VH fails to aggregate even when boiled (Perchiacca et al., 2012b). The extreme solubility of the unfolded state may reduce the sensitivity of VH display levels to destabilizing mutations given the lack of correlation between unfolding, aggregation and expression. Indeed, we find that strongly destabilized VH domains (D2, D3 and D4) express in bacteria at moderate levels (~10–50 mg/l) and fail to aggregate (as judged by visual inspection) when stored at 4°C for weeks (data not shown). Moreover, we observe reversible unfolding for both the WT and D1 variant (Supplementary Fig. S4) despite that the latter is much less stable (Tm of 57°C for D1 relative to 75°C for WT).

Another contributing factor to the poor correlation between yeast display levels and VH stability may be the small size of our domain antibodies. Indeed, other reports for some small, single-domain proteins also demonstrate reduced correlation between folding stability and yeast display levels (Park et al., 2006) or secretion levels as autonomous domains (Hagihara and Kim, 2002). This may be due to the simpler folding mechanisms of small, single-domain proteins that are less likely to be perturbed by destabilizing mutations. Nevertheless, the weak correlation between yeast display and stability has also been observed for some multidomain antibody fragments and related proteins (Esteban and Zhao, 2004; Kim et al., 2006; Traxlmayr et al., 2012; Xu et al., 2013), suggesting that the small size of our VH domains does not fully explain this behavior.

It is also likely that the properties of Aga2 influence the degree of correlation between yeast display levels of Aga2-VH fusion proteins and the stability of isolated VH domains. Importantly, Aga2 (~10 kDa) is similar in size as our VH domains (~15 kDa), and it is heavily glycosylated and expected to be highly soluble. Thus, it may be that display levels of fusion proteins are strongly influenced by the properties of Aga2 for fusion partners that are relatively small and soluble. Even the display levels of some Aga2-scFv fusions are weakly influenced by overexpression of proteins that improve scFv folding (such as protein disulfide isomerase) and which strongly enhance secretion of the isolated scFvs (Wentz and Shusta, 2007). This suggests that Aga2 can alter the secretory processing of its fusion partners and may reduce the ability of the secretory pathway to eliminate destabilized protein variants such as our unfolded VH domains.

Our use of a conformational probe (Protein A) for detecting VH display levels on the surface of yeast deserves further consideration. We find that it is relatively simple to select stabilizing mutations that improve Protein A binding to VH domains in the absence of co-selection for antigen binding, as others have demonstrated using phage display (Bond et al., 2003; Jespers et al., 2004a,b; Barthelemy et al., 2008; Famm et al., 2008; Dudgeon et al., 2012a,b). This is consistent with the expectation that stabilizing mutations may occur at positions throughout the VH domain and are common enough to be readily selected. We also find that it is relatively simple to identify destabilizing mutations that improve VH binding to antigen in the absence of Protein A. This is likely due to the increased stickiness of destabilized VH domains that mediates binding to hydrophobic antigens such as Aβ. In contrast, it was much more difficult to select sets of mutations that improve both Protein A and antigen binding, which is consistent with the expected rare occurrence of mutations (or sets of mutations) that improve specific antigen binding and which are not destabilizing. Thus, the use of Protein A during evolution of our VH domains acts as a folding filter that greatly reduces the rate of false positives during our selections for specific Aβ binding.

Protein A has some notable advantages over other conformational ligands used previously for detecting proper folding on the surface of yeast (Shusta et al., 2000; Weber et al., 2005; Jones et al., 2006; Aggen et al., 2011; Traxlmayr et al., 2012; Traxlmayr and Obinger, 2012). We find that the level of Protein A binding to displayed VH domains is directly correlated to the stability of autonomous VH domains, even for variants that appear well folded on the surface of yeast and which display reversible unfolding transitions as isolated domains (Fig. (Fig.3B3B and Supplementary Fig. S6). This excellent sensitivity to resolve stability differences between folded antibody fragments is in contrast to other studies demonstrating that many conformational ligands fail to provide such resolution for related proteins (Traxlmayr et al., 2012; Traxlmayr and Obinger, 2012). Instead, most previous studies have used heat stress to unfold variants that are destabilized and conformational ligands to select stable variants that do not unfold during heat stress or are able to properly refold after such stress (Shusta et al., 2000; Weber et al., 2005; Jones et al., 2006; Aggen et al., 2011). Some of these studies require high enough temperatures that strongly reduce yeast viability and require the use of PCR after each sorting step to recover genes encoding stabilized antibody fragments (Traxlmayr et al., 2012), which limits the robustness and throughput of this approach. An additional limitation is the need for conformational ligands that recognize regions on the framework (which do not overlap with the binding loops) for co-selection of mutations that improve both affinity and specificity, which is problematic in some cases.

Nevertheless, an advantage of using heat stress and selection of stable variants guided by conformational probes other than Protein A is that the former approach is not limited to specific subclasses of variable domains. For VH domains, Protein A is generally specific for the VH3 subclass (Potter et al., 1996, 1997; Starovasnik et al., 1999; Graille et al., 2000; Bond et al., 2003). This limits the utility of our approach for evolving antibody fragments with non-VH3 frameworks. Nevertheless, the significant improvements in selection of stable and specific antibody fragments afforded by conformational probes such as Protein A may warrant either transferring the Protein A binding site to other types of variable domains or generating new conformational ligands specific for folded variable domains. It is also notable that Protein L recognizes a conformational epitope on Vκ domains, including the Vκ I, III and IV subclasses (Nilson et al., 1992; Enokizono et al., 1997; Svensson et al., 2004), and key residues from this epitope have been grafted onto VL domains from other subclasses to confer Protein L binding activity (Muzard et al., 2009). Moreover, given that the stability of VH and VL domains is strongly influenced by the VHVL interface (Tan et al., 1998; Worn and Pluckthun, 1998; Jager and Pluckthun, 1999; Rothlisberger et al., 2005), it may be that evolving scFvs using even one conformational ligand (Protein A or Protein L) will be sufficient to stabilize both domains. If true, this would broaden the utility of our approach to evolving antibodies with VH3 and/or Vκ I, III and IV domains without the need for mutating the framework.

Our findings also raise questions about the robustness of using negative selections during the isolation of antibodies specific for hydrophobic antigens. We find that the reliability of our selections for VH domains with increased binding activity to Aβ was improved by including 1% (v/v) Triton X-100 (as well as 10 mg/ml BSA in PBS) in the binding and screening solutions. This stringent screening solution afforded reliable and consistent improvements in antigen binding per sort, likely by blocking weak nonspecific interactions. Indeed, we confirmed this by demonstrating that the stringent screening solution reduced binding to an extremely hydrophobic nonspecific peptide (IAPP) for destabilized VH domains (such as D4) relative to a less stringent screening solution (1 mg/ml BSA in PBS; Supplementary Fig. S2). However, the destabilized D4 variant (which is unfolded as an autonomous domain and is weakly recognized by Protein A on yeast) only showed ~25% (1 mg/ml BSA in PBS) and ~5% (1% (v/v) Triton X-100 and 10 mg/ml BSA in PBS) of the binding signal for the nonspecific antigen (IAPP) relative to Aβ at high concentration (500 nM). It is unclear if these modest nonspecific signals are strong enough to enable effective negative selections that eliminate destabilized VH domains. In contrast, we observed much larger (orders of magnitude) differences for Protein A binding to stable VH domains relative to destabilized ones, which provides a robust methodology for eliminating destabilized VH domains during selections for sets of mutations that improve specific antigen binding. We are currently evaluating the generality of our findings for designing and evolving a wide range of antibody fragments (including multidomain antibodies) that are specific for different hydrophobic antigens.

It is also important to understand the weaknesses of our findings. Our best evolved variant (P4) yielded maximum binding signals normalized to background of four to six in well plates, while conventional antibodies specific for Aβ yield maximum normalized signals at least 3-fold higher (data not shown). This may be due to the bivalency of IgGs and the resulting increased avidity as well as reduced nonspecific interactions relative to our VH domains, and highlights the need for further optimization of our grafted VH domains. It is also notable that the specificity of our autonomous VH domains was lower than the corresponding Aga2-VH fusions on the surface of yeast. For example, we observed significant binding specificity of the P4 variant to Aβ42 relative to IAPP on the surface of yeast (~130-fold higher Aβ binding) but this was reduced off yeast (~10-fold higher Aβ binding). This may be due to avidity effects on the surface of yeast and/or conformational differences between isolated VH domains and Aga2-VH fusion proteins. We also note that the parent VH domain (B1a; Fig. Fig.1B)1B) as well as related VH (including the WT and P4 variants) and unrelated VL domains bind to a nonspecific, highly positively charged protein (lysozyme) as autonomous domains, but fail to do so on the surface of yeast (data not shown). These findings highlight challenges in relating binding specificity of isolated antibody fragments to those fused to Aga2 on the surface of yeast. These observations combined with the preference for our evolved antibody domains (such as the P4 variant) to bind Aβ in solution (Fig. (Fig.8)8) relative to immobilized Aβ (Supplementary Fig. S11) suggest that they are not optimal for immunoblotting or western blotting applications. Finally, the apparent conformational specificity of our evolved P4 variant was dependent on the assay format, as we observed preferential binding of the P4 variant to monomers relative to fibrils for Aβ immobilized in well plates and the opposite specificity for Aβ blotted on nitrocellulose membranes (data not shown). These findings may be due to changes in antigen conformation and/or avidity when immobilized in different formats.

Finally, it is notable that we selected multiple mutations (2–4) per round of evolution using Protein A to obtain the P4 variant (12 mutations) with improved affinity and moderate stability. We speculate that the multiple rounds of evolution resulted in selection of some mutations that improved antigen binding but reduced stability (given our findings for VH domains evolved without Protein A co-selection) as well as other mutations that primarily contributed to stability. If correct, this process of accumulating different types of mutations that collectively result in improved affinity while maintaining thermodynamic stability in our directed evolution experiments may mimic the natural process of somatic hypermutation and B-cell clonal selection. Recent studies have demonstrated that multiple high-affinity antibodies accumulate somatic mutations with different functions, some of which contribute to affinity (and which are destabilizing) while others contribute primarily to stability (Sun et al., 2013; Wang et al., 2013). Analogous observations have also been made for enzymes (Wang et al., 2002; Chen et al., 2005) and other affinity proteins (Houlihan et al., 2015). We are currently evaluating whether our methodology for co-evolving VH stability and affinity leads to accumulation of mutations outside the antigen-binding site that contribute primarily to stability and which compensate for destabilizing mutations within the antigen-binding site.

Author contributions

M.C.J. and P.M.T. designed the research and wrote the paper. M.C.J., C.C.L., K.E.T., L.A.R., E.K.D. and A.J.S. performed the experiments.

Funding

This work was supported by the National Institutes of Health [R01GM104130 to P.M.T.], National Science Foundation [CBET 0954450; and 1159943 to P.M.T., Graduate Research Fellowships to M.C.J., K.E.T and L.A.R.], the Pew Charitable Trust [Pew Scholars Award in Biomedical Sciences to P.M.T.] and the Richard Baruch M.D. Chair (to P.M.T).

Conflict of interest: P.M.T. has received consulting fees and/or honorariums for presentations of this and/or related research findings at MedImmune, Eli Lilly, Bristol-Myers Squibb, Janssen, Merck, Genentech, Amgen, Pfizer, Adimab, Abbvie, Abbott, Roche, Boehringer Ingelheim, DuPont, Schrödinger and Novo Nordisk.

Supplementary Material

Supplementary Data:

Acknowledgements

We thank Dane Wittrup for providing the pCTCON2 yeast display vector and for helpful discussions, and Eric Shusta, David Colby, Jennifer Cochran, Eric Boder and Ben Hackel for helpful advice in performing yeast surface display. We also thank members of the Tessier lab for their helpful suggestions.

References


Articles from Protein Engineering, Design and Selection are provided here courtesy of Oxford University Press

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/4533622
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/4533622

Article citations


Go to all (28) article citations

Data 


Data behind the article

This data has been text mined from the article, or deposited into data resources.

Funding 


Funders who supported this work.

NIGMS NIH HHS (2)

National Institutes of Health (1)

National Science Foundation (2)

Pew Charitable Trust

    Richard Baruch M.D. Chair