Europe PMC
Nothing Special   »   [go: up one dir, main page]

Europe PMC requires Javascript to function effectively.

Either your web browser doesn't support Javascript or it is currently turned off. In the latter case, please turn on Javascript support in your web browser and reload this page.

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Understanding clinical genetic test results in the era of next-generation sequencing has become increasingly complex, necessitating clear and thorough guidelines for sequence variant interpretation. To meet this need the American College of Medical Genetics and Genomics (ACMG) and the Association for Molecular Pathology (AMP) published guidelines for a systematic approach for sequence variant interpretation in 2015. This framework is intended to be adaptable to any Mendelian condition, promoting transparency and consistency in variant interpretation, yet its comprehensive nature yields important challenges and caveats that end users must understand. In this review, we address some of these nuances and discuss the evolving efforts to refine and adapt this framework. We also consider the added complexity of distinguishing between variant-level interpretations and case-level conclusions, particularly in the context of the large gene panel approach to clinical diagnostics.

Free full text 


Logo of nihpaLink to Publisher's site
Genet Med. Author manuscript; available in PMC 2019 Aug 4.
Published in final edited form as:
PMCID: PMC6679919
NIHMSID: NIHMS1043424
PMID: 29988079

Navigating the nuances of clinical sequence variant interpretation in Mendelian disease

Abstract

Understanding clinical genetic test results in the era of next-generation sequencing has become increasingly complex, necessitating clear and thorough guidelines for sequence variant interpretation. To meet this need the American College of Medical Genetics and Genomics (ACMG) and the Association for Molecular Pathology (AMP) published guidelines for a systematic approach for sequence variant interpretation in 2015. This framework is intended to be adaptable to any Mendelian condition, promoting transparency and consistency in variant interpretation, yet its comprehensive nature yields important challenges and caveats that end users must understand. In this review, we address some of these nuances and discuss the evolving efforts to refine and adapt this framework. We also consider the added complexity of distinguishing between variant-level interpretations and case-level conclusions, particularly in the context of the large gene panel approach to clinical diagnostics.

Keywords: ACMG laboratory guideline, clinical genetic testing, clinical interpretation, variant classification, variant interpretation

INTRODUCTION

Utilizing genetic information for precision medicine requires thorough understanding of sequence variation and causality across all diseases. For complex multifactorial diseases, such as diabetes, many common genetic variants make small contributions to disease risk, in combination with multiple non-genetic factors.1 Multifactorial contributions to disease etiology are interrogated by statistical means (e.g. Genome-Wide Association Studies), but the clinical utility of this information is currently limited by its poor predictive power. In contrast, Mendelian or monogenic disorders are characterized by rare variants in a single gene with a high impact on disease risk.2 In general, assertion of variant pathogenicity for a Mendelian disorder implies causality, although this does not always correlate with disease manifestations in a given individual, due to incomplete penetrance and variable expressivity. While some disease mechanisms fall between these categories, arising from a combination of common variants of low effect and rare variants of greater effect, the binary approach (monogenic versus multifactorial) is currently the predominant organizing framework for disease causality.

In lieu of formal statistical approaches, significant efforts have been made to develop guidelines describing the evidence types needed to assess variants implicated in Mendelian diseases.35 In this review, we focus on the evidence types articulated by the clinical genetics community as providing support for or against pathogenicity of a variant with respect to a monogenic disorder, and the nuances inherent in combining the available evidence to arrive at a clinical interpretation. Accurate variant interpretations often warrant the expertise of a trained molecular geneticist.

OVERVIEW OF ACMG/AMP SEQUENCE VARIANT INTERPRETATION GUIDELINES

The American College of Medical Genetics and Genomics (ACMG), together with the Association for Molecular Pathology (AMP), established guidelines for reporting and interpreting sequence variation in an effort to standardize clinical evaluation of genomic information. The original 2000 guidelines established five categories of classifications but provided little guidance on evidence selection and weighting.3 Revision of these guidelines in 2007 incorporated a sixth category of variants: those associated with clinical symptoms, but that are unexpected or unknown to cause disease (e.g. risk variants).4 The 2007 version also recommended that clinical laboratories utilize standardized variant nomenclature and include testing limitations in reports. These initial iterations were qualitative and assigned variants to categories based on certain features (e.g. reported in the literature or observed in other affected individuals).

Variability in the interpretation of variants between laboratories, in the setting of massively increased data generation due to next-generation sequencing, necessitated more thorough guidance and ultimately led to the development of a more structured approach for variant interpretation in 2015.5 These updated guidelines establish a 5-tier classification system (pathogenic, likely pathogenic, uncertain significance, likely benign, or benign) and specify lines of evidence necessary for clinical interpretation. Critically, the guidelines include a relative measure of strength (stand-alone, very strong, strong, moderate, or supporting) for each piece of evidence for or against pathogenicity (Figure 1). Additionally, the 2015 guidelines present rules for combining evidence to make a given assertion, defaulting to variant of uncertain significance (VUS) when these rules are not met or conflicting evidence exists.

An external file that holds a picture, illustration, etc.
Object name is nihms-1043424-f0001.jpg
ACMG/AMP evidence codes for classifying sequence variants as organized in the text by data type and strength.

Evidence codes are divided into those that support a benign (B) or pathogenic (P) classification (first letter of code) and given a relative strength (second letter of code): VS, very strong; S, strong; M, moderate; and P, supporting. See Richards, et al. 2015 for complete description of codes. *Odds of pathogenicity corresponding to evidence strength, assuming a prior probability of 0.10 as would be anticipated for single-gene analysis (see Tavtigian, et al. 2017 for details). +BA1 is considered a “stand-alone” evidence type and was not included in the Bayesian model used to derive the odds of pathogenicity.

The comprehensive nature of these guidelines promotes flexibility and adaptability across most Mendelian conditions, but also creates a degree of ambiguity regarding their implementation. The structured format promotes data sharing efforts and aims to minimize inconsistencies in variant classification through transparency in the use of evidence, which allows comparison and conflict resolution.610 The National Institute of Health (NIH) funded endeavors, such as the Clinical Genome Resource (ClinGen)11 and ClinVar,12 are developing curation tools that incorporate the ACMG/AMP guidelines to assist in variant interpretation and data sharing. Below we discuss important challenges and caveats regarding the implementation of these guidelines both in general and with respect to specific criteria. We then address ongoing efforts to improve the guidelines and to provide disease-driven rule specifications.

NUANCES IN THE IMPLEMENTATION OF ACMG/AMP VARIANT INTERPRETATION CRITERIA

Application of the 2015 guidelines is intentionally restricted to inherited, Mendelian conditions with relatively high penetrance. The guidelines are not recommended to be used in pharmacogenomics or complex traits/conditions. Notably, caution should be exercised when applying these guidelines in the context of secondary findings, particularly for variants identified in asymptomatic or otherwise healthy individuals. Furthermore, these guidelines are intended for variants in genes with established disease causality, not for novel variants in “candidate” genes. The ClinGen Gene Curation Working Group has developed a framework that can be utilized to determine the strength of evidence supporting gene-disease associations.13

Population Data

Population-level minor allele frequency (MAF) data is critical since disease-causing alleles for most Mendelian disorders are expected to be rare, and five ACMG/AMP criteria (BA1, BS1, BS2, PM2, and PS4) utilize these data. It is important to consider disease prevalence, penetrance, and genetic (locus and allelic) heterogeneity when applying any of these criteria, although such information is often unknown or inaccurate due to ascertainment bias. A MAF >5% in any global population is considered a “stand alone” benign classification (BA1) for the vast majority of Mendelian disorders, with the exception of well-known founder alleles.5 The most frequently applied ACMG/AMP criteria across 99 variants assessed by 9 laboratories were PM2 (absent from control populations) and BS1 (MAF higher than expected for disorder).7

To date, ExAC14 and gnomAD are the largest and most ethnically comprehensive datasets of variant allele frequency. However, even these datasets do not represent all populations and it is important to consider population size and error in MAF estimates when assessing thresholds for BS1. Furthermore, inadequate population representation and lack of phenotypic details may cause difficulties in applying BS1 or BS2 (variant for highly penetrant condition seen in healthy individual) criteria. In addition, the data quality of any population allele frequency database should be evaluated for sufficient depth of coverage to ensure accurate MAF estimates. Furthermore, repetitive and low complexity regions of the genome (e.g. paralogous regions) are challenging to correctly sequence with standard technologies and variants in these regions should be interpreted cautiously given their inaccurate representation in these databases. A better understanding of monogenic disorders will allow specification of MAF thresholds for each gene-disease pair as available repositories grow and provide greater statistical power.1417

In more prevalent Mendelian conditions, odds ratios (OR) or relative risks can be calculated to assess whether a variant is likely to be associated with a phenotype. Variants with increased prevalence in an affected population compared to controls can be assigned PS4, if the calculated OR >5.0 and the confidence interval does not include 1.0.5 The population size used to calculate the OR should be considered when assessing the accuracy and reliability of the study. It may also be possible to calculate an OR using a public MAF repository, such as ExAC, however it is critical to understand the nuances described above when using such databases. Importantly, not all conditions are amenable to statistically compelling case-control studies, therefore the guidelines stipulate that the “prior observation of [very rare] variant[s] in multiple unrelated patients with the same phenotype, and its absence in controls, may be used as moderate level of evidence.”5

Allelic Evidence and Co-segregation

Due to the Mendelian patterns of inheritance seen in most monogenic disorders, evidence of segregation in family members (or lack thereof) can inform variant interpretation. The ACMG/AMP guidelines include a number of criteria (PS2, PM6, PP1, and BS4) that apply to segregation evidence. The de novo occurrence of a variant is considered strong evidence of pathogenicity (PS2) when: 1) maternity and paternity are confirmed, 2) the variant is in a gene associated with a condition consistent with the patient’s phenotype, and 3) there is no past family history of disease (i.e. unaffected parents). When the first criterion is not met, the evidence is considered moderate strength (PM6). The second and third criteria apply for both PS2 and PM6, because all humans are expected to have approximately 44–82 de novo single nucleotide variants (SNV) of which 1–2 are expected to be exonic.18 Additionally, improved sequencing techniques are facilitating better detection of mosaic or somatic variants,19 which if applied to the parents of patients with previously reported de novo mutations may reveal that these variant were in fact inherited from a mosaic parent.

When a condition is inherited in a dominant fashion, co-segregation in affected family members is used as supporting evidence in favor of pathogenicity (PP1), with the guidance that strength may be increased when appropriate. This approach promotes a conservative interpretation while allowing discretion and flexibility, but is subject to potential variability between labs with regard to upgrading the strength of segregation evidence. Since the variant under consideration may be in linkage disequilibrium with the “true” pathogenic variant, it is critical to assess the thoroughness of the linkage study. Both the methodology and extent of sequencing merit consideration, in addition to whether all variants within a linkage region have been evaluated for pathogenicity (e.g. a cryptic splice-altering variant deep within the intron). Furthermore, it is important to establish that all other common plausible molecular etiologies have also been ruled out. Conversely, lack of segregation (e.g. variant inherited from the unaffected parent) is considered strong evidence that a variant is benign (BS4). Accurate application of both segregation criteria hinges on thorough phenotypic evaluation of family members, which is not always possible. Phenotypic evaluation and subsequent segregation analysis can be further complicated by issues of penetrance, expressivity, age of onset and ascertainment bias, therefore, it is generally encouraged to interpret segregation data conservatively.

Aside from de novo occurrence and co-segregation analysis, family studies can also be used to determine phase of two or more heterozygous variants, which applies to three ACMG/AMP criteria (PM3, BP2, and BP5). If a variant occurs in a gene associated with an autosomal recessive condition and is in trans with a pathogenic variant, the PM3 criterion can be applied. However, the guidelines do not address the situation in which the second variant is likely pathogenic, or whether this criterion can be applied (with weaker strength) when phase has not been confirmed (e.g. the pathogenic variant was inherited, but inheritance of the second variant is unknown). If the variant occurs in a gene associated with an autosomal dominant condition and is in trans with a pathogenic variant, the BP2 criterion can be applied. BP2 also applies when the variant being evaluated is in cis with a pathogenic variant, regardless of inheritance pattern. As with PM3, it is unclear whether BP2 can be applied when the second variant is likely pathogenic. Caution should also be applied in using BP2 in situations where the true “pathogenic” allele might be a complex haplotype that includes more than one change from the reference sequence. For situations in which the variant being evaluated is observed together with another pathogenic variant in a different gene with a more compelling molecular basis for the individual’s phenotype, BP5 should be applied as evidence against pathogenicity. Further caution should be used when applying this criterion since it is possible for an individual’s composite phenotype to result from the rare combination of two different Mendelian disorders.

Computational and Predictive Criteria

A large number of the ACMG/AMP variant interpretation criteria (PVS1, PS1, PM4, PM5, PP3, BP1, BP3, BP4, and BP7) are categorized as predictive or computational evidence.5 These criteria relate to the type of variant in question and its predicted impact on the protein product based on knowledge about the protein’s function, structure, and evolutionary conservation. Notably, PP2 (missense variant in a gene in which missense changes are rare) and PM1 (mutational hotspot/functional domain), which are categorized as “functional data,” could also be regarded as “predictive” evidence (see Figure 1). Together, these 11 criteria provide a way to predict variant pathogenicity by extrapolating from what we know about the functional and clinical impact of similar variants, with respect to both variant type and location within a protein. By virtue of the predictive nature of this category, these criteria are most appropriately applied to variants in genes with well-understood molecular mechanism and functional domains.

An important consideration is whether the predicted impact of the variant in question is consistent with the known disease mechanism, such as gain of function (GOF) or loss of function (LOF). Understanding disease mechanism is critical for novel predicted truncating variants (nonsense, frameshift, or canonical splice site), which are classified as likely pathogenic when PVS1 (null variant where LOF is known disease mechanism) and PM2 (absent in population databases) are applied. Unfortunately, disease mechanism is often not well-established. Overly liberal use of PVS1 could result in a potentially erroneous assessment of pathogenicity and consequently have serious implications for patients and family members (e.g. in the context of secondary findings). Population data can be used to evaluate the prevalence of predicted truncating and missense mutations in an unselected population,14 approximating how well any given gene tolerates variation and suggesting possible disease mechanism. However, this approach primarily reflects constraint due to reproductive fitness and may not accurately indicate molecular mechanism for any given gene-disease association. Further detailed guidance and expert curation of molecular mechanism across all known Mendelian disease genes is therefore a high priority.

Another potential pitfall when applying the predictive criteria is that several criteria rely on the same basic reasoning to predict pathogenicity. Criteria PM1 (variant in mutational hotspot), PS1 (novel nucleotide change creates same amino acid change as known pathogenic variant), and PM5 (novel missense variant at residue with different pathogenic missense change) similarly argue that variants altering an important region of a protein are likely to be pathogenic and therefore application of either PM1+PS1 or PM1+PM5 could artificially bolster the evidence for pathogenicity. The same logic applies to the use of the in silico criteria (PP3 and BP4), since the algorithms used by many in silico pathogenicity predictors rely on protein sequence, structure, and conservation,20 much like many other criteria in the “predictive” category. The current ACMG/AMP guidelines do not restrict the use of certain criteria together, which may inadvertently result in double-counting evidence.

Specific caveats for the use of individual predictive criteria should also be considered. In an early attempt to compare the application of the ACMG/AMP guidelines by the Clinical Sequencing Exploratory Research (CSER) consortium, 8 of the 11 predictive criteria were applied inappropriately or inconsistently, and clarifications to the guidelines were suggested.7 For example, PVS1 (null variant where LOF is known disease mechanism) should not be applied to variants that may escape nonsense-mediated decay, such as premature truncating codons near the 3’ end of the protein21 or non-canonical splice variants. Similarly, PS1, PM1, and PM4 (protein-length-changing variant) are all criteria intended for use with specific types of variants; however, each of these criteria were inappropriately used by at least one laboratory due to vague descriptions in the guidelines.7

While in silico predictors have been heralded for the potential to apply high-throughput assessments independent of clinical data,22 laboratories disagree on how to implement these predictors,23 leading to discordant variant interpretations.8,24 The guidelines recommend use of multiple in silico predictors to mitigate the varying strengths and weaknesses of each program and further stipulate that each of the in silico predictions must agree with one another to count as supporting evidence.5 No further guidance is given as to how many and which in silico predictors are most appropriate to use for the consistent application of this criteria. This poses a problem given the varying performance characteristics of the algorithms depending on whether they are tuned for sensitivity to discover potentially damaging variants. Furthermore, the guidelines do not address how to handle “false concordance” arising when predictive tools arrive at a different interpretation from that supported by other available evidence.23

One approach to simplify this issue is to use meta-predictors that combine multiple tools into one prediction output. Many of the recently developed meta-predictors (e.g. REVEL, VEST3, MetaLR, MetaSVM) demonstrated superior performance in a recent comparison of 25 different algorithms for the prediction of 14,819 benign or pathogenic ClinVar variants.23 For example, REVEL (rare exome variant ensemble learner), which considers 13 existing tools to score missense pathogenicity probability from zero to one,25 has a high predictive performance for a variety of diseases, genes, and modes of inheritance23 and is incorporated in the ClinGen Variant Curation Interface (https://curation.clinicalgenome.org). No single threshold exists for BP3/PP3 satisfaction, and we expect that expert panels will define cut-offs based on gene-specific predictive performance.

Functional Criteria

Data from well-established functional assays showing a deleterious effect (PS3) or no effect (BS3) are considered strong evidence in the ACMG/AMP variant interpretation framework.5 As with in silico tools, functional assays are poised to tackle the reclassification of many rare missense VUSs, since they are not dependent on clinical data.22,26 However, lack of guidance on what constitutes a “well-established” assay has resulted in subjective application of these criteria, and inter-laboratory interpretation differences are not always resolved through data sharing.8 Often, assays are performed in research laboratories, which may not meet clinical laboratory standards. For sufficient predictive power, functional assays require extensive reproducibility and experimental rigor, including benchmarking against multiple variants with definitive clinical interpretations as determined by genetic or other evidence.2629 An exemplary validated assay is the homology-directed DNA damage repair (HR) assay, which demonstrated 100% sensitivity and specificity for pathogenicity determination.2830

A well-validated functional assay should also provide variant-level evidence of the effect on the gene or gene product to satisfy PS3 or BS3 criteria, whereas assays evaluating biochemical parameters may suggest a specific clinical diagnosis but not pinpoint a causative variant. For example, an in vitro assay of enzyme activity in whole blood from a patient demonstrating impaired enzyme activity implicates the gene encoding the non-functional enzyme, but does not isolate a specific variant’s effect and thus would not meet PS3 criteria. This information might be relevant to the PP4 criteria (patient’s phenotype is highly specific for a disease with a single genetic etiology) but caution is advised in applying this rule, as described below.

For clinical interpretation, a functional assay should also be relevant to disease mechanism and manifestation. Cell-based or cell-free in vitro assays and in vivo organismal studies such as zebrafish or mouse models can be used to probe variant effects, but should be closely related to the known etiology. Cell lines should be disease-relevant and carefully selected; a transformed cell line may not be ideal for isolating a variant’s tumorigenic effects.31 Negative results (equivalent to wild-type function) may support a benign classification, but should be contingent on how thoroughly the assay evaluates gene/protein function. For example, a protein-protein binding assay might evaluate part of a protein’s normal function, but may provide an incomplete assessment if catalytic activity is not evaluated. Multiple assays that comprehensively probe gene function are likely to better reflect clinical significance. Determining the most appropriate functional assay requires gene- and disease-specific knowledge, often beyond the expertise of variant reviewers.8 This underscores the importance of expert consensus on these issues and the adaptation of the ACMG/AMP guidelines for individual genes or diseases.

Other Criteria

The remaining criteria (PP4, PP5, and BP6) are not easily classified into the previously discussed categories, but warrant discussion given their potential for misuse. For conditions with a phenotype highly specific to a single gene, PP4 can be applied as supporting evidence of pathogenicity. The ACMG/AMP guidelines stipulate that in addition to a highly specific phenotype, the patient should have a family history consistent with the mode of inheritance, the testing should be highly sensitive, and the gene should have little benign variation. Nevertheless, PP4 was the most inconsistently applied criteria across the nine CSER laboratories evaluating the ACMG/AMP guidelines,7 likely due to the subjectivity in deciding the specificity of a phenotype.

The reputable source criteria (PP5 and BP6) have recently been recommended for removal from the guidelines due to their questionable utility, on the basis that review of the primary evidence is superior to expert opinion and application of this criteria is likely to double count evidence when the criteria used by the reputable source are unknown.32 The ACMG/AMP Interpretation of Sequence Variants Work Group has not yet recommended removal of these criteria,33 therefore laboratories must apply PP5 and BP6 at their own discretion.

Combining Rules

A critical feature of the 2015 guidelines is the set of rules for combining individual evidence codes to establish one of the five variant classification assertions (pathogenic, likely pathogenic, VUS, likely benign, or benign). This method allows transparency and promotes consistency amongst laboratories in applying the criteria and arriving at a classification. However, manual tabulation of evidence codes could increase the risk of errors, as evidenced by the early experience of nine CSER laboratories.7 In addition, judgement is required when evidence addressing a particular criterion exists (and can be cited) but is judged to not satisfy an expert’s threshold for utilizing that evidence in the assessment.

In the ACMG/AMP guidelines, a VUS can result from either insufficient evidence or due to conflicting benign/pathogenic evidence. However, determining what constitutes conflicting evidence is challenging. Although not explicitly stated, the ACMG/AMP guidelines imply that the strength of conflicting evidence should be relatively equivalent. The guidelines do not address how to proceed when the strength of conflicting evidence is unbalanced (i.e. weighted more heavily towards pathogenic or benign), and no approved method currently exists for resolving VUS classifications with conflicting evidence.

EFFORTS IN IMPROVING VARIANT INTERPRETATION GUIDELINES

While the 2017 ACMG/AMP sequence variant interpretation guidelines establish a foundation for uniform and transparent variant analysis, there is still room for improvement and refinement. The guidelines are expected to “evolve as technology and knowledge improve,” and many groups have published their experiences and their critiques and/or modifications to the guidelines.79,3439 Laboratories within the CSER consortium compared their implementation of the guidelines and identified several criteria that were inconsistently or inappropriately applied and put forth the following recommendations: 1) modify the BA1 stand-alone criteria to be disease-specific, 2) develop quantitative thresholds for segregation analysis, 3) determine which computational algorithms are best in practice, 4) better define “well-established” functional data and establish a database with such data, 5) create a resource for gene-disease mechanism, and 6) develop tools to automate computable aspects of the ACMG/AMP guidelines.7

The ClinGen Consortium has established processes by which Variant Curation Expert Panels can review and specify the interpretation rules for a gene or group of related genes. Important functions of these expert groups are to help define the molecular mechanism of disease and what functional assays qualify as “well-established.” Both the RASopathy and MYH7 expert panels have recently published disease-specific variant interpretation guidelines.38,39 Furthermore, the ClinGen Sequence Variant Interpretation (SVI) group was tasked with making general refinements to the ACMG/AMP guidelines and harmonizing gene-specific refinements proposed by Expert Panels. Recently, the SVI demonstrated that the combining rules defined in the ACMG/AMP guidelines have a Bayesian nature and are therefore amenable to objective quantification, including incorporation of conflicting evidence into a final probabilistic assessment (Figure 1).40 Finally, ClinGen has a Variant Curation Interface (https://curation.clinicalgenome.org/) and a pathogenicity calculator that automates tabulation of evidence codes.41

Use of population allele frequencies is a fundamental aspect of variant classification and therefore defining reasonable thresholds for BA1, BS1, and PM2 is critical. The recommended 5% MAF cutoff for BA1 is overly conservative for most rare conditions, but may be too liberal for disorders with known causative variants at high frequencies in some populations (e.g. Sickle Cell disease) or founder alleles. The ClinGen SVI has identified known exceptions to the BA1 rule (https://www.clinicalgenome.org/site/assets/files/6006/svi_ba1_ashg_10_11_2016_1.pdf). In addition to ClinGen’s disease-specific efforts, two groups have developed general thresholds for the maximum expected MAF for pathogenic variants in various hereditary disorders (referring to BS1).42,43 Using the ExAC dataset, Kobayashi and colleagues demonstrated that 97.3% of pathogenic variants in genes associated with a broad spectrum of disorders had MAF <0.01% and those with higher frequencies were well-characterized in the literature.43 These data suggest that MAF threshold of 0.01% may be an appropriate starting point for the BS1 criteria. Whiffin and colleagues developed a mathematical model that additionally accounts for inheritance pattern, prevalence, heterogeneity, and penetrance, thereby providing an even more stringent MAF threshold.42

Given the potential to quantify segregation data, these criteria (PP1 and BS4) would greatly benefit from a statistical approach to modulate strength based on the number of individuals examined. Because many clinical laboratories do not have genetic statisticians readily available, Jarvik and Browning proposed a simplified calculation to provide thresholds for different strengths of segregation evidence.44 This proposed method is less accurate than previously proposed methods,45,46 but allows for a close approximation without extensive statistical analysis. The ClinGen SVI is developing more granular rules regarding de novo variants and segregation evidence that would be required for supporting, moderate, or strong evidence of pathogenicity (https://www.clinicalgenome.org/site/assets/files/8490/recommendation_ps2_and_pm6_acmgamp_critiera_version_1_0.pdf).

As the sensitivity and specificity of in silico predictors continue to improve, future iterations of these guidelines could be optimized for a more quantitative strength assignment correlated with algorithm accuracy and odds of pathogenicity. While a complete discussion of performance assessments is beyond the scope of this review, the nuances of these considerations should be reviewed for algorithms on a gene-specific basis before broad application and before increasing the weight of computational evidence in the variant interpretation framework.8,23,40,47,48

BEYOND VARIANT INTERPRETATION: CHALLENGES IN CASE-LEVEL INTERPRETATION

One aspect of molecular diagnosis not heavily discussed in the ACMG/AMP guidelines or elsewhere, is the distinction between variant-level interpretations and overall case-level (or clinical) conclusions. Although each variant interpretation is critical to an overall case-level conclusion, it is only one necessary component in the final assessment of a case. Acknowledging this distinction, the guidelines explicitly state that “pathogenicity determination [of a variant] should be independent of interpreting the cause of disease in a given patient.”5 The latter necessitates thorough evaluation of the patient’s clinical and family history to assess whether a molecular result is consistent with the patient’s phenotype and the suspected pattern of inheritance. While there is one ACMG/AMP criterion that pertains to phenotypic correlation (PP4), this criteria is intended to be used when a unique phenotype is associated with a single gene (e.g. CFTR).

Beyond the aforementioned challenges associated with variant-level interpretation, case-level interpretation is further complicated by the added complexities of incomplete penetrance, variable expressivity, and phenotypic correlation (including biochemical manifestations).49,50 Variant penetrance and expressivity data is often limited, even for well-established pathogenic variants, and much of the available data is likely to be influenced by ascertainment bias of specific disease manifestations.51 The lack of accurate penetrance and expressivity data is compounded by the difficulty of phenotypic evaluation in the proband and relatives, a subjective process impacted by evolution of symptoms over time. Furthermore, molecular tests can uncover results only partially consistent with the patient’s phenotype and potentially suggestive of an “expanded phenotype”5255 or may identify multiple plausible variants, indicating the possible coexistence of two (or more) conditions leading to a “blended phenotype,” rather than a single disease entity.5661

Navigating the nuances of variant-level and case-level interpretation is becoming more challenging as our ability to acquire sequence information far exceeds our current interpretative capacity. Molecular diagnostic laboratories and clinicians must accurately and meaningfully communicate uncertain results to their patients. While the ACMG/AMP variant interpretation guidelines facilitate a systematic characterization of variant level uncertainty, they do not provide a structured approach for classifying case-level uncertainty. Variability in how laboratories classify their case-level results is illustrated by the range of diagnostic yields from exome analysis across laboratories.62 A standardized classification system to differentiate definitive and inconclusive case-level results might improve comprehension of results and would facilitate better comparison/meta-analysis of published genomic studies, yielding a true assessment of genomic sequencing diagnostic yield. Our experience with whole exome sequencing in a diverse population led us to propose the case-level classifications outlined in Table 1, where uncertainty can arise from three categories: variant pathogenicity, variant zygosity (e.g. heterozygous variant for AD condition) and phenotypic concordance.63,64

Table 1

Proposed case-level classification with respect to uncertainty

Case-Level ClassificationClassification CriteriaExplanation of Uncertainty
Variant ClassExpected ZygosityPhenotypic Concordance
PositiveDefinitiveKPYesYesNo uncertainty
ProbableLPYesYesUncertainty at variant level
UncertainVariantVUSYesYesUncertainty only due to variant interpretation
HeterozygosityLP/KPNoYesSingle variant in gene associated with recessive condition matching patient’s phenotype
ContributionLP/KPYesPartialResult may contribute to part of phenotypic presentation but cannot fully explain condition
PhaseLP/KPNot knownYesTwo variants in gene associated with recessive condition matching patient’s phenotype but with unknown allelic phase
MultipleVUS/LP/KPMaybePartialMultiple levels of uncertainty (combinations of above)
NegativeKB/LB/VUSMaybeMaybeBenign variant(s) or VUS unrelated to patient’s phenotype
Secondary FindingsOnly LP/KPYesNoVariant(s) with established pathogenicity and the correct allelic requirement for a condition that has no relationship to the patient’s presenting phenotype

Abbreviations: KB – Known Benign, KP – Known Pathogenic, LB – Likely Benign, LP – Likely Pathogenic, VUS – Variant of Uncertain Significance

Previously, when single-gene testing dominated the molecular diagnostic arena, the onus was on the clinician to prepare a differential diagnosis, order the appropriate tests, and ultimately interpret the case-level result. As clinicians routinely opt for larger gene panels or even genome-scale diagnostic tests, laboratories will increasingly need to incorporate phenotypic information during variant prioritization. This is particularly important for untargeted genome-scale sequencing, which will uncover many variants unrelated to the diagnostic indication for testing. To fully harness the potential of genome-scale sequencing, clinicians and clinical laboratories must be intentional in establishing collaborative efforts relying on one another’s expertise.51,62,65 This may include developing practical clinical history forms to collect standardized phenotypic terms for use in prioritizing variants, such as those utilized by recent variant prioritization software programs (e.g. OMIM Explorer, Phevor, PHIVE, etc.).66,67 Likewise, clinical laboratories should make every effort to explicitly state their return of results policies and when requested, provide a list of rare variants not meeting the laboratory’s threshold for return.

Finally, with the constant discovery of new gene-disease and variant-disease associations,68 variant interpretations (particularly VUSs) are expected to change over time. Reanalysis of genome-scale data can identify a potential diagnosis in 10–36% of previously unsolved cases.61,6871 Reanalyzing variants reported in association with hereditary cancer led to re-classification in 3.6% of 1,103 cases (predominantly classification downgrades).72 These data emphasize the need for clinical laboratories to re-evaluate variant data periodically; however, there are no clear guidelines as to how and when this should happen.73 While reanalysis can potentially impact patient care, it can be onerous, and the ACMG/AMP guidelines recommend that laboratories develop clear policies for variant reanalysis indicating whether a clinician must initiate reanalysis and if there will be an additional charge.5

CONCLUSION

While the genomic sequencing era has facilitated more efficient identification of potentially disease-causing genomic variants, it has highlighted the need for a systematic, quantitative approach for variant classification to ensure reliable, reproducible results/interpretations for patients. Further refinement of the evidence necessary for variant classification will lead to increasingly quantitative assessments of variant pathogenicity. Widely anticipated implementation of genomic sequencing in an increasingly predictive context will demand thoughtful integration of genomic variant pathogenicity assertions, with consideration of a probabilistic assessment of the likelihood of developing any given condition. Furthermore, increasing complexity in our understanding of genetic contributions to disease (genetic modifiers, oligogenic disorders, etc.) will require laboratorians and clinical practitioners to continually evolve and incorporate new methods for interpreting disease etiology.

Funding:

NHGRI U01 HG006487, U01 HG007437, U41 HG009650

REFERENCES

1. Manolio TA, Brooks LD, Collins FS. A HapMap harvest of insights into the genetics of common disease. J Clin Invest. 2008;118(5):1590–1605. 10.1172/JCI34772. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
2. Manolio TA, Collins FS, Cox NJ, et al. Finding the missing heritability of complex diseases. Nature. 2009;461(7265):747–753. 10.1038/nature08494. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
3. Kazazian HH, Boehm CD, Seltzer WK. ACMG recommendations for standards for interpretation of sequence variations. Genet Med. 2000;2(5):302–303. 10.1097/00125817-200009000-00009. [CrossRef] [Google Scholar]
4. Richards CS, Bale S, Bellissimo DB, et al. ACMG recommendations for standards for interpretation and reporting of sequence variations: Revisions 2007. Genet Med. 2008;10(4):294–300. 10.1097/GIM.0b013e31816b5cae. [Abstract] [CrossRef] [Google Scholar]
5. Richards S, Aziz N, Bale S, et al. Standards and guidelines for the interpretation of sequence variants: a joint consensus recommendation of the American College of Medical Genetics and Genomics and the Association for Molecular Pathology. Genet Med. 2015;17(5):405–423. 10.1038/gim.2015.30. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
6. Pepin MG, Murray ML, Bailey S, Leistritz-Kessler D, Schwarze U, Byers PH. The challenge of comprehensive and consistent sequence variant interpretation between clinical laboratories. Genet Med. 2016;18(1):20–24. 10.1038/gim.2015.31. [Abstract] [CrossRef] [Google Scholar]
7. Amendola LM, Jarvik GP, Leo MC, et al. Performance of ACMG-AMP Variant-Interpretation Guidelines among Nine Laboratories in the Clinical Sequencing Exploratory Research Consortium. Am J Hum Genet. 2016;98(6):1067–1076. 10.1016/j.ajhg.2016.03.024. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
8. Harrison SM, Dolinsky JS, Knight Johnson AE, et al. Clinical laboratories collaborate to resolve differences in variant interpretations submitted to ClinVar. Genet Med. 2017;19(10):1096–1104. 10.1038/gim.2017.14. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
9. Lincoln SE, Yang S, Cline MS, et al. Consistency of BRCA1 and BRCA2 Variant Classifications Among Clinical Diagnostic Laboratories. JCO Precis Oncol. 2017;1(1):1–10. 10.1200/PO.16.00020. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
10. Yang S, Lincoln SE, Kobayashi Y, Nykamp K, Nussbaum RL, Topper S. Sources of discordance among germ-line variant classifications in ClinVar. Genet Med. 2017;19(10):1118–1126. 10.1038/gim.2017.60. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
11. Rehm HL, Berg JS, Brooks LD, et al. ClinGen--the Clinical Genome Resource. N Engl J Med. 2015;372(23):2235–2242. 10.1056/NEJMsr1406261. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
12. Landrum MJ, Lee JM, Benson M, et al. ClinVar: public archive of interpretations of clinically relevant variants. Nucleic Acids Res. 2016;44(D1):D862–D868. 10.1093/nar/gkv1222. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
13. Strande NT, Riggs ER, Buchanan AH, et al. Evaluating the Clinical Validity of Gene-Disease Associations: An Evidence-Based Framework Developed by the Clinical Genome Resource. Am J Hum Genet. 2017;100(6):895–906. 10.1016/j.ajhg.2017.04.015. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
14. Lek M, Karczewski KJ, Minikel EV, et al. Analysis of protein-coding genetic variation in 60,706 humans. Nature. 2016;536(7616):285–291. 10.1038/nature19057. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
15. 1000 Genomes Project Consortium, Auton A, Brooks LD, et al. A global reference for human genetic variation. Nature. 2015;526(7571):68–74. 10.1038/nature15393. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
16. Sudmant PH, Rausch T, Gardner EJ, et al. An integrated map of structural variation in 2,504 human genomes. Nature. 2015;526(7571):75–81. 10.1038/nature15394. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
17. Tennessen JA, Bigham AW, O’Connor TD, et al. Evolution and functional impact of rare coding variation from deep sequencing of human exomes. Science. 2012;337(6090):64–69. 10.1126/science.1219240. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
18. Acuna-Hidalgo R, Veltman JA, Hoischen A. New insights into the generation and role of de novo mutations in health and disease. Genome Biol. 2016;17(1):241. 10.1186/s13059-016-1110-1. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
19. Pagnamenta AT, Lise S, Harrison V, et al. Exome sequencing can detect pathogenic mosaic mutations present at low allele frequencies. J Hum Genet. 2012;57(1):70–72. 10.1038/jhg.2011.128. [Abstract] [CrossRef] [Google Scholar]
20. Masica DL, Karchin R. Towards Increasing the Clinical Relevance of In Silico Methods to Predict Pathogenic Missense Variants. Nussinov R, ed. PLoS Comput Biol. 2016;12(5):e1004725. 10.1371/journal.pcbi.1004725. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
21. Popp MW-L, Maquat LE. Organizing Principles of Mammalian Nonsense-Mediated mRNA Decay. Annu Rev Genet. 2013;47(1):139–165. 10.1146/annurev-genet-111212-133424. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
22. Starita LM, Ahituv N, Dunham MJ, et al. Variant Interpretation: Functional Assays to the Rescue. Am J Hum Genet. 2017;101(3):315–325. 10.1016/j.ajhg.2017.07.014. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
23. Ghosh R, Oak N, Plon SE. Evaluation of in silico algorithms for use with ACMG/AMP clinical variant interpretation guidelines. Genome Biol. 2017;18(1):225. 10.1186/s13059-017-1353-5. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
24. Grimm DG, Azencott CA, Aicheler F, et al. The evaluation of tools used to predict the impact of missense variants is hindered by two types of circularity. Hum Mutat. 2015;36(5):513–523. 10.1002/humu.22768. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
25. Ioannidis NM, Rothstein JH, Pejaver V, et al. REVEL: An Ensemble Method for Predicting the Pathogenicity of Rare Missense Variants. Am J Hum Genet. 2016;99(4):877–885. 10.1016/j.ajhg.2016.08.016. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
26. Millot GA, Carvalho MA, Caputo SM, et al. A guide for functional analysis of BRCA1 variants of uncertain significance. Hum Mutat. 2012;33(11):1526–1537. 10.1002/humu.22150. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
27. Burd EM. Validation of laboratory-developed molecular assays for infectious diseases. Clin Microbiol Rev. 2010;23(3):550–576. 10.1128/CMR.00074-09. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
28. Guidugli L, Pankratz VS, Singh N, et al. A Classification Model for BRCA2 DNA Binding Domain Missense Variants Based on Homology-Directed Repair Activity. Cancer Res. 2013;73(1):265–275. 10.1158/0008-5472.CAN-12-2081. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
29. Pesaran T, Karam R, Huether R, et al. Beyond DNA: An Integrated and Functional Approach for Classifying Germline Variants in Breast Cancer Genes. Int J Breast Cancer. 2016;2016:1–10. 10.1155/2016/2469523. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
30. Guidugli L, Carreira A, Caputo SM, et al. Functional assays for analysis of variants of uncertain significance in BRCA2. Hum Mutat. 2014;35(2):151–164. 10.1002/humu.22478. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
31. Toland AE, Andreassen PR. DNA repair-related functional assays for the classification of BRCA1 and BRCA2 variants: A critical review and needs assessment. J Med Genet. 2017;54(11):721–731. 10.1136/jmedgenet-2017-104707. [Abstract] [CrossRef] [Google Scholar]
32. Biesecker LG, Harrison SM. The ACMG/AMP reputable source criteria for the interpretation of sequence variants. Genet Med. March 2018. 10.1038/gim.2018.42. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
33. Richards CS, Aziz N, Bale S, et al. Response to Biesecker and Harrison. Genet Med. March 2018. 10.1038/gim.2018.43. [Abstract] [CrossRef] [Google Scholar]
34. Paludan-Müller C, Ahlberg G, Ghouse J, et al. Integration of 60,000 exomes and ACMG guidelines question the role of Catecholaminergic Polymorphic Ventricular Tachycardia-associated variants. Clin Genet. 2017;91(1):63–72. 10.1111/cge.12847. [Abstract] [CrossRef] [Google Scholar]
35. Maxwell KN, Hart SN, Vijai J, et al. Evaluation of ACMG-Guideline-Based Variant Classification of Cancer Susceptibility and Non-Cancer-Associated Genes in Families Affected by Breast Cancer. Am J Hum Genet. 2016;98(5):801–817. 10.1016/j.ajhg.2016.02.024. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
36. Chen S, Hu X, Shen Y. Sequence variant interpretation 2.0: Perspective on new guidelines for sequence variant classification. Clin Chem. 2015;61(11):1317–1319. 10.1373/clinchem.2015.240812. [Abstract] [CrossRef] [Google Scholar]
37. Karbassi I, Maston GA, Love A, et al. A Standardized DNA Variant Scoring System for Pathogenicity Assessments in Mendelian Disorders. Hum Mutat. 2016;37(1):127–134. 10.1002/humu.22918. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
38. Kelly MA, Caleshu C, Morales A, et al. Adaptation and validation of the ACMG/AMP variant classification framework for MYH7-associated inherited cardiomyopathies: recommendations by ClinGen’s Inherited Cardiomyopathy Expert Panel. Genet Med. 2018;20(3):351–359. 10.1038/gim.2017.218. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
39. Gelb BD, Cavé H, Dillon MW, et al. ClinGen’s RASopathy Expert Panel consensus methods for variant interpretation. Genet Med. March 2018. 10.1038/gim.2018.3. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
40. Tavtigian SV, Greenblatt MS, Harrison SM, et al. Modeling the ACMG/AMP variant classification guidelines as a Bayesian classification framework. Genet Med. January 2018. 10.1038/gim.2017.210. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
41. Patel RY, Shah N, Jackson AR, et al. ClinGen Pathogenicity Calculator: a configurable system for assessing pathogenicity of genetic variants. Genome Med. 2017;9(1):3. 10.1186/s13073-016-0391-z. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
42. Whiffin N, Minikel E, Walsh R, et al. Using high-resolution variant frequencies to empower clinical genome interpretation. Genet Med. 2017;19(10):1151–1158. 10.1038/gim.2017.26. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
43. Kobayashi Y, Yang S, Nykamp K, Garcia J, Lincoln SE, Topper SE. Pathogenic variant burden in the ExAC database: an empirical approach to evaluating population data for clinical variant interpretation. Genome Med. 2017;9(1):13. 10.1186/s13073-017-0403-7. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
44. Jarvik GP, Browning BL. Consideration of Cosegregation in the Pathogenicity Classification of Genomic Variants. Am J Hum Genet. 2016;98(6):1077–1081. 10.1016/j.ajhg.2016.04.003. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
45. Thompson D, Easton DF, Goldgar DE. A Full-Likelihood Method for the Evaluation of Causality of Sequence Variants from Family Data. Am J Hum Genet. 2003;73(3):652–655. 10.1086/378100. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
46. Bayrak-Toydemir P, McDonald J, Mao R, et al. Likelihood ratios to assess genetic evidence for clinical significance of uncertain variants: Hereditary hemorrhagic telangiectasia as a model. Exp Mol Pathol. 2008;85(1):45–49. 10.1016/j.yexmp.2008.03.006. [Abstract] [CrossRef] [Google Scholar]
47. Leong IUS, Stuckey A, Lai D, Skinner JR, Love DR. Assessment of the predictive accuracy of five in silico prediction tools, alone or in combination, and two metaservers to classify long QT syndrome gene mutations. BMC Med Genet. 2015;16:34. 10.1186/s12881-015-0176-z. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
48. Mahmood K, Jung C, Philip G, et al. Variant effect prediction tools assessed using independent, functional assay-based datasets: implications for discovery and diagnostics. Hum Genomics. 2017;11(1):10. 10.1186/s40246-017-0104-8. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
49. Kammenga JE. The background puzzle: how identical mutations in the same gene lead to different disease symptoms. FEBS J. 2017;284(20):3362–3373. 10.1111/febs.14080. [Abstract] [CrossRef] [Google Scholar]
50. Schacherer J Beyond the simplicity of Mendelian inheritance. C R Biol. 2016;339(7–8):284–288. 10.1016/j.crvi.2016.04.006. [Abstract] [CrossRef] [Google Scholar]
51. Berg JS. Exploring the importance of case-level clinical information for variant interpretation. Genet Med. 2017;19(1):3–5. 10.1038/gim.2016.106. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
52. Dyment DA, Tétreault M, Beaulieu CL, et al. Whole-exome sequencing broadens the phenotypic spectrum of rare pediatric epilepsy: a retrospective study. Clin Genet. 2015;88(1):34–40. 10.1111/cge.12464. [Abstract] [CrossRef] [Google Scholar]
53. Bertola DR, Hsia G, Alvizi L, et al. Richieri-Costa-Pereira syndrome: Expanding its phenotypic and genotypic spectrum. Clin Genet. 2018;93(4):800–811. 10.1111/cge.13169. [Abstract] [CrossRef] [Google Scholar]
54. Tracewska-Siemiątkowska A, Haer-Wigman L, Bosch D, et al. An Expanded Multi-Organ Disease Phenotype Associated with Mutations in YARS. Genes (Basel). 2017;8(12):381. 10.3390/genes8120381. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
55. Orlova EM, Sozaeva LS, Kareva MA, et al. Expanding the Phenotypic and Genotypic Landscape of Autoimmune Polyendocrine Syndrome Type 1. J Clin Endocrinol Metab. 2017;102(9):3546–3556. 10.1210/jc.2017-00139. [Abstract] [CrossRef] [Google Scholar]
56. Theunissen TEJ, Sallevelt SCEH, Hellebrekers DMEI, et al. Rapid Resolution of Blended or Composite Multigenic Disease in Infants by Whole-Exome Sequencing. J Pediatr. 2017;182:371–374.e2. 10.1016/j.jpeds.2016.12.032. [Abstract] [CrossRef] [Google Scholar]
57. Li Y, Salfelder A, Schwab KO, et al. Against all odds: blended phenotypes of three single-gene defects. Eur J Hum Genet. 2016;24(9):1274–1279. 10.1038/ejhg.2015.285. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
58. Posey JE, Rosenfeld JA, James RA, et al. Molecular diagnostic experience of whole-exome sequencing in adult patients. Genet Med. 2016;18(7):678–685. 10.1038/gim.2015.142. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
59. Yang Y, Muzny DM, Xia F, et al. Molecular findings among patients referred for clinical whole-exome sequencing. JAMA. 2014;312(18):1870–1879. 10.1001/jama.2014.14601. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
60. Balci TB, Hartley T, Xi Y, et al. Debunking Occam’s razor: Diagnosing multiple genetic diseases in families by whole-exome sequencing. Clin Genet. 2017;92(3):281–289. 10.1111/cge.12987. [Abstract] [CrossRef] [Google Scholar]
61. Eldomery MK, Coban-Akdemir Z, Harel T, et al. Lessons learned from additional research analyses of unsolved clinical exome cases. Genome Med. 2017;9(1):26. 10.1186/s13073-017-0412-6. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
62. Strande NT, Berg JS. Defining the Clinical Value of a Genomic Diagnosis in the Era of Next-Generation Sequencing. Annu Rev Genomics Hum Genet. 2016;17(1):303–332. 10.1146/annurev-genom-083115-022348. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
63. Vora NL, Powell B, Brandt A, et al. Prenatal exome sequencing in anomalous fetuses: new opportunities and challenges. Genet Med. 2017;19(11):1207–1216. 10.1038/gim.2017.33. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
64. Skinner D, Roche MI, Weck KE, et al. “Possibly positive or certainly uncertain?”: participants’ responses to uncertain diagnostic results from exome sequencing. Genet Med. 2018;20(3):313–319. 10.1038/gim.2017.135. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
65. Schrijver I, Farkas DH, Gibson JS, Lyon E. The Evolving Role of the Laboratory Professional in the Age of Genome Sequencing. J Mol Diagnostics. 2015;17(4):335–338. 10.1016/j.jmoldx.2015.03.001. [Abstract] [CrossRef] [Google Scholar]
66. James RA, Campbell IM, Chen ES, et al. A visual and curatorial approach to clinical variant prioritization and disease gene discovery in genome-wide diagnostics. Genome Med. 2016;8(1):13. 10.1186/s13073-016-0261-8. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
67. Eilbeck K, Quinlan A, Yandell M. Settling the score: Variant prioritization and Mendelian disease. Nat Rev Genet. 2017;18(10):599–612. 10.1038/nrg.2017.52. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
68. Wenger AM, Guturu H, Bernstein JA, Bejerano G. Systematic reanalysis of clinical exome data yields additional diagnoses: implications for providers. Genet Med. 2017;19(2):209–214. 10.1038/gim.2016.88. [Abstract] [CrossRef] [Google Scholar]
69. Wright CF, McRae JF, Clayton S, et al. Making new genetic diagnoses with old data: iterative reanalysis and reporting from genome-wide data in 1,133 families with developmental disorders. Genet Med. January 2018. 10.1038/gim.2017.246. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
70. Nambot S, Thevenon J, Kuentz P, et al. Clinical whole-exome sequencing for the diagnosis of rare disorders with congenital anomalies and/or intellectual disability: substantial interest of prospective annual reanalysis. Genet Med. November 2017. 10.1038/gim.2017.162. [Abstract] [CrossRef] [Google Scholar]
71. Xiao B, Qiu W, Ji X, et al. Marked yield of re-evaluating phenotype and exome/target sequencing data in 33 individuals with intellectual disabilities. Am J Med Genet Part A. 2018;176(1):107–115. 10.1002/ajmg.a.38542. [Abstract] [CrossRef] [Google Scholar]
72. Macklin S, Durand N, Atwal P, Hines S. Observed frequency and challenges of variant reclassification in a hereditary cancer clinic. Genet Med. 2018;20(3):346–350. 10.1038/gim.2017.207. [Abstract] [CrossRef] [Google Scholar]
73. Rehm HL, Bale SJ, Bayrak-Toydemir P, et al. ACMG clinical laboratory standards for next-generation sequencing. Genet Med. 2013;15(9):733–747. 10.1038/gim.2013.92. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/44778355
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/44778355

Smart citations by scite.ai
Smart citations by scite.ai include citation statements extracted from the full text of the citing article. The number of the statements may be higher than the number of citations provided by EuropePMC if one paper cites another multiple times or lower if scite has not yet processed some of the citing articles.
Explore citation contexts and check if this article has been supported or disputed.
https://scite.ai/reports/10.1038/s41436-018-0100-y

Supporting
Mentioning
Contrasting
0
42
0

Article citations


Go to all (24) article citations

Similar Articles 


To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.


Funding 


Funders who supported this work.

NHGRI NIH HHS (4)

NICHD NIH HHS (1)

NIGMS NIH HHS (2)