Advertisement
Article| Volume 24, ISSUE 6, P1196-1205, June 2022

Download started.

Ok

Laboratory-related outcomes from integrating an accessible delivery model for hereditary cancer risk assessment and genetic testing in populations with barriers to access

Open AccessPublished:March 16, 2022DOI:https://doi.org/10.1016/j.gim.2022.02.006

      Abstract

      Purpose

      This study aimed to evaluate the laboratory-related outcomes of participants who were offered genomic testing based on cancer family history risk assessment tools.

      Methods

      Patients from clinics that serve populations with access barriers, who are screened at risk for a hereditary cancer syndrome based on adapted family history collection tools (the Breast Cancer Genetics Referral Screening Tool and PREMM5), were offered exome-based panel testing for cancer risk and medically actionable secondary findings. We used descriptive statistics, electronic health record review, and inferential statistics to explore participant characteristics and results, consultations and actions related to pathogenic/likely pathogenic variants identified, and variables predicting category of findings, respectively.

      Results

      Of all the participants, 87% successfully returned a saliva kit. Overall, 5% had a pathogenic/likely pathogenic cancer risk variant and 1% had a secondary finding. Almost all (14/15, 93%) participants completed recommended consultations with nongenetics providers after an average of 17 months. The recommended actions (eg, breast magnetic resonance imaging) were completed by 17 of 25 participants. Participant personal history of cancer and PREMM5 score were each associated with the category of findings (history and colon cancer finding, Fisher’s exact P = .02; history and breast cancer finding, Fisher’s exact P = .01; PREMM5TM score; and colon cancer finding, Fisher’s exact P < .001).

      Conclusion

      This accessible model of hereditary cancer risk assessment and genetic testing yielded results that were often acted upon by patients and physicians.

      Keywords

      Introduction

      Germline genetic testing is the standard of care for patients at increased risk for hereditary cancer on the basis of personal and family history.
      • Daly M.B.
      • Pilarski R.
      • Yurgelun M.B.
      • et al.
      NCCN Guidelines Insights: genetic/familial high-risk assessment: breast, ovarian, and pancreatic, version 1.2020.
      However, access to genetic evaluation and testing is inequitable and is influenced by geographical, economic, referral-related, and other factors, which limit access.
      • Swink A.
      • Nair A.
      • Hoof P.
      • et al.
      Barriers to the utilization of genetic testing and genetic counseling in patients with suspected hereditary breast and ovarian cancers.
      • Kaye C.
      • Bodurtha J.
      • Edick M.
      • et al.
      Regional models of genetic services in the United States.
      • Erwin D.J.
      • LaMaire C.
      • Espana A.
      • Eble T.N.
      • Dhar S.U.
      Financial barriers in a county genetics clinic: problems and solutions.
      Patient-provider communication, lack of patient awareness and knowledge, and health literacy barriers are also related to disparities in genetic service delivery for underrepresented populations in clinical genetics.
      • Joseph G.
      • Pasick R.J.
      • Schillinger D.
      • Luce J.
      • Guerra C.
      • Cheng J.K.Y.
      Information mismatch: cancer risk counseling with diverse underserved patients.
      • Hawley S.T.
      • Morris A.M.
      Cultural challenges to engaging patients in shared decision making.
      • Kaphingst K.A.
      • Stafford J.D.
      • McGowan L.D.
      • Seo J.
      • Lachance C.R.
      • Goodman M.S.
      Effects of racial and ethnic group and health literacy on responses to genomic risk information in a medically underserved population.
      Specifically, in cancer genetics, patients from historically underserved populations are less likely to have their family history evaluated and be referred to a genetic specialist.
      • McCarthy A.M.
      • Bristol M.
      • Domchek S.M.
      • et al.
      Health care segregation, physician recommendation, and racial disparities in BRCA1/2 testing among women with breast cancer.
      ,
      • Meyer L.A.
      • Anderson M.E.
      • Lacour R.A.
      • et al.
      Evaluating women with ovarian cancer for BRCA1 and BRCA2 mutations: missed opportunities.
      In addition, suboptimal communication between diverse and underserved patients and genetics providers in the setting of cancer risk counseling has been identified.
      • Joseph G.
      • Pasick R.J.
      • Schillinger D.
      • Luce J.
      • Guerra C.
      • Cheng J.K.Y.
      Information mismatch: cancer risk counseling with diverse underserved patients.
      ,
      • Cheng J.K.Y.
      • Guerra C.
      • Pasick R.J.
      • Schillinger D.
      • Luce J.
      • Joseph G.
      Cancer genetic counseling communication with low-income Chinese immigrants.
      The engagement of diverse and medically underserved communities is a priority for the field of genomics.
      • Hindorff L.A.
      • Bonham V.L.
      • Brody L.C.
      • et al.
      Prioritizing diversity in human genomics research.
      In 2017, the Clinical Sequencing Evidence-Generating Research consortium was funded by the National Institutes of Health to investigate the integration of exome and genome sequencing into a range of health care settings and disease states in diverse racial/ethnic and medically underserved patient populations.
      • Amendola L.M.
      • Berg J.S.
      • Horowitz C.R.
      • et al.
      The clinical sequencing evidence-generating research consortium: integrating genomic sequencing in diverse and medically underserved populations.
      As part of the Clinical Sequencing Evidence-Generating Research consortium, the Cancer Health Assessments Reaching Many (CHARM) study evaluated a series of interventions to address health care disparities in germline cancer genomic services, with the goal of learning how to better deliver these services equitably in diverse populations.
      • Mittendorf K.F.
      • Kauffman T.L.
      • Amendola L.M.
      • et al.
      Cancer Health Assessments Reaching Many (CHARM): a clinical trial assessing a multimodal cancer genetics services delivery program and its impact on diverse populations.
      The CHARM study enrolled participants at increased risk for hereditary cancer or with limited family history information or structure from 1 of 2 sites: (1) Kaiser Permanente Northwest (KPNW) and (2) Denver Health (DH). Twenty-three percent of KPNW members are from racial/ethnic populations that are underrepresented in genetic studies. In addition, 81% of the patient population at DH is publicly insured or uninsured, 69% is from racial/ethnic populations underrepresented in genetic studies, and 21% of those between the ages of 18 and 49 years primarily or exclusively speak Spanish.
      • Mittendorf K.F.
      • Kauffman T.L.
      • Amendola L.M.
      • et al.
      Cancer Health Assessments Reaching Many (CHARM): a clinical trial assessing a multimodal cancer genetics services delivery program and its impact on diverse populations.
      Here we report the characteristics and exome-based panel testing results for the 967 participants in the CHARM study. We summarize the recommendations made during results disclosure and related follow-up care for participants with a pathogenic or likely pathogenic (P/LP) variant. Finally, we investigate variables associated with the category of findings returned. This study highlights key laboratory-related outcomes from the integration of an alternative service delivery model to increase access to genetic testing and informs expectations for results in diverse and underserved participant populations that include individuals at risk for hereditary cancer syndromes.

      Materials and Methods

      Enrollment in the CHARM study

      Recruitment approaches varied by site and are described in detail elsewhere.
      • Mittendorf K.F.
      • Kauffman T.L.
      • Amendola L.M.
      • et al.
      Cancer Health Assessments Reaching Many (CHARM): a clinical trial assessing a multimodal cancer genetics services delivery program and its impact on diverse populations.
      Briefly, recruitment for the CHARM study took place between August 2018 and August 2020. Primary recruitment at KPNW was carried out via email and follow-up text to patients with upcoming visits at 1 of the 3 KPNW CHARM study clinic sites. At DH, participants were primarily recruited via post card with a follow-up telephone call or by provider referral. Patients from both health systems with an English or Spanish language preference aged between 18 and 49 years were invited to take the risk assessment. Participants who could not speak either English or Spanish, were unable to provide informed consent, or who did not want their results placed in their medical records were not eligible.
      • Mittendorf K.F.
      • Kauffman T.L.
      • Amendola L.M.
      • et al.
      Cancer Health Assessments Reaching Many (CHARM): a clinical trial assessing a multimodal cancer genetics services delivery program and its impact on diverse populations.
      Invited participants provided electronic consent for the risk assessment and completed a web-based patient-facing family history risk assessment.

      Mittendorf KF, Ukaegbu C, Gilmore MJ, et al. Adaptation and early implementation of the PREdiction model for gene mutations (PREMM5™) for lynch syndrome risk assessment in a diverse population. Fam Cancer. Published online March 23, 2021. https://doi.org/10.1007/s10689-021-00243-3

      This risk assessment tool incorporated 2 validated algorithms for hereditary cancer risk assessment, namely PREMM5
      • Kastrinos F.
      • Uno H.
      • Ukaegbu C.
      • et al.
      Development and validation of the PREMM5 model for comprehensive risk assessment of Lynch syndrome.
      ,
      • Kastrinos F.
      • Uno H.
      • Syngal S.
      Commentary: PREMM5 threshold of 2.5% is recommended to improve identification of PMS2 carriers.
      for Lynch syndrome (LS) and the Breast Cancer Genetics Referral Screening Tool (B-RST 3.0)
      • Bellcross C.
      • Hermstad A.
      • Tallo C.
      • Stanislaw C.
      Validation of version 3.0 of the breast cancer genetics referral screening tool (B-RST™).
      for hereditary breast and ovarian cancer (HBOC) syndrome. The tool also included a novel algorithm that assessed unknown family history and the number of female family members living beyond age 45 years to screen for limited family history knowledge and limited family structure, respectively. All participants were provided information about their risk assessment results online immediately after completion of the screening tool.
      Online consent included custom illustrations of key concepts and audio voiceovers in English and Spanish.
      • Kraft S.A.
      • Porter K.M.
      • Duenas D.M.
      • et al.
      Participant reactions to a literacy-focused, web-based informed consent approach for a genomic implementation study.
      Participants could also request a paper copy or download a PDF copy of the consent if they preferred and/or could complete the risk assessment and consent over the phone. The online consent and risk assessment tools were developed and adapted for limited health literacy in English and were culturally modified and translated into Spanish in an iterative process involving patient stakeholders.

      Mittendorf KF, Ukaegbu C, Gilmore MJ, et al. Adaptation and early implementation of the PREdiction model for gene mutations (PREMM5™) for lynch syndrome risk assessment in a diverse population. Fam Cancer. Published online March 23, 2021. https://doi.org/10.1007/s10689-021-00243-3

      ,
      • Kraft S.A.
      • McMullen C.
      • Lindberg N.M.
      • et al.
      Integrating stakeholder feedback in translational genomics research: an ethnographic analysis of a study protocol’s evolution.
      Participants who were determined to be high risk by the screening tool(s) (high or moderate risk on B-RST 3.0 and/or ≥2.5% risk on PREMM5) or who reported limited family information or structure were provided with information about genetic testing and the options to (1) receive exome-based panel testing through the CHARM study or (2) receive information about access to clinical cancer genetic counseling and testing.
      • Kraft S.A.
      • Porter K.M.
      • Duenas D.M.
      • et al.
      Participant reactions to a literacy-focused, web-based informed consent approach for a genomic implementation study.
      Participants who consented
      • Kraft S.A.
      • Porter K.M.
      • Duenas D.M.
      • et al.
      Participant reactions to a literacy-focused, web-based informed consent approach for a genomic implementation study.
      were provided with a saliva sample collection kit by mail or in the clinic, which included literacy-adapted, pictorial, and written instructions congruent with their language selection. The enrollment and consent process for participants in the CHARM study is presented in Figure 1.

      Genomic testing

      Study participants who returned a saliva sample underwent genetic testing at the University of Washington Northwest Clinical Genomics Laboratory via an exome-based panel, which included the clinically relevant portion of the genome (about 5000 of the 20,000 genes in the human genome). DNA was extracted from saliva samples collected via the Oragene Dx OGD-500 kit (DNAGenotek). Sample-specific, dual-indexed libraries were constructed and enriched using an optimized xGen Inherited Diseases Panel (Integrated DNA Technologies). Enriched libraries were pooled and sequenced using an Illumina HiSeq 2500 (Illumina, Inc). Resulting sequences were aligned with the human genome build hg19 reference using the Burrows-Wheeler Aligner.
      • Li H.
      • Durbin R.
      Fast and accurate short read alignment with Burrows-Wheeler transform.
      Single-nucleotide variants and insertion/deletions were identified using the Genome Analysis Tool Kit
      • McKenna A.
      • Hanna M.
      • Banks E.
      • et al.
      The Genome Analysis Toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data.
      ; copy number variants were detected with CNVkit.
      • Talevich E.
      • Shain A.H.
      • Botton T.
      • Bastian B.C.
      CNVkit: genome-wide copy number detection and visualization from targeted DNA sequencing.
      A modified version of SnpEff
      • Cingolani P.
      • Platts A.
      • le Wang le L.
      • et al.
      A program for annotating and predicting the effects of single nucleotide polymorphisms, SnpEff: SNPs in the genome of Drosophila melanogaster strain w1118; iso-2; iso-3.
      was implemented to annotate all variants.
      Variants were annotated in 39 genes associated with cancer risk and 77 noncancer, medically actionable secondary finding genes (Supplemental Table 1). Cancer risk genes were identified from the literature and currently available commercial cancer gene panels and were reviewed for inclusion by members of the University of Washington, Northwest Clinical Genomics Laboratory CHARM study team. The medically actionable secondary finding list included the American College of Medical Genetics and Genomics V2.0 secondary finding list genes
      • Kalia S.S.
      • Adelman K.
      • Bale S.J.
      • et al.
      Recommendations for reporting of secondary findings in clinical exome and genome sequencing, 2016 update (ACMG SF v2.0): a policy statement of the American College of Medical Genetics and Genomics.
      and additional genes deemed medically actionable as part of previous genomic sequencing implementation studies.
      eMERGE Clinical Annotation Working Group
      Frequency of genomic secondary findings among 21,915 eMERGE network participants.
      ,
      • Dorschner M.O.
      • Amendola L.M.
      • Turner E.H.
      • et al.
      Actionable, pathogenic incidental findings in 1,000 participants’ exomes.
      All P and LP variants identified in cancer risk genes and medically actionable secondary finding genes were reported. Variants of uncertain significance (VUS) were reported only if the participant reported a personal and/or family history of a cancer associated with the VUS, because this family history information was not collected by a genetics provider, patients were tested for the same cancer genes regardless of their personal and family history, and the majority of VUS will eventually be reclassified as benign.
      • Harrison S.M.
      • Rehm H.L.
      Is “likely pathogenic” really 90% likely? Reclassification data in ClinVar.
      Pathogenic and likely pathogenic variants were reported in medically actionable secondary finding genes to participants who opted to receive them. Carrier status for autosomal recessive conditions in the cancer or medically actionable secondary finding gene lists was not reported, and only select variants were reported for some genes (Supplemental Table 1).
      Annotated variants were prioritized and initially reviewed by a genetic counselor and a molecular geneticist. All variants identified as eligible to be returned or as requiring discussion before classification were reviewed by the Northwest Clinical Genomics Laboratory team, which included a second genetic counselor, a molecular pathologist, and a medical geneticist. Variants were classified on the basis of the American College of Medical Genetics and Genomics recommendations for germline variant classification.
      • Richards S.
      • Aziz N.
      • Bale S.
      • et al.
      Standards and guidelines for the interpretation of sequence variants: a joint consensus recommendation of the American College of Medical Genetics and Genomics and the Association for Molecular Pathology.
      Participant laboratory reports included a section for reporting cancer risk results and a section for reporting medically actionable secondary findings. Cancer risk findings were reported in the same section regardless of whether they were concordant with the participant reported personal and family cancer history.

      Participant characteristics and overall results

      We explored characteristics of all participants in the CHARM study and of participants who returned a saliva kit using descriptive statistics. Descriptive statistics were also used to summarize the findings reported by the CHARM study in cancer risk and medically actionable secondary findings genes.
      Characteristics assessed included age, sex assigned at birth, personal history of cancer, enrollment site, risk assessment result, and whether or not participants had barriers to access. Participants were defined as having barriers to access on the basis of any of the following criteria established by CHARM study investigators: (1) Hispanic ethnicity or a race other than White indicated by participant report or health system electronic medical record data, (2) residing in a Health Resources and Services Administration–defined medically underserved area,

      Health Resources & Services Administration. What is shortage designation? Health Resources & Services Administration. Published February 2021. https://bhw.hrsa.gov/workforce-shortage-areas/shortage-designation#mups. Accessed June 15, 2021.

      (3) Spanish language preference for the risk assessment or any survey, (4) education attainment less than high school graduate, (5) income <200% of the Federal Poverty Level or Medicaid insurance, (6) uninsured, (7) sexual orientation other than heterosexual, and/or (8) gender identity other than cisgender female/male. The term barriers to access is used throughout this paper as shorthand to describe participants who met 1 or more of these criteria. In addition, given that individuals with Ashkenazi Jewish ancestry are more likely to have P variants in the BRCA1/2 genes, we calculated the proportion of participants who reported this ancestry on the B-RST 3.0 portion of the risk assessment.
      To test whether participants who reported a personal history of cancer were more likely to return a saliva kit than participants who qualified on the basis of family history of cancer or limited family history information, we performed Fisher exact tests to evaluate the statistical significance and report Cramér’s V as an estimate of magnitude.

      Recommendations and related care activities for participants with a P/LP variant disclosed

      We aggregated selected participant characteristics and result details and reviewed disclosure discussions and related activities for participants with a P/LP variant in a cancer risk or medically actionable secondary finding gene disclosed. Participants with other types of results or who did not complete results disclosure were not included in this review. Because changes to colon cancer screening are only recommended on the basis of the finding of a single P/LP variant in the MUTYH gene when there is a family history of colon cancer in a first-degree relative, participants with this finding were also not included.
      Three genetic counselors and a medical oncologist on the CHARM study team developed and piloted a data abstraction table over the course of several teleconference calls during which the group iteratively finalized the process and desired content. Results disclosure summary notes that were entered into the participant electronic medical records were reviewed by 1 of the 3 genetic counselors who abstracted relevant personal and family history information and the recommendations made. The other 2 genetic counselors and the medical oncologist then reviewed participant electronic medical records from the time of results disclosure until the present time and abstracted information on the follow-up care completed in relation to the P/LP finding (ie, other provider consultations and/or health care actions).
      Results disclosures of P/LP variants took place between December 2018 and July 2020. A subset of normal results was returned via letter. The remainder of the normal results and all VUS and positive results were disclosed via phone by 1 of 4 study genetic counselors. Half of the participants were randomized to receive results disclosure genetic counseling by 1 of the study genetic counselors trained in the Accessible, Relational, Inclusive, and Actionable approach described elsewhere.
      • Riddle L.
      • Amendola L.M.
      • Gilmore M.J.
      • et al.
      Development and early implementation of an accessible, relational, inclusive and actionable approach to genetic counseling: the ARIA model.
      The other half of participants received genetic counseling aligned with definitions of usual care in genetic counseling research.
      • Biesecker B.B.
      • Lillie S.E.
      • Amendola L.M.
      • et al.
      A review and definition of “usual care” in genetic counseling trials to standardize use in research.
      The review of participant electronic medical records was conducted between 10 and 27 months post results disclosure with an average elapsed time of 17 months.

      Investigation of variables associated with findings reported

      We explored participant level characteristics that may be associated with the category of findings returned. For the purpose of this analysis, findings were categorized as either (1) positive: P/LP variants in a high or moderate risk breast, ovarian, and/or colon cancer gene; (2) uncertain: VUS in a high or moderate risk breast, ovarian, and/or colon cancer gene; or (3) negative: all other results, including P/LP variants in medically actionable secondary finding genes. High and moderate risk breast and/or ovarian cancer risk genes from the cancer risk gene list (Supplemental Table 1) included ATM, BRCA1, BRCA2, CDH1, PALB2, PTEN, and TP53. High and moderate colon cancer risk genes included APC, BMPR1A, EPCAM, MUTYH (if 2 P/LP variants) MSH6, MLH1, MSH2, POLD1, POLE, PMS2, SMAD4, and STK11. Cancer risk designations for each gene were determined using estimates provided by the Clinical Genome (ClinGen) Resource,
      ClinGen. National Institutes of Health
      although more recently published data suggest a lower lifetime cancer risk for some of the breast cancer associated genes.
      • Dorling L.
      • Carvalho S.
      • et al.
      Breast Cancer Association Consortium
      Breast cancer risk genes – association analysis in more than 113,000 women.
      Given that an individual with a history of cancer is more likely to have a hereditary cancer condition, we explored whether a participant’s personal history of breast, ovarian, colon, and/or endometrial cancer was associated with having a positive finding. We also explored if having barriers to access was associated with having a positive finding, hypothesizing that less access to clinical genetic testing among those with barriers would lead to more positive results in this group. In addition, we hypothesized that having limited family information would be more common among those with barriers to access. Thus, we compared the proportion of participants with and without barriers to access who qualified on the basis of limited family information.
      Both PREMM5 and B-RST 3.0 have been validated as risk assessment tools to identify patients at risk for LS and HBOC, respectively.
      • Kastrinos F.
      • Uno H.
      • Ukaegbu C.
      • et al.
      Development and validation of the PREMM5 model for comprehensive risk assessment of Lynch syndrome.
      • Kastrinos F.
      • Uno H.
      • Syngal S.
      Commentary: PREMM5 threshold of 2.5% is recommended to improve identification of PMS2 carriers.
      • Bellcross C.
      • Hermstad A.
      • Tallo C.
      • Stanislaw C.
      Validation of version 3.0 of the breast cancer genetics referral screening tool (B-RST™).
      Recent data indicate that PREMM5 risk results ≥2.5% may not be specific to LS but can also indicate the presence of non-LS high penetrance germline P variants.
      • Mannucci A.
      • Furniss C.S.
      • Ukaegbu C.
      • et al.
      Comparison of colorectal and endometrial microsatellite instability tumor analysis and Premm5 risk assessment for predicting pathogenic germline variants on multigene panel testing.
      Thus, we investigated if having a positive finding in any colon cancer or breast and/or ovarian cancer risk gene returned was associated with screening above the threshold in PREMM5 or with screening high risk in B-RST 3.0, respectively.
      Finally, we explored the rates of VUS across race/ethnicity groups from participant reports or health system electronic medical record data, hypothesizing that there would be a higher rate of VUS in Asian, Hispanic, and Black participants based on both previous research
      • Caswell-Jin J.L.
      • Gupta T.
      • Hall E.
      • et al.
      Racial/ethnic differences in multiple-gene sequencing results for hereditary cancer risk.
      • Jones T.
      • Trivedi M.S.
      • Jiang X.
      • et al.
      Racial and ethnic differences in BRCA1/2 and multigene panel testing among young breast cancer patients.
      • Landry L.G.
      • Rehm H.L.
      Association of racial/ethnic categories with the ability of genetic tests to detect a cause of cardiomyopathy.
      and on historically lower rates of genetic testing and less representation in genomic research in these populations. Participant race/ethnicity groups were deliberately not combined for this analysis. VUS in high-, moderate-, and low-risk cancer genes were included.
      To evaluate each of the relationships described above, we performed Fisher’s exact test to evaluate statistical significance and reported Cramér’s V as an estimate of magnitude.

      Results

      Participant characteristics

      A total of 841 of the 967 (87%) participants in the CHARM study who were sent a saliva collection kit returned their sample to the laboratory. Successful DNA extraction and sequencing was completed for 827 of these 841 participants (98.3%). In total, 83 (10%) participants with completed sequencing were identified as Ashkenazi Jewish. Participants with a personal history of a breast, ovarian, colon, and/or endometrial cancer were more likely to return their saliva kit than participants without a personal history (98.3% vs 86.3%; Cramér's V = 0.08; Fisher's exact P = .04). Otherwise, participant characteristics and cancer risk assessment results were similar for all CHARM study participants and participants who returned their sample to the laboratory (Table 1).
      Table 1Characteristics of all participants and participants who returned a saliva kit
      CharacteristicsAll Participants (N = 967)Returned Saliva Kit (n = 841)
      Age, mean (SD)36.1 (8.3)36.2 (8.3)
      Sex assigned at birth, n (%)
       Female760 (79)664 (79)
       Male201 (21)177 (21)
      Personal history of cancer, n (%)
       Yes
      One participant had a personal history of 2 separate cancer diagnoses.
      57 (6)56 (7)
      (colon; endometrial; breast; ovarian)(11 [1]; 6 [1]; 34 [4]; 7 [1])(11 [1]; 6 [1]; 33 [4]; 7 (1))
       No910 (94)784 (93)
      Enrollment site, n (%)
       Kaiser Permanente Northwest678 (70)572 (68)
       Denver Health289 (30)269 (32)
      Screening result, n (%)
       B-RST 3.0 High & PREMM5 Positive104 (11)89 (11)
       B-RST 3.0 Moderate & PREMM5 Positive19 (2)16 (2)
       B-RST 3.0 High389 (40)334 (40)
       B-RST 3.0 Moderate154 (16)139 (17)
      PREMM5 Positive105 (11)90 (11)
       Limited Family Information196 (20)173 (21)
      Barriers to access, n (%)741 (77)646 (7)
      a One participant had a personal history of 2 separate cancer diagnoses.

      Cancer risk and medically actionable secondary findings

      Overall, 28 participants (3%) had a P/LP variant associated with breast and/or ovarian cancer risk, including 10 participants with a P/LP variant in BRCA1 or BRCA2. In total, 8 participants (1%) had a P/LP variant associated with colon cancer risk, including 7 in the LS associated genes. The overall VUS rate was 9% or 75 out of 827 participants. The number of participants with a P/LP variant and VUS identified in a breast, ovarian, and/or colon cancer risk gene is presented in Table 2.
      Table 2Breast, ovarian, and colon cancer-related findings in 827 sequenced participants
      FindingNumber of Participants, n (%)
      P/LP Variant≥1 VUS
      HBOC (BRCA1/2)10 (1)8 (1)
      Lynch syndrome (MLH1, MSH2, MSH6, PMS2)
      No participants were identified to have deletions in the EPCAM gene associated with Lynch syndrome.
      7 (1)
      One participant with a P/LP variant in a Lynch syndrome gene also had a VUS.
      14 (2)
      High/ moderate risk
      Defined on the basis of review of ClinGen penetrance estimates, December 2020.
      ,
      High/moderate risk genes with variants: APC, ATM, BMPR1A, CDH1, POLD1, POLE, PTEN, PALB2 SMAD4, STK11, and TP53.
      Low risk
      Defined on the basis of review of ClinGen penetrance estimates, December 2020.
      ,
      Low risk genes with variants: BRIP1, RAD51C, RAD51D, CHEK2, and FANCM.
      High/ moderate riskLow risk
      Non-HBOC breast/ovarian cancer risk6 (1)12 (1)
      One participant with a P/LP variant in a low-risk non-HBOC breast/ovarian cancer risk gene also had a high/moderate risk VUS.
      30 (4)15 (2)
      Non–Lynch syndrome colon cancer risk1 (0)0 (0)8 (1)0 (0)
      HBOC, hereditary breast and ovarian cancer; LP, likely pathogenic; P, pathogenic; VUS, variant of uncertain significance.
      a No participants were identified to have deletions in the EPCAM gene associated with Lynch syndrome.
      b One participant with a P/LP variant in a Lynch syndrome gene also had a VUS.
      c Defined on the basis of review of ClinGen penetrance estimates, December 2020.
      d High/moderate risk genes with variants: APC, ATM, BMPR1A, CDH1, POLD1, POLE, PTEN, PALB2 SMAD4, STK11, and TP53.
      e Low risk genes with variants: BRIP1, RAD51C, RAD51D, CHEK2, and FANCM.
      f One participant with a P/LP variant in a low-risk non-HBOC breast/ovarian cancer risk gene also had a high/moderate risk VUS.
      In total, 20 participants (2%) were heterozygous for a P/LP variant in the MUTYH gene and 4 participants (0.5%) had a P/LP variant in a cancer risk gene not associated with breast, ovarian, colon, and/or endometrial cancer (1 each in PTCH1, SDHD, SDHB, and TMEM127). Nine (1%) of the 810 participants who opted for return of medically actionable secondary findings had a P/LP variant. Medically actionable secondary findings were identified in APOB, LDLR, MYBPC3 (×2), PAH (compound heterozygote), RYR1, SERPINA1 (SZ alleles), TNNI3, and TSC1.

      Recommendations and related care activities for participants with P/LP variants disclosed

      Of the 40 participants with a P/LP variant in a cancer risk gene, and 9 participants with a medically actionable secondary finding, 34 (85%) and 8 (89%), respectively, had a results disclosure conversation with a study genetic counselor. The participant characteristics, results, disclosure session details, and care activities related to the P/LP results disclosed are presented in Supplemental Table 2.
      Of the 34 participants who were disclosed a cancer risk variant, 6 of 17 (35%) completed a recommended consultation with a genetics provider and 9 of 10 (90%) completed a consultation related to their result with other providers. Eighteen of these 34 participants were recommended to change their current care (eg, breast magnetic resonance imaging, colonoscopy) and 11 (61%) completed at least 1 of the recommended actions. Ten (29%) participants with cancer risk variants received recommendations for health care actions that did not change their care at their current age (eg, recommendation for a 25-year-old female participant with a P/LP CHEK2 variant to consider breast magnetic resonance imaging at age 40 years). Of note, 6 of the 34 (18%) participants disclosed a P/LP cancer risk variant were no longer receiving care at DH or KPNW at the time of electronic health record review.
      Of the 8 participants who disclosed a medically actionable secondary finding, 2 of 4 (50%) completed the recommended consultations with a genetics provider and 5 of 5 (100%) completed related follow-up consultations with other providers. Five of 6 (83%) participants completed recommended actions.
      None of the 8 participants with a secondary finding disclosed had previous knowledge of the variant in themselves or in their family; however, 11 of the 34 (32%) participants with a cancer risk P/LP variant disclosed reported previous knowledge of the finding in themselves (n = 6) or in 1 or more family members (n = 5) during results disclosure conversations. These findings had been identified by genetic testing conducted in a clinical setting outside of the CHARM study. Four of the 6 participants with a known P/LP cancer risk variant in themselves had a personal history of cancer. Most participants with a cancer risk variant (24/33, 73%) and a secondary finding (6/8, 75%) did not have a related personal history.

      Variables associated with results reported

      No differences in the VUS rates were found across self-reported race/ethnicity groups (Table 3) (high/moderate/low risk breast/ovarian cancer genes: Cramér’s V = 0.24; Fisher's exact P = .10; high/moderate risk colon cancer genes: Cramér’s V = 0.07; Fisher's exact P = .61).
      Table 3VUS in breast/ovarian and colon cancer risk genes across race/ethnicity groups from participant report or health system electronic medical record data
      Race/Ethnicity (n)Breast/Ovarian Cancer Risk Gene VUS, n (%)Colon Cancer

      Risk Gene VUS, n (%)
      Asian (39)0 (0)0 (0)
      Black (44)2 (4)1 (2)
      Hispanic (270)21 (8)9 (3)
      Middle Eastern (6)0 (0)0 (0)
      Multiracial (71)6 (8)3 (4)
      Native American (14)1 (7)1 (7)
      Pacific Islander (4)1 (25)0 (0)
      White (374)19 (5)8 (2)
      VUS, variant of uncertain significance.
      The category of findings returned (positive, uncertain, or negative) was associated with whether or not participants had a personal history of breast, ovarian, colon, and/or endometrial cancer (breast and/or ovarian cancer risk gene, Cramér’s V = 0.11; Fisher's exact P = .02; colon cancer risk gene, Cramér’s V = 0.13; Fisher's exact P = .01). Participants with a personal history of cancer had a positive finding more often in breast and/or ovarian cancer risk genes (7.3% vs 1.6%) and colon cancer risk genes (5.5% vs 0.7%) and had an uncertain finding less often (breast/ovarian cancer risk genes, 1.8% vs 4.8%; colon cancer risk genes 0% vs 2.9%).
      There was no association between having barriers to access and the category of findings for breast and ovarian cancer risk genes (Cramér’s V = 0.02; Fisher’s exact P = 1.0); however, there was an association between having barriers to access and the category of findings for colon cancer risk genes (Cramér’s V = 0.09; Fisher’s exact P = .04). Participants had similar rates of uncertain findings in colon cancer risk genes (no barriers 2.58% vs barriers 2.69%); but a higher proportion of participants who did not have barriers to access had a positive colon cancer finding (no barriers 2.58% vs barriers 0.47%). There was no association between having barriers to access and being eligible for enrollment based on limited family information (Fisher’s exact P = .26).
      Screening above the threshold on PREMM5 was associated with the category of findings for colon cancer risk genes (Cramér’s V = 0.22; Fisher’s exact P < .001). Those who screened ≥2.5% in PREMM5 had an uncertain or positive colon cancer risk finding more frequently than those who qualified for the study based on limited family information or screening high risk in B-RST 3.0 (uncertain 7.9% vs 1.1%; positive 3.2% vs 0.3%). Screening high risk in B-RST 3.0 was not associated with the category of findings for breast and/or ovarian cancer risk genes (Cramér’s V = 0.08; Fisher’s exact P = .09).

      Discussion

      The CHARM study evaluated a streamlined approach to increase access to genetic testing for patients from diverse and medically underrepresented groups at risk for hereditary cancer or with limited family information or structure. As part of the CHARM study, multiple intervention components were designed and implemented to reduce barriers to risk assessment, consent, and sample acquisition, including the use of web-based patient-facing tools and saliva collection at home.
      • Mittendorf K.F.
      • Kauffman T.L.
      • Amendola L.M.
      • et al.
      Cancer Health Assessments Reaching Many (CHARM): a clinical trial assessing a multimodal cancer genetics services delivery program and its impact on diverse populations.
      ,

      Mittendorf KF, Ukaegbu C, Gilmore MJ, et al. Adaptation and early implementation of the PREdiction model for gene mutations (PREMM5™) for lynch syndrome risk assessment in a diverse population. Fam Cancer. Published online March 23, 2021. https://doi.org/10.1007/s10689-021-00243-3

      ,
      • Kraft S.A.
      • Porter K.M.
      • Duenas D.M.
      • et al.
      Participant reactions to a literacy-focused, web-based informed consent approach for a genomic implementation study.
      A high proportion (841/967, 87%) of participants who consented for genetic testing through the study successfully returned a saliva kit, and there was no difference in the rate of return between those who met the CHARM study definition of having barriers to access and those who did not. This suggests that the CHARM study multimodal service delivery approach provided an accessible delivery model for genetic testing. Increasing access to genetic services is essential to providing genomic medicine equitably. Integrating multiple, evidence-based modifications with traditional care delivery approaches will likely be necessary to effectively address the needs and preferences of providers, health systems, and patients.
      With the introduction of massively parallel sequencing into clinical genetics, hereditary cancer testing has evolved from targeted, sequential, single-gene testing toward larger panels of genes that predispose to all types of cancers.
      • Stanislaw C.
      • Xue Y.
      • R Wilcox W
      Genetic evaluation and testing for hereditary forms of cancer in the era of next-generation sequencing.
      Recent research providing cancer gene panel testing for all patients with solid tumors, regardless of age, cancer type, or family history, identified P/LP variants in 13% of patients.
      • Samadder N.J.
      • Riegert-Johnson D.
      • Boardman L.
      • et al.
      Comparison of universal genetic testing vs guideline-directed targeted testing for patients with hereditary cancer syndrome.
      In the CHARM study, 5% of participants had a P/LP variant in a cancer risk gene. This rate reflects the personal and family cancer history characteristics of the sequenced participants. The prior probability of a positive result is highest for an individual diagnosed with cancer, raising suspicion for a hereditary predisposition in a family. Most participants tested in the CHARM study had no personal history of breast, ovarian, colon, and/or endometrial cancer (781/837, 93%). In addition, 20% (170/837) of the sequenced CHARM participants qualified for the study based on limited family information or structure, and 2 (1%) of these individuals had a P/LP cancer risk variant. These estimates of testing yield can inform guidelines and recommendations for hereditary cancer genetic testing that include criteria related to patient reported personal and family history of cancer and limited family history information or structure.
      • Daly M.B.
      • Pilarski R.
      • Yurgelun M.B.
      • et al.
      NCCN Guidelines Insights: genetic/familial high-risk assessment: breast, ovarian, and pancreatic, version 1.2020.
      ,
      • Owens D.K.
      • Davidson K.W.
      • et al.
      US Preventive Services Task Force
      Risk assessment, genetic counseling, and genetic testing for BRCA-related cancer: US Preventive Services Task Force recommendation statement.
      Although a subset (18%) of participants with a P/LP cancer risk variant had previous knowledge of the variant in themselves, most (73% cancer risk, 75% secondary findings) participants with a P/LP finding had no known related personal history. These participants gained the opportunity to discuss and pursue prevention and surveillance for early detection of disease. Each participant disclosed a P/LP variant met with a genetics provider through the CHARM study to discuss their result and the implications, and almost all completed recommended downstream consultations with nongenetics providers (90% cancer risk, 100% secondary finding) who could facilitate risk management behaviors associated with reduced morbidity and mortality.
      The PREMM5 risk assessment has been validated and integrated into clinical practice as a LS evaluation tool.
      • Kastrinos F.
      • Uno H.
      • Ukaegbu C.
      • et al.
      Development and validation of the PREMM5 model for comprehensive risk assessment of Lynch syndrome.
      In the CHARM study, screening above the threshold on the PREMM5 was associated with having a P/LP variant in a colon cancer risk gene. This suggests that the literacy and cultural adaptation of this tool for implementation as a self-completed, patient-facing electronic application in this population was effective at identifying those at increased risk. This finding also suggests that integrating the PREMM5 as a patient-facing tool could identify patients with non-LS hereditary colon cancer conditions, which is consistent with recently published research,
      • Mannucci A.
      • Furniss C.S.
      • Ukaegbu C.
      • et al.
      Comparison of colorectal and endometrial microsatellite instability tumor analysis and Premm5 risk assessment for predicting pathogenic germline variants on multigene panel testing.
      and provides further support for recommending multigene panel testing for those who screen at increased risk.
      Screening high risk on the B-RST 3.0 in the CHARM study was not associated with the category of finding returned (positive, uncertain, negative) in breast and/or ovarian cancer risk genes. Family history of ovarian cancer and bilateral breast cancer are both highly weighted in the B-RST 3.0 algorithm. It is possible that inaccurate reporting of family members with these cancers on the B-RST 3.0 qualified individuals for the CHARM study who did not actually have a family history suggestive of HBOC, underpowering the analysis for this association.
      These findings need to be interpreted in the context of several limitations. First, the rate of positive cancer risk findings in the CHARM study may not be generalizable to a clinical setting with testing ordered by a genetic specialist and/or on the basis of a provider-collected family history. Second, although a difference in VUS rate across participant reported race/ethnicity categories was not identified, it is possible that the CHARM study was underpowered to evaluate this question. Research opportunities and dedicated funding that is focused on engagement of diverse participant cohorts are necessary to generate data sets and evidence to support equitable variant classification outcomes. Third, the interpretation of these findings is limited by the absence of a comparison group. A manuscript comparing outcomes of those who declined participation in the CHARM study is forthcoming and will add context for the findings reported here. Finally, there are several limitations related to the review of recommendations and related care activities for participants with P/LP variants disclosed. The time frame during which completion of recommended consultations and care activities was evaluated overlapped with the COVID-19 pandemic and related restrictions on routine medical care, which may have lowered rates of adherence to related recommendations. It is also not possible to identify which and to what extent each of the 12 components in the CHARM multimodal intervention may have influenced participant actions related to follow-up care. In addition, the review was conducted at a single point in time, and information from each chart was abstracted by only 1 reviewer, so interrater reliability and changes over time were not assessed.
      The integration of an alternative delivery model incorporating electronic, patient-facing hereditary cancer risk assessment and at-home saliva-based genetic testing enabled successful genetic testing service delivery in diverse and medically underserved patient populations in the CHARM study. The continued development, evaluation, and tailoring of alternative approaches, such as those integrated in the CHARM study, is essential to address barriers and inequities in access to genetic services. Identifying participants at increased cancer risk and with other medically actionable genetic conditions increased opportunities for prevention and early detection. Longer term studies that can evaluate the patient health and economic outcomes related to these changes in recommended care will inform the utility of larger scale, less targeted genomic testing. Finally, additional work to identify and address barriers to adherence to recommended health care, especially in traditionally underrepresented populations, is necessary.

      Data Availability

      Classifications and evidence details for all variants returned to Cancer Health Assessments Reaching Many participants have been submitted to ClinVar under the submitter name “Division of Medical Genetics, University of Washington” and can be accessed at: https://www.ncbi.nlm.nih.gov/clinvar/submitters/507302/.

      Conflict of Interest

      S.S. reports being a consultant for Myriad Genetics and reports receiving an inventor share of licensing revenues from the PREMM model. L.M.A. is an employee of Illumina, Inc. All other authors declare no conflicts of interest.

      Acknowledgments

      This work was part of the Clinical Sequencing Evidence-Generating Research consortium funded by the National Human Genome Research Institute with cofunding from the National Institute on Minority Health and Health Disparities and the National Cancer Institute. This work was supported by a grant from the National Human Genome Research Institute (U01HG007292; multiple principle investigators: Wilfond, Goddard), with additional support from U24HG007307 (Coordinating Center) and National Institutes of Health 5R01CA132829 (S.S. and C.U.).

      Author Information

      Conceptualization: L.M.A, M.O.D., T.L.K., K.F.M., C.B., S.S., C.U., K.A.B.G., B.S.W., G.P.J.; Data curation: L.M.A., E.S., M.J.G., S.O., J.M.Z.; Formal analysis: M.C.L.; Funding acquisition: K.A.B.G., B.S.W., G.P.J.; Methodology: L.M.A., M.O.D., M.C.L., K.A.B.G., B.S.W., G.P.J.; Project administration: L.M.A., T.L.K., C.L.J.; Writing-original draft: L.M.A., M.O.D., T.L.K., K.F.M.; Writing-review and editing: L.M.A., E.S., M.C.L., M.O.D., B.A.R., B.H.S., M.J.G., S.O., J.M.Z., T.L.K., K.F.M., C.B., C.L.J., G.J., L.R., S.S., C.U., K.A.B.G., B.S.W., G.P.J.

      Ethics Declaration

      Patient consent for participation in the Cancer Health Assessments Reaching Many study was received. The Cancer Health Assessments Reaching Many study was approved by the Kaiser Permanente Northwest Institutional Review Board (IRB), and all collaborating IRBs relied on Kaiser Permanente Northwest IRB except for Dana-Farber Cancer Institute and Columbia University, which approved the study separately.

      Supplementary Material

      CHARM Study Team Members

      Jake Allen, Laura M. Amendola, Katherine P. Anderson, Frank Angelo, Briana L. Arnold, Cecelia Bellcross, Tiffany Bendelow, Barbara B. Biesecker, Kristin D. Breslin, Joanna E. Bulkley, Kristina F. Booker, Mikaella Caruncho, James V. Davis, Sonia Deutsch, Beth Devine, Michael O. Dorschner, Devan M. Duenas, Donna J. Eubanks, Heather Spencer Feigelson, Amanda S. Freed, Marian J. Gilmore, Katrina A.B. Goddard, Clay Greaney, Inga Gruß, Claudia Guerra, Boya Guo, Joan Holup, Jessica Ezzell Hunter, Chalinya L. Ingphakorn, Paige Jackson, Gail P. Jarvik, Charisma L. Jenkins, Galen Joseph, Leah S. Karliner, Tia L. Kauffman, Erin Keast, Sarah Knerr, Alyssa H. Koomas, Stephanie A. Kraft, Mi H. Lee, Robin Lee, Sandra Soo-Jin Lee, Michael C. Leo, Hannah S. Lewis, Elizabeth G. Liles, Nangel M. Lindberg, Frances Lynch, Carmit K. McMullen, Elizabeth Medina, Kathleen F. Mittendorf, Kristin R. Muessig, Sonia Okuyama, C. Samuel Peterson, Angela R. Paolucci, Rosse Rodriguez Perez, Kathryn M. Porter, Chelese L. Ransom, Ana Reyes, Leslie S. Riddle, Sperry Robinson, Bradley A. Rolf, Alan F. Rope, Emily Schield, Jennifer L. Schneider, Kelly J. Shipman, Brian H Shirts, Elizabeth Shuster, Sapna Syngal, Britta N. Torgrimson-Ojerio, Chinedu Ukaegbu, Meredith L. Vandermeer, Alexandra M. Varga, David L. Veenstra, W. Chris Whitebirch, Larissa Lee White, Benjamin S. Wilfond, Jamilyn M. Zepp.

      References

        • Daly M.B.
        • Pilarski R.
        • Yurgelun M.B.
        • et al.
        NCCN Guidelines Insights: genetic/familial high-risk assessment: breast, ovarian, and pancreatic, version 1.2020.
        J Natl Compr Canc Netw. 2020; 18: 380-391https://doi.org/10.6004/jnccn.2020.0017
        • Swink A.
        • Nair A.
        • Hoof P.
        • et al.
        Barriers to the utilization of genetic testing and genetic counseling in patients with suspected hereditary breast and ovarian cancers.
        Proc (Bayl Univ Med Cent). 2019; 32: 340-344https://doi.org/10.1080/08998280.2019.1612702
        • Kaye C.
        • Bodurtha J.
        • Edick M.
        • et al.
        Regional models of genetic services in the United States.
        Genet Med. 2020; 22 (Published correction appears in Genet Med. 2020;22(1):241.): 381-388
        https://doi.org/10.1038/s41436-019-0648-1
        • Erwin D.J.
        • LaMaire C.
        • Espana A.
        • Eble T.N.
        • Dhar S.U.
        Financial barriers in a county genetics clinic: problems and solutions.
        J Genet Couns. 2020; 29: 678-688https://doi.org/10.1002/jgc4.1279
        • Joseph G.
        • Pasick R.J.
        • Schillinger D.
        • Luce J.
        • Guerra C.
        • Cheng J.K.Y.
        Information mismatch: cancer risk counseling with diverse underserved patients.
        J Genet Couns. 2017; 26 (Published correction appears in J Genet Couns. 2017;26(5):1105.): 1090-1104
        https://doi.org/10.1007/s10897-017-0089-4
        • Hawley S.T.
        • Morris A.M.
        Cultural challenges to engaging patients in shared decision making.
        Patient Educ Couns. 2017; 100: 18-24https://doi.org/10.1016/j.pec.2016.07.008
        • Kaphingst K.A.
        • Stafford J.D.
        • McGowan L.D.
        • Seo J.
        • Lachance C.R.
        • Goodman M.S.
        Effects of racial and ethnic group and health literacy on responses to genomic risk information in a medically underserved population.
        Health Psychol. 2015; 34: 101-110https://doi.org/10.1037/hea0000177
        • McCarthy A.M.
        • Bristol M.
        • Domchek S.M.
        • et al.
        Health care segregation, physician recommendation, and racial disparities in BRCA1/2 testing among women with breast cancer.
        J Clin Oncol. 2016; 34: 2610-2618https://doi.org/10.1200/JCO.2015.66.0019
        • Meyer L.A.
        • Anderson M.E.
        • Lacour R.A.
        • et al.
        Evaluating women with ovarian cancer for BRCA1 and BRCA2 mutations: missed opportunities.
        Obstet Gynecol. 2010; 115: 945-952https://doi.org/10.1097/AOG.0b013e3181da08d7
        • Cheng J.K.Y.
        • Guerra C.
        • Pasick R.J.
        • Schillinger D.
        • Luce J.
        • Joseph G.
        Cancer genetic counseling communication with low-income Chinese immigrants.
        J Community Genet. 2018; 9: 263-276https://doi.org/10.1007/s12687-017-0350-4
        • Hindorff L.A.
        • Bonham V.L.
        • Brody L.C.
        • et al.
        Prioritizing diversity in human genomics research.
        Nat Rev Genet. 2018; 19: 175-185https://doi.org/10.1038/nrg.2017.89
        • Amendola L.M.
        • Berg J.S.
        • Horowitz C.R.
        • et al.
        The clinical sequencing evidence-generating research consortium: integrating genomic sequencing in diverse and medically underserved populations.
        Am J Hum Genet. 2018; 103: 319-327https://doi.org/10.1016/j.ajhg.2018.08.007
        • Mittendorf K.F.
        • Kauffman T.L.
        • Amendola L.M.
        • et al.
        Cancer Health Assessments Reaching Many (CHARM): a clinical trial assessing a multimodal cancer genetics services delivery program and its impact on diverse populations.
        Contemp Clin Trials. 2021; 106 (Published correction appears in Contemp Clin Trials. Published online February 2, 2022.): 106432
        https://doi.org/10.1016/j.cct.2021.106432
      1. Mittendorf KF, Ukaegbu C, Gilmore MJ, et al. Adaptation and early implementation of the PREdiction model for gene mutations (PREMM5™) for lynch syndrome risk assessment in a diverse population. Fam Cancer. Published online March 23, 2021. https://doi.org/10.1007/s10689-021-00243-3

        • Kastrinos F.
        • Uno H.
        • Ukaegbu C.
        • et al.
        Development and validation of the PREMM5 model for comprehensive risk assessment of Lynch syndrome.
        J Clin Oncol. 2017; 35: 2165-2172https://doi.org/10.1200/JCO.2016.69.6120
        • Kastrinos F.
        • Uno H.
        • Syngal S.
        Commentary: PREMM5 threshold of 2.5% is recommended to improve identification of PMS2 carriers.
        Fam Cancer. 2018; 17: 567https://doi.org/10.1007/s10689-018-0074-6
        • Bellcross C.
        • Hermstad A.
        • Tallo C.
        • Stanislaw C.
        Validation of version 3.0 of the breast cancer genetics referral screening tool (B-RST™).
        Genet Med. 2019; 21: 181-184https://doi.org/10.1038/s41436-018-0020-x
        • Kraft S.A.
        • Porter K.M.
        • Duenas D.M.
        • et al.
        Participant reactions to a literacy-focused, web-based informed consent approach for a genomic implementation study.
        AJOB Empir Bioeth. 2021; 12: 1-11https://doi.org/10.1080/23294515.2020.1823907
        • Kraft S.A.
        • McMullen C.
        • Lindberg N.M.
        • et al.
        Integrating stakeholder feedback in translational genomics research: an ethnographic analysis of a study protocol’s evolution.
        Genet Med. 2020; 22: 1094-1101https://doi.org/10.1038/s41436-020-0763-z
        • Li H.
        • Durbin R.
        Fast and accurate short read alignment with Burrows-Wheeler transform.
        Bioinformatics. 2009; 25: 1754-1760https://doi.org/10.1093/bioinformatics/btp324
        • McKenna A.
        • Hanna M.
        • Banks E.
        • et al.
        The Genome Analysis Toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data.
        Genome Res. 2010; 20: 1297-1303https://doi.org/10.1101/gr.107524.110
        • Talevich E.
        • Shain A.H.
        • Botton T.
        • Bastian B.C.
        CNVkit: genome-wide copy number detection and visualization from targeted DNA sequencing.
        PLoS Comput Biol. 2016; 12e1004873https://doi.org/10.1371/journal.pcbi.1004873
        • Cingolani P.
        • Platts A.
        • le Wang le L.
        • et al.
        A program for annotating and predicting the effects of single nucleotide polymorphisms, SnpEff: SNPs in the genome of Drosophila melanogaster strain w1118; iso-2; iso-3.
        Fly (Austin). 2012; 6: 80-92https://doi.org/10.4161/fly.19695
        • Kalia S.S.
        • Adelman K.
        • Bale S.J.
        • et al.
        Recommendations for reporting of secondary findings in clinical exome and genome sequencing, 2016 update (ACMG SF v2.0): a policy statement of the American College of Medical Genetics and Genomics.
        Genet Med. 2017; 19 (Published correction appears in Genet Med. 2017;19(4):484.): 249-255
        https://doi.org/10.1038/gim.2016.190
        • eMERGE Clinical Annotation Working Group
        Frequency of genomic secondary findings among 21,915 eMERGE network participants.
        Genet Med. 2020; 22: 1470-1477https://doi.org/10.1038/s41436-020-0810-9
        • Dorschner M.O.
        • Amendola L.M.
        • Turner E.H.
        • et al.
        Actionable, pathogenic incidental findings in 1,000 participants’ exomes.
        Am J Hum Genet. 2013; 93: 631-640https://doi.org/10.1016/j.ajhg.2013.08.006
        • Harrison S.M.
        • Rehm H.L.
        Is “likely pathogenic” really 90% likely? Reclassification data in ClinVar.
        Genome Med. 2019; 11: 72https://doi.org/10.1186/s13073-019-0688-9
        • Richards S.
        • Aziz N.
        • Bale S.
        • et al.
        Standards and guidelines for the interpretation of sequence variants: a joint consensus recommendation of the American College of Medical Genetics and Genomics and the Association for Molecular Pathology.
        Genet Med. 2015; 17: 405-424https://doi.org/10.1038/gim.2015.30
      2. Health Resources & Services Administration. What is shortage designation? Health Resources & Services Administration. Published February 2021. https://bhw.hrsa.gov/workforce-shortage-areas/shortage-designation#mups. Accessed June 15, 2021.

        • Riddle L.
        • Amendola L.M.
        • Gilmore M.J.
        • et al.
        Development and early implementation of an accessible, relational, inclusive and actionable approach to genetic counseling: the ARIA model.
        Patient Educ Couns. 2021; 104: 969-978https://doi.org/10.1016/j.pec.2020.12.017
        • Biesecker B.B.
        • Lillie S.E.
        • Amendola L.M.
        • et al.
        A review and definition of “usual care” in genetic counseling trials to standardize use in research.
        J Genet Couns. 2021; 30: 42-50https://doi.org/10.1002/jgc4.1363
        • ClinGen. National Institutes of Health
        (Accessed December 1, 2021)
        • Dorling L.
        • Carvalho S.
        • et al.
        • Breast Cancer Association Consortium
        Breast cancer risk genes – association analysis in more than 113,000 women.
        N Engl J Med. 2021; 384: 428-439https://doi.org/10.1056/NEJMoa1913948
        • Mannucci A.
        • Furniss C.S.
        • Ukaegbu C.
        • et al.
        Comparison of colorectal and endometrial microsatellite instability tumor analysis and Premm5 risk assessment for predicting pathogenic germline variants on multigene panel testing.
        J Clin Oncol. 2020; 38: 4086-4094https://doi.org/10.1200/JCO.20.01470
        • Caswell-Jin J.L.
        • Gupta T.
        • Hall E.
        • et al.
        Racial/ethnic differences in multiple-gene sequencing results for hereditary cancer risk.
        Genet Med. 2018; 20: 234-239https://doi.org/10.1038/gim.2017.96
        • Jones T.
        • Trivedi M.S.
        • Jiang X.
        • et al.
        Racial and ethnic differences in BRCA1/2 and multigene panel testing among young breast cancer patients.
        J Cancer Educ. 2021; 36: 463-469https://doi.org/10.1007/s13187-019-01646-8
        • Landry L.G.
        • Rehm H.L.
        Association of racial/ethnic categories with the ability of genetic tests to detect a cause of cardiomyopathy.
        JAMA Cardiol. 2018; 3: 341-345https://doi.org/10.1001/jamacardio.2017.5333
        • Stanislaw C.
        • Xue Y.
        • R Wilcox W
        Genetic evaluation and testing for hereditary forms of cancer in the era of next-generation sequencing.
        Cancer Biol Med. 2016; 13: 55-67https://doi.org/10.28092/j.issn.2095-3941.2016.0002
        • Samadder N.J.
        • Riegert-Johnson D.
        • Boardman L.
        • et al.
        Comparison of universal genetic testing vs guideline-directed targeted testing for patients with hereditary cancer syndrome.
        JAMA Oncol. 2021; 7 (Published correction appears in JAMA Oncol. 2020;7(2):31.): 230-237
        https://doi.org/10.1001/jamaoncol.2020.6252
        • Owens D.K.
        • Davidson K.W.
        • et al.
        • US Preventive Services Task Force
        Risk assessment, genetic counseling, and genetic testing for BRCA-related cancer: US Preventive Services Task Force recommendation statement.
        JAMA. 2019; 322 (Published correction appears in JAMA. 2019;322(18):1830.): 652-665
        https://doi.org/10.1001/jama.2019.10987