Multi-Institutional FASTQ File Exchange as a Means of Proficiency Testing for Next-Generation Sequencing Bioinformatics and Variant Interpretation

Kurtis D. Davies, Midhat S. Farooqi, Mike Gruidl, Charles E. Hill, Julie Woolworth-Hirschhorn, Heather Jones, Kenneth L. Jones, Anthony Magliocco, Midori Mitui, Philip H. O'Neill, Rebecca O'Rourke, Nirali M. Patel, Dahui Qin, Erica Ramos, Michael R. Rossi, Thomas M. Schneider, Geoffrey H. Smith, Linsheng Zhang, Jason Y. Park, Dara L. Aisner

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Next-generation sequencing is becoming increasingly common in clinical laboratories worldwide and is revolutionizing clinical molecular testing. However, the large amounts of raw data produced by next-generation sequencing assays and the need for complex bioinformatics analyses present unique challenges. Proficiency testing in clinical laboratories has traditionally been designed to evaluate assays in their entirety; however, it can be alternatively applied to separate assay components. We developed and implemented a multi-institutional proficiency testing approach to directly assess custom bioinformatics and variant interpretation processes. Six clinical laboratories, all of which use the same commercial library preparation kit for next-generation sequencing analysis of tumor specimens, each submitted raw data (FASTQ files) from four samples. These 24 file sets were then deidentified and redistributed to five of the institutions for analysis and interpretation according to their clinically validated approach. Among the laboratories, there was a high rate of concordance in the calling of single-nucleotide variants, in particular those we considered clinically significant (100% concordance). However, there was significant discordance in the calling of clinically significant insertions/deletions, with only two of seven being called by all participating laboratories. Missed calls were addressed by each laboratory to improve their bioinformatics processes. Thus, through our alternative proficiency testing approach, we identified the bioinformatic detection of insertions/deletions as an area of particular concern for clinical laboratories performing next-generation sequencing testing.

Original languageEnglish (US)
Pages (from-to)572-579
Number of pages8
JournalJournal of Molecular Diagnostics
Volume18
Issue number4
DOIs
StatePublished - Jul 1 2016

Fingerprint

Computational Biology
Information Storage and Retrieval
Libraries
Nucleotides
Neoplasms

ASJC Scopus subject areas

  • Pathology and Forensic Medicine
  • Molecular Medicine

Cite this

Multi-Institutional FASTQ File Exchange as a Means of Proficiency Testing for Next-Generation Sequencing Bioinformatics and Variant Interpretation. / Davies, Kurtis D.; Farooqi, Midhat S.; Gruidl, Mike; Hill, Charles E.; Woolworth-Hirschhorn, Julie; Jones, Heather; Jones, Kenneth L.; Magliocco, Anthony; Mitui, Midori; O'Neill, Philip H.; O'Rourke, Rebecca; Patel, Nirali M.; Qin, Dahui; Ramos, Erica; Rossi, Michael R.; Schneider, Thomas M.; Smith, Geoffrey H.; Zhang, Linsheng; Park, Jason Y.; Aisner, Dara L.

In: Journal of Molecular Diagnostics, Vol. 18, No. 4, 01.07.2016, p. 572-579.

Research output: Contribution to journalArticle

Davies, KD, Farooqi, MS, Gruidl, M, Hill, CE, Woolworth-Hirschhorn, J, Jones, H, Jones, KL, Magliocco, A, Mitui, M, O'Neill, PH, O'Rourke, R, Patel, NM, Qin, D, Ramos, E, Rossi, MR, Schneider, TM, Smith, GH, Zhang, L, Park, JY & Aisner, DL 2016, 'Multi-Institutional FASTQ File Exchange as a Means of Proficiency Testing for Next-Generation Sequencing Bioinformatics and Variant Interpretation', Journal of Molecular Diagnostics, vol. 18, no. 4, pp. 572-579. https://doi.org/10.1016/j.jmoldx.2016.03.002
Davies, Kurtis D. ; Farooqi, Midhat S. ; Gruidl, Mike ; Hill, Charles E. ; Woolworth-Hirschhorn, Julie ; Jones, Heather ; Jones, Kenneth L. ; Magliocco, Anthony ; Mitui, Midori ; O'Neill, Philip H. ; O'Rourke, Rebecca ; Patel, Nirali M. ; Qin, Dahui ; Ramos, Erica ; Rossi, Michael R. ; Schneider, Thomas M. ; Smith, Geoffrey H. ; Zhang, Linsheng ; Park, Jason Y. ; Aisner, Dara L. / Multi-Institutional FASTQ File Exchange as a Means of Proficiency Testing for Next-Generation Sequencing Bioinformatics and Variant Interpretation. In: Journal of Molecular Diagnostics. 2016 ; Vol. 18, No. 4. pp. 572-579.
@article{65efa26eb9534e0e860ee8414253d6c8,
title = "Multi-Institutional FASTQ File Exchange as a Means of Proficiency Testing for Next-Generation Sequencing Bioinformatics and Variant Interpretation",
abstract = "Next-generation sequencing is becoming increasingly common in clinical laboratories worldwide and is revolutionizing clinical molecular testing. However, the large amounts of raw data produced by next-generation sequencing assays and the need for complex bioinformatics analyses present unique challenges. Proficiency testing in clinical laboratories has traditionally been designed to evaluate assays in their entirety; however, it can be alternatively applied to separate assay components. We developed and implemented a multi-institutional proficiency testing approach to directly assess custom bioinformatics and variant interpretation processes. Six clinical laboratories, all of which use the same commercial library preparation kit for next-generation sequencing analysis of tumor specimens, each submitted raw data (FASTQ files) from four samples. These 24 file sets were then deidentified and redistributed to five of the institutions for analysis and interpretation according to their clinically validated approach. Among the laboratories, there was a high rate of concordance in the calling of single-nucleotide variants, in particular those we considered clinically significant (100{\%} concordance). However, there was significant discordance in the calling of clinically significant insertions/deletions, with only two of seven being called by all participating laboratories. Missed calls were addressed by each laboratory to improve their bioinformatics processes. Thus, through our alternative proficiency testing approach, we identified the bioinformatic detection of insertions/deletions as an area of particular concern for clinical laboratories performing next-generation sequencing testing.",
author = "Davies, {Kurtis D.} and Farooqi, {Midhat S.} and Mike Gruidl and Hill, {Charles E.} and Julie Woolworth-Hirschhorn and Heather Jones and Jones, {Kenneth L.} and Anthony Magliocco and Midori Mitui and O'Neill, {Philip H.} and Rebecca O'Rourke and Patel, {Nirali M.} and Dahui Qin and Erica Ramos and Rossi, {Michael R.} and Schneider, {Thomas M.} and Smith, {Geoffrey H.} and Linsheng Zhang and Park, {Jason Y.} and Aisner, {Dara L.}",
year = "2016",
month = "7",
day = "1",
doi = "10.1016/j.jmoldx.2016.03.002",
language = "English (US)",
volume = "18",
pages = "572--579",
journal = "Journal of Molecular Diagnostics",
issn = "1525-1578",
publisher = "Association of Molecular Pathology",
number = "4",

}

TY - JOUR

T1 - Multi-Institutional FASTQ File Exchange as a Means of Proficiency Testing for Next-Generation Sequencing Bioinformatics and Variant Interpretation

AU - Davies, Kurtis D.

AU - Farooqi, Midhat S.

AU - Gruidl, Mike

AU - Hill, Charles E.

AU - Woolworth-Hirschhorn, Julie

AU - Jones, Heather

AU - Jones, Kenneth L.

AU - Magliocco, Anthony

AU - Mitui, Midori

AU - O'Neill, Philip H.

AU - O'Rourke, Rebecca

AU - Patel, Nirali M.

AU - Qin, Dahui

AU - Ramos, Erica

AU - Rossi, Michael R.

AU - Schneider, Thomas M.

AU - Smith, Geoffrey H.

AU - Zhang, Linsheng

AU - Park, Jason Y.

AU - Aisner, Dara L.

PY - 2016/7/1

Y1 - 2016/7/1

N2 - Next-generation sequencing is becoming increasingly common in clinical laboratories worldwide and is revolutionizing clinical molecular testing. However, the large amounts of raw data produced by next-generation sequencing assays and the need for complex bioinformatics analyses present unique challenges. Proficiency testing in clinical laboratories has traditionally been designed to evaluate assays in their entirety; however, it can be alternatively applied to separate assay components. We developed and implemented a multi-institutional proficiency testing approach to directly assess custom bioinformatics and variant interpretation processes. Six clinical laboratories, all of which use the same commercial library preparation kit for next-generation sequencing analysis of tumor specimens, each submitted raw data (FASTQ files) from four samples. These 24 file sets were then deidentified and redistributed to five of the institutions for analysis and interpretation according to their clinically validated approach. Among the laboratories, there was a high rate of concordance in the calling of single-nucleotide variants, in particular those we considered clinically significant (100% concordance). However, there was significant discordance in the calling of clinically significant insertions/deletions, with only two of seven being called by all participating laboratories. Missed calls were addressed by each laboratory to improve their bioinformatics processes. Thus, through our alternative proficiency testing approach, we identified the bioinformatic detection of insertions/deletions as an area of particular concern for clinical laboratories performing next-generation sequencing testing.

AB - Next-generation sequencing is becoming increasingly common in clinical laboratories worldwide and is revolutionizing clinical molecular testing. However, the large amounts of raw data produced by next-generation sequencing assays and the need for complex bioinformatics analyses present unique challenges. Proficiency testing in clinical laboratories has traditionally been designed to evaluate assays in their entirety; however, it can be alternatively applied to separate assay components. We developed and implemented a multi-institutional proficiency testing approach to directly assess custom bioinformatics and variant interpretation processes. Six clinical laboratories, all of which use the same commercial library preparation kit for next-generation sequencing analysis of tumor specimens, each submitted raw data (FASTQ files) from four samples. These 24 file sets were then deidentified and redistributed to five of the institutions for analysis and interpretation according to their clinically validated approach. Among the laboratories, there was a high rate of concordance in the calling of single-nucleotide variants, in particular those we considered clinically significant (100% concordance). However, there was significant discordance in the calling of clinically significant insertions/deletions, with only two of seven being called by all participating laboratories. Missed calls were addressed by each laboratory to improve their bioinformatics processes. Thus, through our alternative proficiency testing approach, we identified the bioinformatic detection of insertions/deletions as an area of particular concern for clinical laboratories performing next-generation sequencing testing.

UR - http://www.scopus.com/inward/record.url?scp=84992036355&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84992036355&partnerID=8YFLogxK

U2 - 10.1016/j.jmoldx.2016.03.002

DO - 10.1016/j.jmoldx.2016.03.002

M3 - Article

C2 - 27155050

AN - SCOPUS:84992036355

VL - 18

SP - 572

EP - 579

JO - Journal of Molecular Diagnostics

JF - Journal of Molecular Diagnostics

SN - 1525-1578

IS - 4

ER -