CASP9 assessment of free modeling target predictions

Lisa Kinch, Shuo Yong Shi, Qian Cong, Hua Cheng, Yuxing Liao, Nick V. Grishin

Research output: Contribution to journalArticle

70 Citations (Scopus)

Abstract

We present an overview of the ninth round of Critical Assessment of Protein Structure Prediction (CASP9) "Template free modeling" category (FM). Prediction models were evaluated using a combination of established structural and sequence comparison measures and a novel automated method designed to mimic manual inspection by capturing both global and local structural features. These scores were compared to those assigned manually over a diverse subset of target domains. Scores were combined to compare overall performance of participating groups and to estimate rank significance. Moreover, we discuss a few examples of free modeling targets to highlight the progress and bottlenecks of current prediction methods. Notably, a server prediction model for a single target (T0581) improved significantly over the closest structure template (44% GDT increase). This accomplishment represents the "winner" of the CASP9 FM category. A number of human expert groups submitted slight variations of this model, highlighting a trend for human experts to act as "meta predictors" by correctly selecting among models produced by the top-performing automated servers. The details of evaluation are available at.

Original languageEnglish (US)
Pages (from-to)59-73
Number of pages15
JournalProteins: Structure, Function and Bioinformatics
Volume79
Issue numberSUPPL. 10
DOIs
StatePublished - 2011

Fingerprint

Servers
Proteins
Inspection

Keywords

  • ab-initio
  • Alignment quality
  • CASP9
  • Domain structure
  • Protein-fold prediction
  • Structure comparison

ASJC Scopus subject areas

  • Biochemistry
  • Structural Biology
  • Molecular Biology

Cite this

CASP9 assessment of free modeling target predictions. / Kinch, Lisa; Yong Shi, Shuo; Cong, Qian; Cheng, Hua; Liao, Yuxing; Grishin, Nick V.

In: Proteins: Structure, Function and Bioinformatics, Vol. 79, No. SUPPL. 10, 2011, p. 59-73.

Research output: Contribution to journalArticle

Kinch, Lisa ; Yong Shi, Shuo ; Cong, Qian ; Cheng, Hua ; Liao, Yuxing ; Grishin, Nick V. / CASP9 assessment of free modeling target predictions. In: Proteins: Structure, Function and Bioinformatics. 2011 ; Vol. 79, No. SUPPL. 10. pp. 59-73.
@article{6fd7d66234a14377a3bc283bb6ac6e04,
title = "CASP9 assessment of free modeling target predictions",
abstract = "We present an overview of the ninth round of Critical Assessment of Protein Structure Prediction (CASP9) {"}Template free modeling{"} category (FM). Prediction models were evaluated using a combination of established structural and sequence comparison measures and a novel automated method designed to mimic manual inspection by capturing both global and local structural features. These scores were compared to those assigned manually over a diverse subset of target domains. Scores were combined to compare overall performance of participating groups and to estimate rank significance. Moreover, we discuss a few examples of free modeling targets to highlight the progress and bottlenecks of current prediction methods. Notably, a server prediction model for a single target (T0581) improved significantly over the closest structure template (44{\%} GDT increase). This accomplishment represents the {"}winner{"} of the CASP9 FM category. A number of human expert groups submitted slight variations of this model, highlighting a trend for human experts to act as {"}meta predictors{"} by correctly selecting among models produced by the top-performing automated servers. The details of evaluation are available at.",
keywords = "ab-initio, Alignment quality, CASP9, Domain structure, Protein-fold prediction, Structure comparison",
author = "Lisa Kinch and {Yong Shi}, Shuo and Qian Cong and Hua Cheng and Yuxing Liao and Grishin, {Nick V.}",
year = "2011",
doi = "10.1002/prot.23181",
language = "English (US)",
volume = "79",
pages = "59--73",
journal = "Proteins: Structure, Function and Bioinformatics",
issn = "0887-3585",
publisher = "Wiley-Liss Inc.",
number = "SUPPL. 10",

}

TY - JOUR

T1 - CASP9 assessment of free modeling target predictions

AU - Kinch, Lisa

AU - Yong Shi, Shuo

AU - Cong, Qian

AU - Cheng, Hua

AU - Liao, Yuxing

AU - Grishin, Nick V.

PY - 2011

Y1 - 2011

N2 - We present an overview of the ninth round of Critical Assessment of Protein Structure Prediction (CASP9) "Template free modeling" category (FM). Prediction models were evaluated using a combination of established structural and sequence comparison measures and a novel automated method designed to mimic manual inspection by capturing both global and local structural features. These scores were compared to those assigned manually over a diverse subset of target domains. Scores were combined to compare overall performance of participating groups and to estimate rank significance. Moreover, we discuss a few examples of free modeling targets to highlight the progress and bottlenecks of current prediction methods. Notably, a server prediction model for a single target (T0581) improved significantly over the closest structure template (44% GDT increase). This accomplishment represents the "winner" of the CASP9 FM category. A number of human expert groups submitted slight variations of this model, highlighting a trend for human experts to act as "meta predictors" by correctly selecting among models produced by the top-performing automated servers. The details of evaluation are available at.

AB - We present an overview of the ninth round of Critical Assessment of Protein Structure Prediction (CASP9) "Template free modeling" category (FM). Prediction models were evaluated using a combination of established structural and sequence comparison measures and a novel automated method designed to mimic manual inspection by capturing both global and local structural features. These scores were compared to those assigned manually over a diverse subset of target domains. Scores were combined to compare overall performance of participating groups and to estimate rank significance. Moreover, we discuss a few examples of free modeling targets to highlight the progress and bottlenecks of current prediction methods. Notably, a server prediction model for a single target (T0581) improved significantly over the closest structure template (44% GDT increase). This accomplishment represents the "winner" of the CASP9 FM category. A number of human expert groups submitted slight variations of this model, highlighting a trend for human experts to act as "meta predictors" by correctly selecting among models produced by the top-performing automated servers. The details of evaluation are available at.

KW - ab-initio

KW - Alignment quality

KW - CASP9

KW - Domain structure

KW - Protein-fold prediction

KW - Structure comparison

UR - http://www.scopus.com/inward/record.url?scp=80855133462&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80855133462&partnerID=8YFLogxK

U2 - 10.1002/prot.23181

DO - 10.1002/prot.23181

M3 - Article

VL - 79

SP - 59

EP - 73

JO - Proteins: Structure, Function and Bioinformatics

JF - Proteins: Structure, Function and Bioinformatics

SN - 0887-3585

IS - SUPPL. 10

ER -