Is Double-Blinded Peer Review Necessary? the Effect of Blinding on Review Quality

Kevin C. Chung, Melissa J. Shauver, Sunitha Malay, Lin Zhong, Aaron Weinstein, Rod J. Rohrich

Research output: Contribution to journalArticle

13 Scopus citations

Abstract

Background: The review process can be completely open, double-blinded, or somewhere in between. Double-blinded peer review, where neither the authors' nor peer reviewers' identities are shared with each other, is thought to be the fairest system, but there is evidence that it does not affect reviewer behavior or influence decisions. Furthermore, even without presenting author names, authorship is often apparent to reviewers, especially in small specialties. In conjunction with Plastic and Reconstructive Surgery (PRS), the authors examined the effect of double-blinded review on review quality, reviewer publishing recommendation, and reviewer manuscript rating. The authors hypothesized that double-blinded review will not improve review quality and will not affect recommendation or rating. Methods: Traditionally, PRS peer review has been conducted in a single-blinded fashion. During a 3-month period of standard operation of the Journal, the authors examined reviews, recommendations, and manuscript ratings. Beginning October 1, 2014, PRS started conducting reviews in a double-blinded manner. The authors examined the additional reviews submitted during a 3-month period after the change. Review quality was assessed using the validated Review Quality Instrument. Results: Double-blinding had no effect on reviewer publishing recommendation or manuscript ranking. Review quality did not improve after the implementation of double-blinded review. Blinding was successful 66 percent of the time. The most common reasons for blinding failure were reviewer familiarity with authors' work and author self-citation. Conclusions: Double-blinding adds considerable work for authors and editorial staff and has no positive effect on review quality. Furthermore, the authors' results revealed no publication bias based on author identity at PRS.

Original languageEnglish (US)
Pages (from-to)1369-1377
Number of pages9
JournalPlastic and Reconstructive Surgery
Volume136
Issue number6
DOIs
Publication statusPublished - Dec 1 2015

    Fingerprint

ASJC Scopus subject areas

  • Surgery

Cite this

Chung, K. C., Shauver, M. J., Malay, S., Zhong, L., Weinstein, A., & Rohrich, R. J. (2015). Is Double-Blinded Peer Review Necessary? the Effect of Blinding on Review Quality. Plastic and Reconstructive Surgery, 136(6), 1369-1377. https://doi.org/10.1097/PRS.0000000000001820