Significance testing as perverse probabilistic reasoning

M. Brandon Westover, Kenneth D. Westover, Matt T. Bianchi

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

Truth claims in the medical literature rely heavily on statistical significance testing. Unfortunately, most physicians misunderstand the underlying probabilistic logic of significance tests and consequently often misinterpret their results. This near-universal misunderstanding is highlighted by means of a simple quiz which we administered to 246 physicians at two major academic hospitals, on which the proportion of incorrect responses exceeded 90%. A solid understanding of the fundamental concepts of probability theory is becoming essential to the rational interpretation of medical information. This essay provides a technically sound review of these concepts that is accessible to a medical audience. We also briefly review the debate in the cognitive sciences regarding physicians' aptitude for probabilistic inference.

Original languageEnglish (US)
Article number20
JournalBMC Medicine
Volume9
DOIs
StatePublished - Feb 28 2011

Fingerprint

Physicians
Probability Theory
Cognitive Science
Aptitude

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Significance testing as perverse probabilistic reasoning. / Westover, M. Brandon; Westover, Kenneth D.; Bianchi, Matt T.

In: BMC Medicine, Vol. 9, 20, 28.02.2011.

Research output: Contribution to journalArticle

Westover, M. Brandon ; Westover, Kenneth D. ; Bianchi, Matt T. / Significance testing as perverse probabilistic reasoning. In: BMC Medicine. 2011 ; Vol. 9.
@article{a58f0648b0ba4ea9b1cf28945ba4c1ff,
title = "Significance testing as perverse probabilistic reasoning",
abstract = "Truth claims in the medical literature rely heavily on statistical significance testing. Unfortunately, most physicians misunderstand the underlying probabilistic logic of significance tests and consequently often misinterpret their results. This near-universal misunderstanding is highlighted by means of a simple quiz which we administered to 246 physicians at two major academic hospitals, on which the proportion of incorrect responses exceeded 90{\%}. A solid understanding of the fundamental concepts of probability theory is becoming essential to the rational interpretation of medical information. This essay provides a technically sound review of these concepts that is accessible to a medical audience. We also briefly review the debate in the cognitive sciences regarding physicians' aptitude for probabilistic inference.",
author = "Westover, {M. Brandon} and Westover, {Kenneth D.} and Bianchi, {Matt T.}",
year = "2011",
month = "2",
day = "28",
doi = "10.1186/1741-7015-9-20",
language = "English (US)",
volume = "9",
journal = "BMC Medicine",
issn = "1741-7015",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Significance testing as perverse probabilistic reasoning

AU - Westover, M. Brandon

AU - Westover, Kenneth D.

AU - Bianchi, Matt T.

PY - 2011/2/28

Y1 - 2011/2/28

N2 - Truth claims in the medical literature rely heavily on statistical significance testing. Unfortunately, most physicians misunderstand the underlying probabilistic logic of significance tests and consequently often misinterpret their results. This near-universal misunderstanding is highlighted by means of a simple quiz which we administered to 246 physicians at two major academic hospitals, on which the proportion of incorrect responses exceeded 90%. A solid understanding of the fundamental concepts of probability theory is becoming essential to the rational interpretation of medical information. This essay provides a technically sound review of these concepts that is accessible to a medical audience. We also briefly review the debate in the cognitive sciences regarding physicians' aptitude for probabilistic inference.

AB - Truth claims in the medical literature rely heavily on statistical significance testing. Unfortunately, most physicians misunderstand the underlying probabilistic logic of significance tests and consequently often misinterpret their results. This near-universal misunderstanding is highlighted by means of a simple quiz which we administered to 246 physicians at two major academic hospitals, on which the proportion of incorrect responses exceeded 90%. A solid understanding of the fundamental concepts of probability theory is becoming essential to the rational interpretation of medical information. This essay provides a technically sound review of these concepts that is accessible to a medical audience. We also briefly review the debate in the cognitive sciences regarding physicians' aptitude for probabilistic inference.

UR - http://www.scopus.com/inward/record.url?scp=79952047808&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952047808&partnerID=8YFLogxK

U2 - 10.1186/1741-7015-9-20

DO - 10.1186/1741-7015-9-20

M3 - Article

C2 - 21356064

AN - SCOPUS:79952047808

VL - 9

JO - BMC Medicine

JF - BMC Medicine

SN - 1741-7015

M1 - 20

ER -