Experimental design issues in clinical research of musculoskeletal pain disabilities

Robert J. Gatchel, Matt Maddrey

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

The purpose of the present article is to provide a basic overview of important experimental design and statistical analysis issues/concepts that require the attention of clinical researchers in the area of musculoskeletal disorders who attempt to demonstrate the effectiveness of a particular treatment modality. We begin with a discussion of important design issues in clinical treatment-outcome research, specifically those related to internal validity, external validity, and statistical conclusion validity (which involves concepts such as statistical power, assumptions of statistical tests, error rates of a statistical test, the operationalization of the key outcome measures, and the reliability of such outcome measures). We next discuss the importance of attempting to conduct the highest quality type of clinical outcome study to infer cause-effect relationships - the randomized controlled trial (RCT). Even though an RCT is often viewed as an important benchmark to use in considering the validity of treatment-outcome results, we also point out that RCTs can vary greatly in the degree of internal and external validity that may make them less than 'perfect' in nature. Fortunately, there are a host of other experimental designs that may be appropriately employed that can yield important scientific data to help in delineating cause-effect relationships (so-called quasi-experimental designs). A hierarchy of experimental designs is also presented in a descending order of rigor: the controlled group outcome study; the single-subject experiment and replicated single-subject experiments; the single-group outcome study; the systematic case study; and the anecdotal case report. We also review useful 'alternative' quantitative and qualitative methods for clinical outcome research that can be used when there are problems encountered with conventional research methodology. Finally, the use of meta-analysis techniques is reviewed as a means of coming up with a concordant summary statistic of effect size across many different experiments.

Original languageEnglish (US)
Pages (from-to)91-101
Number of pages11
JournalCritical Reviews in Physical and Rehabilitation Medicine
Volume12
Issue number2
StatePublished - 2000

Fingerprint

Musculoskeletal Pain
Research Design
Outcome Assessment (Health Care)
Research
Randomized Controlled Trials
Benchmarking
Meta-Analysis
Research Personnel

Keywords

  • External validity
  • Internal validity
  • Meta-analysis
  • Occupational musculoskeletal disorders
  • Quasi-experimental approach
  • Randomized controlled trial
  • Statistical conclusion validity
  • Statistical power
  • Type I error

ASJC Scopus subject areas

  • Rehabilitation

Cite this

Experimental design issues in clinical research of musculoskeletal pain disabilities. / Gatchel, Robert J.; Maddrey, Matt.

In: Critical Reviews in Physical and Rehabilitation Medicine, Vol. 12, No. 2, 2000, p. 91-101.

Research output: Contribution to journalArticle

@article{1e453850ca004f7c8aade1c36fcf8a41,
title = "Experimental design issues in clinical research of musculoskeletal pain disabilities",
abstract = "The purpose of the present article is to provide a basic overview of important experimental design and statistical analysis issues/concepts that require the attention of clinical researchers in the area of musculoskeletal disorders who attempt to demonstrate the effectiveness of a particular treatment modality. We begin with a discussion of important design issues in clinical treatment-outcome research, specifically those related to internal validity, external validity, and statistical conclusion validity (which involves concepts such as statistical power, assumptions of statistical tests, error rates of a statistical test, the operationalization of the key outcome measures, and the reliability of such outcome measures). We next discuss the importance of attempting to conduct the highest quality type of clinical outcome study to infer cause-effect relationships - the randomized controlled trial (RCT). Even though an RCT is often viewed as an important benchmark to use in considering the validity of treatment-outcome results, we also point out that RCTs can vary greatly in the degree of internal and external validity that may make them less than 'perfect' in nature. Fortunately, there are a host of other experimental designs that may be appropriately employed that can yield important scientific data to help in delineating cause-effect relationships (so-called quasi-experimental designs). A hierarchy of experimental designs is also presented in a descending order of rigor: the controlled group outcome study; the single-subject experiment and replicated single-subject experiments; the single-group outcome study; the systematic case study; and the anecdotal case report. We also review useful 'alternative' quantitative and qualitative methods for clinical outcome research that can be used when there are problems encountered with conventional research methodology. Finally, the use of meta-analysis techniques is reviewed as a means of coming up with a concordant summary statistic of effect size across many different experiments.",
keywords = "External validity, Internal validity, Meta-analysis, Occupational musculoskeletal disorders, Quasi-experimental approach, Randomized controlled trial, Statistical conclusion validity, Statistical power, Type I error",
author = "Gatchel, {Robert J.} and Matt Maddrey",
year = "2000",
language = "English (US)",
volume = "12",
pages = "91--101",
journal = "Critical Reviews in Physical and Rehabilitation Medicine",
issn = "0896-2960",
publisher = "Begell House Inc.",
number = "2",

}

TY - JOUR

T1 - Experimental design issues in clinical research of musculoskeletal pain disabilities

AU - Gatchel, Robert J.

AU - Maddrey, Matt

PY - 2000

Y1 - 2000

N2 - The purpose of the present article is to provide a basic overview of important experimental design and statistical analysis issues/concepts that require the attention of clinical researchers in the area of musculoskeletal disorders who attempt to demonstrate the effectiveness of a particular treatment modality. We begin with a discussion of important design issues in clinical treatment-outcome research, specifically those related to internal validity, external validity, and statistical conclusion validity (which involves concepts such as statistical power, assumptions of statistical tests, error rates of a statistical test, the operationalization of the key outcome measures, and the reliability of such outcome measures). We next discuss the importance of attempting to conduct the highest quality type of clinical outcome study to infer cause-effect relationships - the randomized controlled trial (RCT). Even though an RCT is often viewed as an important benchmark to use in considering the validity of treatment-outcome results, we also point out that RCTs can vary greatly in the degree of internal and external validity that may make them less than 'perfect' in nature. Fortunately, there are a host of other experimental designs that may be appropriately employed that can yield important scientific data to help in delineating cause-effect relationships (so-called quasi-experimental designs). A hierarchy of experimental designs is also presented in a descending order of rigor: the controlled group outcome study; the single-subject experiment and replicated single-subject experiments; the single-group outcome study; the systematic case study; and the anecdotal case report. We also review useful 'alternative' quantitative and qualitative methods for clinical outcome research that can be used when there are problems encountered with conventional research methodology. Finally, the use of meta-analysis techniques is reviewed as a means of coming up with a concordant summary statistic of effect size across many different experiments.

AB - The purpose of the present article is to provide a basic overview of important experimental design and statistical analysis issues/concepts that require the attention of clinical researchers in the area of musculoskeletal disorders who attempt to demonstrate the effectiveness of a particular treatment modality. We begin with a discussion of important design issues in clinical treatment-outcome research, specifically those related to internal validity, external validity, and statistical conclusion validity (which involves concepts such as statistical power, assumptions of statistical tests, error rates of a statistical test, the operationalization of the key outcome measures, and the reliability of such outcome measures). We next discuss the importance of attempting to conduct the highest quality type of clinical outcome study to infer cause-effect relationships - the randomized controlled trial (RCT). Even though an RCT is often viewed as an important benchmark to use in considering the validity of treatment-outcome results, we also point out that RCTs can vary greatly in the degree of internal and external validity that may make them less than 'perfect' in nature. Fortunately, there are a host of other experimental designs that may be appropriately employed that can yield important scientific data to help in delineating cause-effect relationships (so-called quasi-experimental designs). A hierarchy of experimental designs is also presented in a descending order of rigor: the controlled group outcome study; the single-subject experiment and replicated single-subject experiments; the single-group outcome study; the systematic case study; and the anecdotal case report. We also review useful 'alternative' quantitative and qualitative methods for clinical outcome research that can be used when there are problems encountered with conventional research methodology. Finally, the use of meta-analysis techniques is reviewed as a means of coming up with a concordant summary statistic of effect size across many different experiments.

KW - External validity

KW - Internal validity

KW - Meta-analysis

KW - Occupational musculoskeletal disorders

KW - Quasi-experimental approach

KW - Randomized controlled trial

KW - Statistical conclusion validity

KW - Statistical power

KW - Type I error

UR - http://www.scopus.com/inward/record.url?scp=0033797676&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033797676&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0033797676

VL - 12

SP - 91

EP - 101

JO - Critical Reviews in Physical and Rehabilitation Medicine

JF - Critical Reviews in Physical and Rehabilitation Medicine

SN - 0896-2960

IS - 2

ER -