Reliability and convergent validity of two outcome instruments for pemphigus

Misha Rosenbach, Dedee F. Murrell, Jean Claude Bystryn, Sam Dulay, Sarah Dick, Steve Fakharzadeh, Russell Hall, Neil J. Korman, Julie Lin, Joyce Okawa, Amit G. Pandya, Aimee S. Payne, Mathew Rose, David Rubenstein, David Woodley, Carmela Vittorio, Benjamin B. Werth, Erik A. Williams, Lynne Taylor, Andrea B. Troxel & 1 others Victoria P. Werth

Research output: Contribution to journalArticle

124 Citations (Scopus)

Abstract

A major obstacle in performing multicenter controlled trials for pemphigus is the lack of a validated disease activity scoring system. Here, we assess the reliability and convergent validity of the PDAI (pemphigus disease area index). A group of 10 dermatologists scored 15 patients with pemphigus to estimate the inter- and intra-rater reliability of the PDAI and the recently described ABSIS (autoimmune bullous skin disorder intensity score) instrument. To assess convergent validity, these tools were also correlated with the Physician's Global Assessment (PGA). Reliability studies demonstrated an intra-class correlation coefficient (ICC) for inter-rater reliability of 0.76 (95% confirdence interval (CI)0.61-0.91) for the PDAI and 0.77 (0.63-0.91) for the ABSIS. The tools differed most in reliability of assessing skin activity, with an ICC of 0.39 (0.17-0.60) for the ABSIS and 0.86 (0.76-0.95) for the PDAI. Intra-rater test-retest reliability demonstrated an ICC of 0.98 (0.96-1.0) for the PDAI and 0.80 (0.65-0.96) for the ABSIS. The PDAI also correlated more closely with the PGA. We conclude that the PDAI is more reproducible and correlates better with physician impression of extent. Subset analysis suggests that for this population of mild-to-moderate disease activity, the PDAI captures more variability in cutaneous disease than the ABSIS.

Original languageEnglish (US)
Pages (from-to)2404-2410
Number of pages7
JournalJournal of Investigative Dermatology
Volume129
Issue number10
DOIs
StatePublished - Oct 2009

Fingerprint

Pemphigus
Reproducibility of Results
Skin
Physicians
Skin Diseases
Multicenter Studies

ASJC Scopus subject areas

  • Dermatology
  • Biochemistry
  • Cell Biology
  • Molecular Biology

Cite this

Rosenbach, M., Murrell, D. F., Bystryn, J. C., Dulay, S., Dick, S., Fakharzadeh, S., ... Werth, V. P. (2009). Reliability and convergent validity of two outcome instruments for pemphigus. Journal of Investigative Dermatology, 129(10), 2404-2410. https://doi.org/10.1038/jid.2009.72

Reliability and convergent validity of two outcome instruments for pemphigus. / Rosenbach, Misha; Murrell, Dedee F.; Bystryn, Jean Claude; Dulay, Sam; Dick, Sarah; Fakharzadeh, Steve; Hall, Russell; Korman, Neil J.; Lin, Julie; Okawa, Joyce; Pandya, Amit G.; Payne, Aimee S.; Rose, Mathew; Rubenstein, David; Woodley, David; Vittorio, Carmela; Werth, Benjamin B.; Williams, Erik A.; Taylor, Lynne; Troxel, Andrea B.; Werth, Victoria P.

In: Journal of Investigative Dermatology, Vol. 129, No. 10, 10.2009, p. 2404-2410.

Research output: Contribution to journalArticle

Rosenbach, M, Murrell, DF, Bystryn, JC, Dulay, S, Dick, S, Fakharzadeh, S, Hall, R, Korman, NJ, Lin, J, Okawa, J, Pandya, AG, Payne, AS, Rose, M, Rubenstein, D, Woodley, D, Vittorio, C, Werth, BB, Williams, EA, Taylor, L, Troxel, AB & Werth, VP 2009, 'Reliability and convergent validity of two outcome instruments for pemphigus', Journal of Investigative Dermatology, vol. 129, no. 10, pp. 2404-2410. https://doi.org/10.1038/jid.2009.72
Rosenbach M, Murrell DF, Bystryn JC, Dulay S, Dick S, Fakharzadeh S et al. Reliability and convergent validity of two outcome instruments for pemphigus. Journal of Investigative Dermatology. 2009 Oct;129(10):2404-2410. https://doi.org/10.1038/jid.2009.72
Rosenbach, Misha ; Murrell, Dedee F. ; Bystryn, Jean Claude ; Dulay, Sam ; Dick, Sarah ; Fakharzadeh, Steve ; Hall, Russell ; Korman, Neil J. ; Lin, Julie ; Okawa, Joyce ; Pandya, Amit G. ; Payne, Aimee S. ; Rose, Mathew ; Rubenstein, David ; Woodley, David ; Vittorio, Carmela ; Werth, Benjamin B. ; Williams, Erik A. ; Taylor, Lynne ; Troxel, Andrea B. ; Werth, Victoria P. / Reliability and convergent validity of two outcome instruments for pemphigus. In: Journal of Investigative Dermatology. 2009 ; Vol. 129, No. 10. pp. 2404-2410.
@article{bd70ac5a06ad47e28eb7065584426031,
title = "Reliability and convergent validity of two outcome instruments for pemphigus",
abstract = "A major obstacle in performing multicenter controlled trials for pemphigus is the lack of a validated disease activity scoring system. Here, we assess the reliability and convergent validity of the PDAI (pemphigus disease area index). A group of 10 dermatologists scored 15 patients with pemphigus to estimate the inter- and intra-rater reliability of the PDAI and the recently described ABSIS (autoimmune bullous skin disorder intensity score) instrument. To assess convergent validity, these tools were also correlated with the Physician's Global Assessment (PGA). Reliability studies demonstrated an intra-class correlation coefficient (ICC) for inter-rater reliability of 0.76 (95{\%} confirdence interval (CI)0.61-0.91) for the PDAI and 0.77 (0.63-0.91) for the ABSIS. The tools differed most in reliability of assessing skin activity, with an ICC of 0.39 (0.17-0.60) for the ABSIS and 0.86 (0.76-0.95) for the PDAI. Intra-rater test-retest reliability demonstrated an ICC of 0.98 (0.96-1.0) for the PDAI and 0.80 (0.65-0.96) for the ABSIS. The PDAI also correlated more closely with the PGA. We conclude that the PDAI is more reproducible and correlates better with physician impression of extent. Subset analysis suggests that for this population of mild-to-moderate disease activity, the PDAI captures more variability in cutaneous disease than the ABSIS.",
author = "Misha Rosenbach and Murrell, {Dedee F.} and Bystryn, {Jean Claude} and Sam Dulay and Sarah Dick and Steve Fakharzadeh and Russell Hall and Korman, {Neil J.} and Julie Lin and Joyce Okawa and Pandya, {Amit G.} and Payne, {Aimee S.} and Mathew Rose and David Rubenstein and David Woodley and Carmela Vittorio and Werth, {Benjamin B.} and Williams, {Erik A.} and Lynne Taylor and Troxel, {Andrea B.} and Werth, {Victoria P.}",
year = "2009",
month = "10",
doi = "10.1038/jid.2009.72",
language = "English (US)",
volume = "129",
pages = "2404--2410",
journal = "Journal of Investigative Dermatology",
issn = "0022-202X",
publisher = "Nature Publishing Group",
number = "10",

}

TY - JOUR

T1 - Reliability and convergent validity of two outcome instruments for pemphigus

AU - Rosenbach, Misha

AU - Murrell, Dedee F.

AU - Bystryn, Jean Claude

AU - Dulay, Sam

AU - Dick, Sarah

AU - Fakharzadeh, Steve

AU - Hall, Russell

AU - Korman, Neil J.

AU - Lin, Julie

AU - Okawa, Joyce

AU - Pandya, Amit G.

AU - Payne, Aimee S.

AU - Rose, Mathew

AU - Rubenstein, David

AU - Woodley, David

AU - Vittorio, Carmela

AU - Werth, Benjamin B.

AU - Williams, Erik A.

AU - Taylor, Lynne

AU - Troxel, Andrea B.

AU - Werth, Victoria P.

PY - 2009/10

Y1 - 2009/10

N2 - A major obstacle in performing multicenter controlled trials for pemphigus is the lack of a validated disease activity scoring system. Here, we assess the reliability and convergent validity of the PDAI (pemphigus disease area index). A group of 10 dermatologists scored 15 patients with pemphigus to estimate the inter- and intra-rater reliability of the PDAI and the recently described ABSIS (autoimmune bullous skin disorder intensity score) instrument. To assess convergent validity, these tools were also correlated with the Physician's Global Assessment (PGA). Reliability studies demonstrated an intra-class correlation coefficient (ICC) for inter-rater reliability of 0.76 (95% confirdence interval (CI)0.61-0.91) for the PDAI and 0.77 (0.63-0.91) for the ABSIS. The tools differed most in reliability of assessing skin activity, with an ICC of 0.39 (0.17-0.60) for the ABSIS and 0.86 (0.76-0.95) for the PDAI. Intra-rater test-retest reliability demonstrated an ICC of 0.98 (0.96-1.0) for the PDAI and 0.80 (0.65-0.96) for the ABSIS. The PDAI also correlated more closely with the PGA. We conclude that the PDAI is more reproducible and correlates better with physician impression of extent. Subset analysis suggests that for this population of mild-to-moderate disease activity, the PDAI captures more variability in cutaneous disease than the ABSIS.

AB - A major obstacle in performing multicenter controlled trials for pemphigus is the lack of a validated disease activity scoring system. Here, we assess the reliability and convergent validity of the PDAI (pemphigus disease area index). A group of 10 dermatologists scored 15 patients with pemphigus to estimate the inter- and intra-rater reliability of the PDAI and the recently described ABSIS (autoimmune bullous skin disorder intensity score) instrument. To assess convergent validity, these tools were also correlated with the Physician's Global Assessment (PGA). Reliability studies demonstrated an intra-class correlation coefficient (ICC) for inter-rater reliability of 0.76 (95% confirdence interval (CI)0.61-0.91) for the PDAI and 0.77 (0.63-0.91) for the ABSIS. The tools differed most in reliability of assessing skin activity, with an ICC of 0.39 (0.17-0.60) for the ABSIS and 0.86 (0.76-0.95) for the PDAI. Intra-rater test-retest reliability demonstrated an ICC of 0.98 (0.96-1.0) for the PDAI and 0.80 (0.65-0.96) for the ABSIS. The PDAI also correlated more closely with the PGA. We conclude that the PDAI is more reproducible and correlates better with physician impression of extent. Subset analysis suggests that for this population of mild-to-moderate disease activity, the PDAI captures more variability in cutaneous disease than the ABSIS.

UR - http://www.scopus.com/inward/record.url?scp=70349146310&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349146310&partnerID=8YFLogxK

U2 - 10.1038/jid.2009.72

DO - 10.1038/jid.2009.72

M3 - Article

VL - 129

SP - 2404

EP - 2410

JO - Journal of Investigative Dermatology

JF - Journal of Investigative Dermatology

SN - 0022-202X

IS - 10

ER -