Internal consistency: Reports of its death are premature

Ronald R. Holden, Ira H. Bernstein

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

McCrae, Kurtz, Yamagata, and Terracciano (Personality and Social Psychology Review 15:28-50, 2011) presented data supporting the position that test-retest reliability is more important for methods of personality assessment than is internal-consistency reliability. We raise two points not adequately considered in their findings. First, not all personality assessment is concerned with assessing traits, for which temporal stability is clearly important. Much research (e.g., therapy outcome studies) is concerned with assessing states, in which an emphasis on temporal stability can lead to the underestimation of change. Second, we suggest that using the literature as a basis for their position causes the role of internal consistency to be underestimated. This is because manuscripts are frequently rejected because their measures possess low internal consistency, but are rarely rejected because of low temporal stability. Thus, the effects of internal consistency are range-restricted to an unknown amount, because investigators do not have access to studies that have been rejected due to low internal consistency.

Original languageEnglish (US)
Pages (from-to)946-949
Number of pages4
JournalBehavior Research Methods
Volume45
Issue number4
DOIs
StatePublished - Dec 2013

Fingerprint

Premature Mortality
Personality Assessment
Social Psychology
Manuscripts
Reproducibility of Results
Personality
Research Personnel
Outcome Assessment (Health Care)
Research
Therapeutics

Keywords

  • Internal consistency
  • Personality assessment
  • Test construction methods

ASJC Scopus subject areas

  • Psychology(all)
  • Psychology (miscellaneous)
  • Experimental and Cognitive Psychology
  • Arts and Humanities (miscellaneous)
  • Developmental and Educational Psychology

Cite this

Internal consistency : Reports of its death are premature. / Holden, Ronald R.; Bernstein, Ira H.

In: Behavior Research Methods, Vol. 45, No. 4, 12.2013, p. 946-949.

Research output: Contribution to journalArticle

Holden, Ronald R. ; Bernstein, Ira H. / Internal consistency : Reports of its death are premature. In: Behavior Research Methods. 2013 ; Vol. 45, No. 4. pp. 946-949.
@article{10de920560d04d83a3995c9e94f3587f,
title = "Internal consistency: Reports of its death are premature",
abstract = "McCrae, Kurtz, Yamagata, and Terracciano (Personality and Social Psychology Review 15:28-50, 2011) presented data supporting the position that test-retest reliability is more important for methods of personality assessment than is internal-consistency reliability. We raise two points not adequately considered in their findings. First, not all personality assessment is concerned with assessing traits, for which temporal stability is clearly important. Much research (e.g., therapy outcome studies) is concerned with assessing states, in which an emphasis on temporal stability can lead to the underestimation of change. Second, we suggest that using the literature as a basis for their position causes the role of internal consistency to be underestimated. This is because manuscripts are frequently rejected because their measures possess low internal consistency, but are rarely rejected because of low temporal stability. Thus, the effects of internal consistency are range-restricted to an unknown amount, because investigators do not have access to studies that have been rejected due to low internal consistency.",
keywords = "Internal consistency, Personality assessment, Test construction methods",
author = "Holden, {Ronald R.} and Bernstein, {Ira H.}",
year = "2013",
month = "12",
doi = "10.3758/s13428-013-0315-4",
language = "English (US)",
volume = "45",
pages = "946--949",
journal = "Behavior Research Methods",
issn = "1554-351X",
publisher = "Springer New York",
number = "4",

}

TY - JOUR

T1 - Internal consistency

T2 - Reports of its death are premature

AU - Holden, Ronald R.

AU - Bernstein, Ira H.

PY - 2013/12

Y1 - 2013/12

N2 - McCrae, Kurtz, Yamagata, and Terracciano (Personality and Social Psychology Review 15:28-50, 2011) presented data supporting the position that test-retest reliability is more important for methods of personality assessment than is internal-consistency reliability. We raise two points not adequately considered in their findings. First, not all personality assessment is concerned with assessing traits, for which temporal stability is clearly important. Much research (e.g., therapy outcome studies) is concerned with assessing states, in which an emphasis on temporal stability can lead to the underestimation of change. Second, we suggest that using the literature as a basis for their position causes the role of internal consistency to be underestimated. This is because manuscripts are frequently rejected because their measures possess low internal consistency, but are rarely rejected because of low temporal stability. Thus, the effects of internal consistency are range-restricted to an unknown amount, because investigators do not have access to studies that have been rejected due to low internal consistency.

AB - McCrae, Kurtz, Yamagata, and Terracciano (Personality and Social Psychology Review 15:28-50, 2011) presented data supporting the position that test-retest reliability is more important for methods of personality assessment than is internal-consistency reliability. We raise two points not adequately considered in their findings. First, not all personality assessment is concerned with assessing traits, for which temporal stability is clearly important. Much research (e.g., therapy outcome studies) is concerned with assessing states, in which an emphasis on temporal stability can lead to the underestimation of change. Second, we suggest that using the literature as a basis for their position causes the role of internal consistency to be underestimated. This is because manuscripts are frequently rejected because their measures possess low internal consistency, but are rarely rejected because of low temporal stability. Thus, the effects of internal consistency are range-restricted to an unknown amount, because investigators do not have access to studies that have been rejected due to low internal consistency.

KW - Internal consistency

KW - Personality assessment

KW - Test construction methods

UR - http://www.scopus.com/inward/record.url?scp=84889255055&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84889255055&partnerID=8YFLogxK

U2 - 10.3758/s13428-013-0315-4

DO - 10.3758/s13428-013-0315-4

M3 - Article

C2 - 23371829

AN - SCOPUS:84889255055

VL - 45

SP - 946

EP - 949

JO - Behavior Research Methods

JF - Behavior Research Methods

SN - 1554-351X

IS - 4

ER -