Stability, reliability, and validity of the THINC-it screening tool for cognitive impairment in depression: A psychometric exploration in healthy volunteers

John E. Harrison, Harry Barry, Bernhard T. Baune, Michael W. Best, Christopher R. Bowie, Danielle S. Cha, Larry Culpepper, Philippe Fossati, Tracy L. Greer, Catherine Harmer, Esther Klag, Raymond W. Lam, Yena Lee, Rodrigo B. Mansur, Hans Ulrich Wittchen, Roger S. McIntyre

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Objectives: There is a need for a brief, reliable, valid, and sensitive assessment tool for screening cognitive deficits in patients with Major Depressive Disorders. This paper examines the psychometric characteristics of THINC-it, a cognitive assessment tool composed of four objective measures of cognition and a self-rated assessment, in subjects without mental disorders. Methods: N = 100 healthy controls with no current or past history of depression were tested on four sequential assessments to examine temporal stability, reliability, and convergent validity of the THINC-it tests. We examined temporal reliability across 1 week and stability via three consecutive assessments. Consistency of assessment by the study rater (intrarater reliability) was calculated using the data from the second and third of these consecutive assessments. Results: Test–retest reliability correlations varied between Pearson's r = 0.75 and 0.8. Intrarater reliability between 0.7 and 0.93. Stability for the primary measure for each test yielded within-subject standard deviation values between 5.9 and 11.23 for accuracy measures and 0.735 and 17.3 seconds for latency measures. Convergent validity for three tasks was in the acceptable range, but low for the Symbol Check task. Conclusions: Analysis shows high levels of reliability and stability. Levels of convergent validity were modest but acceptable in the case of all but one test.

Original languageEnglish (US)
Article numbere1736
JournalInternational Journal of Methods in Psychiatric Research
Volume27
Issue number3
DOIs
StatePublished - Sep 1 2018

Fingerprint

Psychometrics
Reproducibility of Results
Healthy Volunteers
Depression
Major Depressive Disorder
Mental Disorders
Cognition
Cognitive Dysfunction
Self-Assessment

Keywords

  • cognition
  • depression
  • memory
  • neuropsychological
  • screening

ASJC Scopus subject areas

  • Psychiatry and Mental health

Cite this

Stability, reliability, and validity of the THINC-it screening tool for cognitive impairment in depression : A psychometric exploration in healthy volunteers. / Harrison, John E.; Barry, Harry; Baune, Bernhard T.; Best, Michael W.; Bowie, Christopher R.; Cha, Danielle S.; Culpepper, Larry; Fossati, Philippe; Greer, Tracy L.; Harmer, Catherine; Klag, Esther; Lam, Raymond W.; Lee, Yena; Mansur, Rodrigo B.; Wittchen, Hans Ulrich; McIntyre, Roger S.

In: International Journal of Methods in Psychiatric Research, Vol. 27, No. 3, e1736, 01.09.2018.

Research output: Contribution to journalArticle

Harrison, JE, Barry, H, Baune, BT, Best, MW, Bowie, CR, Cha, DS, Culpepper, L, Fossati, P, Greer, TL, Harmer, C, Klag, E, Lam, RW, Lee, Y, Mansur, RB, Wittchen, HU & McIntyre, RS 2018, 'Stability, reliability, and validity of the THINC-it screening tool for cognitive impairment in depression: A psychometric exploration in healthy volunteers', International Journal of Methods in Psychiatric Research, vol. 27, no. 3, e1736. https://doi.org/10.1002/mpr.1736
Harrison, John E. ; Barry, Harry ; Baune, Bernhard T. ; Best, Michael W. ; Bowie, Christopher R. ; Cha, Danielle S. ; Culpepper, Larry ; Fossati, Philippe ; Greer, Tracy L. ; Harmer, Catherine ; Klag, Esther ; Lam, Raymond W. ; Lee, Yena ; Mansur, Rodrigo B. ; Wittchen, Hans Ulrich ; McIntyre, Roger S. / Stability, reliability, and validity of the THINC-it screening tool for cognitive impairment in depression : A psychometric exploration in healthy volunteers. In: International Journal of Methods in Psychiatric Research. 2018 ; Vol. 27, No. 3.
@article{fe8b6fffc3384a1a8c539192db354b0b,
title = "Stability, reliability, and validity of the THINC-it screening tool for cognitive impairment in depression: A psychometric exploration in healthy volunteers",
abstract = "Objectives: There is a need for a brief, reliable, valid, and sensitive assessment tool for screening cognitive deficits in patients with Major Depressive Disorders. This paper examines the psychometric characteristics of THINC-it, a cognitive assessment tool composed of four objective measures of cognition and a self-rated assessment, in subjects without mental disorders. Methods: N = 100 healthy controls with no current or past history of depression were tested on four sequential assessments to examine temporal stability, reliability, and convergent validity of the THINC-it tests. We examined temporal reliability across 1 week and stability via three consecutive assessments. Consistency of assessment by the study rater (intrarater reliability) was calculated using the data from the second and third of these consecutive assessments. Results: Test–retest reliability correlations varied between Pearson's r = 0.75 and 0.8. Intrarater reliability between 0.7 and 0.93. Stability for the primary measure for each test yielded within-subject standard deviation values between 5.9 and 11.23 for accuracy measures and 0.735 and 17.3 seconds for latency measures. Convergent validity for three tasks was in the acceptable range, but low for the Symbol Check task. Conclusions: Analysis shows high levels of reliability and stability. Levels of convergent validity were modest but acceptable in the case of all but one test.",
keywords = "cognition, depression, memory, neuropsychological, screening",
author = "Harrison, {John E.} and Harry Barry and Baune, {Bernhard T.} and Best, {Michael W.} and Bowie, {Christopher R.} and Cha, {Danielle S.} and Larry Culpepper and Philippe Fossati and Greer, {Tracy L.} and Catherine Harmer and Esther Klag and Lam, {Raymond W.} and Yena Lee and Mansur, {Rodrigo B.} and Wittchen, {Hans Ulrich} and McIntyre, {Roger S.}",
year = "2018",
month = "9",
day = "1",
doi = "10.1002/mpr.1736",
language = "English (US)",
volume = "27",
journal = "International Journal of Methods in Psychiatric Research",
issn = "1049-8931",
publisher = "John Wiley and Sons Ltd",
number = "3",

}

TY - JOUR

T1 - Stability, reliability, and validity of the THINC-it screening tool for cognitive impairment in depression

T2 - A psychometric exploration in healthy volunteers

AU - Harrison, John E.

AU - Barry, Harry

AU - Baune, Bernhard T.

AU - Best, Michael W.

AU - Bowie, Christopher R.

AU - Cha, Danielle S.

AU - Culpepper, Larry

AU - Fossati, Philippe

AU - Greer, Tracy L.

AU - Harmer, Catherine

AU - Klag, Esther

AU - Lam, Raymond W.

AU - Lee, Yena

AU - Mansur, Rodrigo B.

AU - Wittchen, Hans Ulrich

AU - McIntyre, Roger S.

PY - 2018/9/1

Y1 - 2018/9/1

N2 - Objectives: There is a need for a brief, reliable, valid, and sensitive assessment tool for screening cognitive deficits in patients with Major Depressive Disorders. This paper examines the psychometric characteristics of THINC-it, a cognitive assessment tool composed of four objective measures of cognition and a self-rated assessment, in subjects without mental disorders. Methods: N = 100 healthy controls with no current or past history of depression were tested on four sequential assessments to examine temporal stability, reliability, and convergent validity of the THINC-it tests. We examined temporal reliability across 1 week and stability via three consecutive assessments. Consistency of assessment by the study rater (intrarater reliability) was calculated using the data from the second and third of these consecutive assessments. Results: Test–retest reliability correlations varied between Pearson's r = 0.75 and 0.8. Intrarater reliability between 0.7 and 0.93. Stability for the primary measure for each test yielded within-subject standard deviation values between 5.9 and 11.23 for accuracy measures and 0.735 and 17.3 seconds for latency measures. Convergent validity for three tasks was in the acceptable range, but low for the Symbol Check task. Conclusions: Analysis shows high levels of reliability and stability. Levels of convergent validity were modest but acceptable in the case of all but one test.

AB - Objectives: There is a need for a brief, reliable, valid, and sensitive assessment tool for screening cognitive deficits in patients with Major Depressive Disorders. This paper examines the psychometric characteristics of THINC-it, a cognitive assessment tool composed of four objective measures of cognition and a self-rated assessment, in subjects without mental disorders. Methods: N = 100 healthy controls with no current or past history of depression were tested on four sequential assessments to examine temporal stability, reliability, and convergent validity of the THINC-it tests. We examined temporal reliability across 1 week and stability via three consecutive assessments. Consistency of assessment by the study rater (intrarater reliability) was calculated using the data from the second and third of these consecutive assessments. Results: Test–retest reliability correlations varied between Pearson's r = 0.75 and 0.8. Intrarater reliability between 0.7 and 0.93. Stability for the primary measure for each test yielded within-subject standard deviation values between 5.9 and 11.23 for accuracy measures and 0.735 and 17.3 seconds for latency measures. Convergent validity for three tasks was in the acceptable range, but low for the Symbol Check task. Conclusions: Analysis shows high levels of reliability and stability. Levels of convergent validity were modest but acceptable in the case of all but one test.

KW - cognition

KW - depression

KW - memory

KW - neuropsychological

KW - screening

UR - http://www.scopus.com/inward/record.url?scp=85052711814&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85052711814&partnerID=8YFLogxK

U2 - 10.1002/mpr.1736

DO - 10.1002/mpr.1736

M3 - Article

C2 - 30088298

AN - SCOPUS:85052711814

VL - 27

JO - International Journal of Methods in Psychiatric Research

JF - International Journal of Methods in Psychiatric Research

SN - 1049-8931

IS - 3

M1 - e1736

ER -