The Dot Counting Test adds up: Validation and response pattern analysis in a mixed clinical veteran sample

Jason R. Soble, Octavio A. Santos, Kathleen M. Bain, Joshua W. Kirton, K. Chase Bailey, Edan A. Critchfield, Justin J.F. O’Rourke, Jonathan M. Highsmith, David Andrés González

Research output: Contribution to journalArticle

5 Scopus citations

Abstract

Objective: This study cross-validated the Dot Counting Test (DCT) as a performance validity test (PVT) among a mixed clinical veteran sample. Completion time and error patterns also were examined by validity group and cognitive impairment status. Method: This cross-sectional study included 77 veterans who completed the DCT during clinical evaluation. Seventy-four percent (N = 57) were classified as valid and 26% as noncredible (N = 20) via the Word Memory Test (WMT) and Test of Memory Malingering (TOMM). Among valid participants, 47% (N = 27) were cognitively impaired, and 53% (N = 30) were unimpaired. Results: DCT performance was not significantly associated with age, education, or bilingualism. Seventy-five percent of the overall sample committed at least one error across the 12 stimulus cards; however, valid participants had a 27% higher rate of 0 errors, while noncredible participants had a 35% higher rate of ≥4 errors. Overall, noncredible individuals had significantly longer completion times, more errors, and higher E-scores. Conversely, those with cognitive impairment had longer completion times, but comparable errors to their unimpaired counterparts. Finally, DCT E-scores significantly predicted group membership with 83.1% classification accuracy and an area under the curve of .87 for identifying invalid performance. The optimal cut-score of 15 was associated with 70% sensitivity and 88% specificity. Conclusion: The DCT demonstrated good classification accuracy and sensitivity/specificity for identifying noncredible performance in this mixed clinical veteran sample, suggesting utility as a non-memory-based PVT with this population. Moreover, cognitive impairment significantly contributed to slower completion times, but not reduced accuracy.

Original languageEnglish (US)
Pages (from-to)1-9
Number of pages9
JournalJournal of Clinical and Experimental Neuropsychology
DOIs
StateAccepted/In press - Jun 26 2017

    Fingerprint

Keywords

  • assessment
  • Dot Counting Test
  • effort.​
  • Performance validity
  • psychometrics
  • veterans

ASJC Scopus subject areas

  • Clinical Psychology
  • Neurology
  • Clinical Neurology

Cite this

Soble, J. R., Santos, O. A., Bain, K. M., Kirton, J. W., Bailey, K. C., Critchfield, E. A., O’Rourke, J. J. F., Highsmith, J. M., & González, D. A. (Accepted/In press). The Dot Counting Test adds up: Validation and response pattern analysis in a mixed clinical veteran sample. Journal of Clinical and Experimental Neuropsychology, 1-9. https://doi.org/10.1080/13803395.2017.1342773