Reliability and validity of a questionnaire to measure colorectal cancer screening behaviors: Does mode of survey administration matter?

Sally W. Vernon, Jasmin A. Tiro, Rachel W. Vojvodic, Sharon Coan, Pamela M. Diamond, Anthony Greisinger, Maria E. Fernandez

Research output: Contribution to journalArticle

63 Citations (Scopus)

Abstract

Valid and reliable self-report measures of cancer screening behaviors are important for evaluating efforts to improve adherence to guidelines. We evaluated test-retest reliability and validity of self-report of the fecal occult blood test (FOBT), sigmoidoscopy (SIG), colonoscopy (COL), and barium enema (BE) using the National Cancer Institute colorectal cancer screening (CRCS) questionnaire. A secondary objective was to evaluate reliability and validity by mail, telephone, and face-to-face survey administration modes. Consenting men and women, 51 to 74 years old, receiving care at a multispecialty clinic for at least 5 years who had not been diagnosed with colorectal cancer were stratified by prior CRCS status and randomized to survey mode (n = 857). Within survey mode, respondents were randomized to complete a second survey at 2 weeks, 3 months, or 6 months. Comparing self-report with administrative and medical records, concordance estimates were 0.91 for COL, 0.85 for FOBT, 0.85 for SIG, and 0.92 for BE. Overall sensitivity estimates were 0.91 for COL, 0.82 for FOBT, 0.76 for SIG, and 0.56 for BE. Specificity estimates were 0.91 for COL, 0.86 for FOBT, 0.89 for SIG, and 0.97 for BE. Sensitivity and specificity varied little by survey mode for any test. Report-to-records ratio showed overreporting for SIG(1.1), COL (1.15), and FOBT (1.57), and underreporting for BE (0.82). Reliability at all time intervals was highest for COL; there was no consistent pattern according to survey mode. This study provides evidence to support the use of the National Cancer Institute CRCS questionnaire to assess self-report with any of the three survey modes.

Original languageEnglish (US)
Pages (from-to)758-767
Number of pages10
JournalCancer Epidemiology Biomarkers and Prevention
Volume17
Issue number4
DOIs
StatePublished - Apr 2008

Fingerprint

Early Detection of Cancer
Reproducibility of Results
Colorectal Neoplasms
Sigmoidoscopy
Colonoscopy
Occult Blood
Hematologic Tests
Self Report
National Cancer Institute (U.S.)
Surveys and Questionnaires
Guideline Adherence
Postal Service
Telephone
Medical Records
Barium Enema
Sensitivity and Specificity

ASJC Scopus subject areas

  • Epidemiology
  • Oncology

Cite this

Reliability and validity of a questionnaire to measure colorectal cancer screening behaviors : Does mode of survey administration matter? / Vernon, Sally W.; Tiro, Jasmin A.; Vojvodic, Rachel W.; Coan, Sharon; Diamond, Pamela M.; Greisinger, Anthony; Fernandez, Maria E.

In: Cancer Epidemiology Biomarkers and Prevention, Vol. 17, No. 4, 04.2008, p. 758-767.

Research output: Contribution to journalArticle

Vernon, Sally W. ; Tiro, Jasmin A. ; Vojvodic, Rachel W. ; Coan, Sharon ; Diamond, Pamela M. ; Greisinger, Anthony ; Fernandez, Maria E. / Reliability and validity of a questionnaire to measure colorectal cancer screening behaviors : Does mode of survey administration matter?. In: Cancer Epidemiology Biomarkers and Prevention. 2008 ; Vol. 17, No. 4. pp. 758-767.
@article{d93c252497a74529b529c712e536bbde,
title = "Reliability and validity of a questionnaire to measure colorectal cancer screening behaviors: Does mode of survey administration matter?",
abstract = "Valid and reliable self-report measures of cancer screening behaviors are important for evaluating efforts to improve adherence to guidelines. We evaluated test-retest reliability and validity of self-report of the fecal occult blood test (FOBT), sigmoidoscopy (SIG), colonoscopy (COL), and barium enema (BE) using the National Cancer Institute colorectal cancer screening (CRCS) questionnaire. A secondary objective was to evaluate reliability and validity by mail, telephone, and face-to-face survey administration modes. Consenting men and women, 51 to 74 years old, receiving care at a multispecialty clinic for at least 5 years who had not been diagnosed with colorectal cancer were stratified by prior CRCS status and randomized to survey mode (n = 857). Within survey mode, respondents were randomized to complete a second survey at 2 weeks, 3 months, or 6 months. Comparing self-report with administrative and medical records, concordance estimates were 0.91 for COL, 0.85 for FOBT, 0.85 for SIG, and 0.92 for BE. Overall sensitivity estimates were 0.91 for COL, 0.82 for FOBT, 0.76 for SIG, and 0.56 for BE. Specificity estimates were 0.91 for COL, 0.86 for FOBT, 0.89 for SIG, and 0.97 for BE. Sensitivity and specificity varied little by survey mode for any test. Report-to-records ratio showed overreporting for SIG(1.1), COL (1.15), and FOBT (1.57), and underreporting for BE (0.82). Reliability at all time intervals was highest for COL; there was no consistent pattern according to survey mode. This study provides evidence to support the use of the National Cancer Institute CRCS questionnaire to assess self-report with any of the three survey modes.",
author = "Vernon, {Sally W.} and Tiro, {Jasmin A.} and Vojvodic, {Rachel W.} and Sharon Coan and Diamond, {Pamela M.} and Anthony Greisinger and Fernandez, {Maria E.}",
year = "2008",
month = "4",
doi = "10.1158/1055-9965.EPI-07-2855",
language = "English (US)",
volume = "17",
pages = "758--767",
journal = "Cancer Epidemiology Biomarkers and Prevention",
issn = "1055-9965",
publisher = "American Association for Cancer Research Inc.",
number = "4",

}

TY - JOUR

T1 - Reliability and validity of a questionnaire to measure colorectal cancer screening behaviors

T2 - Does mode of survey administration matter?

AU - Vernon, Sally W.

AU - Tiro, Jasmin A.

AU - Vojvodic, Rachel W.

AU - Coan, Sharon

AU - Diamond, Pamela M.

AU - Greisinger, Anthony

AU - Fernandez, Maria E.

PY - 2008/4

Y1 - 2008/4

N2 - Valid and reliable self-report measures of cancer screening behaviors are important for evaluating efforts to improve adherence to guidelines. We evaluated test-retest reliability and validity of self-report of the fecal occult blood test (FOBT), sigmoidoscopy (SIG), colonoscopy (COL), and barium enema (BE) using the National Cancer Institute colorectal cancer screening (CRCS) questionnaire. A secondary objective was to evaluate reliability and validity by mail, telephone, and face-to-face survey administration modes. Consenting men and women, 51 to 74 years old, receiving care at a multispecialty clinic for at least 5 years who had not been diagnosed with colorectal cancer were stratified by prior CRCS status and randomized to survey mode (n = 857). Within survey mode, respondents were randomized to complete a second survey at 2 weeks, 3 months, or 6 months. Comparing self-report with administrative and medical records, concordance estimates were 0.91 for COL, 0.85 for FOBT, 0.85 for SIG, and 0.92 for BE. Overall sensitivity estimates were 0.91 for COL, 0.82 for FOBT, 0.76 for SIG, and 0.56 for BE. Specificity estimates were 0.91 for COL, 0.86 for FOBT, 0.89 for SIG, and 0.97 for BE. Sensitivity and specificity varied little by survey mode for any test. Report-to-records ratio showed overreporting for SIG(1.1), COL (1.15), and FOBT (1.57), and underreporting for BE (0.82). Reliability at all time intervals was highest for COL; there was no consistent pattern according to survey mode. This study provides evidence to support the use of the National Cancer Institute CRCS questionnaire to assess self-report with any of the three survey modes.

AB - Valid and reliable self-report measures of cancer screening behaviors are important for evaluating efforts to improve adherence to guidelines. We evaluated test-retest reliability and validity of self-report of the fecal occult blood test (FOBT), sigmoidoscopy (SIG), colonoscopy (COL), and barium enema (BE) using the National Cancer Institute colorectal cancer screening (CRCS) questionnaire. A secondary objective was to evaluate reliability and validity by mail, telephone, and face-to-face survey administration modes. Consenting men and women, 51 to 74 years old, receiving care at a multispecialty clinic for at least 5 years who had not been diagnosed with colorectal cancer were stratified by prior CRCS status and randomized to survey mode (n = 857). Within survey mode, respondents were randomized to complete a second survey at 2 weeks, 3 months, or 6 months. Comparing self-report with administrative and medical records, concordance estimates were 0.91 for COL, 0.85 for FOBT, 0.85 for SIG, and 0.92 for BE. Overall sensitivity estimates were 0.91 for COL, 0.82 for FOBT, 0.76 for SIG, and 0.56 for BE. Specificity estimates were 0.91 for COL, 0.86 for FOBT, 0.89 for SIG, and 0.97 for BE. Sensitivity and specificity varied little by survey mode for any test. Report-to-records ratio showed overreporting for SIG(1.1), COL (1.15), and FOBT (1.57), and underreporting for BE (0.82). Reliability at all time intervals was highest for COL; there was no consistent pattern according to survey mode. This study provides evidence to support the use of the National Cancer Institute CRCS questionnaire to assess self-report with any of the three survey modes.

UR - http://www.scopus.com/inward/record.url?scp=42149089253&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=42149089253&partnerID=8YFLogxK

U2 - 10.1158/1055-9965.EPI-07-2855

DO - 10.1158/1055-9965.EPI-07-2855

M3 - Article

C2 - 18381467

AN - SCOPUS:42149089253

VL - 17

SP - 758

EP - 767

JO - Cancer Epidemiology Biomarkers and Prevention

JF - Cancer Epidemiology Biomarkers and Prevention

SN - 1055-9965

IS - 4

ER -