Semantic congruence is a critical factor in multisensory behavioral performance

Paul J. Laurienti, Robert A. Kraft, Joseph A Maldjian, Jonathan H. Burdette, Mark T. Wallace

Research output: Contribution to journalArticle

161 Citations (Scopus)

Abstract

It has repeatedly been demonstrated that the presence of multiple cues in different sensory modalities can enhance behavioral performance by speeding responses, increasing accuracy, and/or improving stimulus detection. Despite an extensive knowledge base as to how the spatial, temporal, and physical (e.g., intensity) characteristics of multisensory stimuli influence such enhancements, little is known about the role of semantic or contextual congruence. Our hypothesis was that semantically congruent multisensory stimuli would result in enhanced behavioral performance, and that semantically incongruent multisensory stimuli would result in either no enhancement or a decrement in behavioral performance. The results from a redundant cue feature discrimination task clearly demonstrate that congruent cross-modal stimulation improves behavioral performance. This effect is specific to the multisensory stimuli, as no improvements are seen in the presence of redundant unimodal stimulus pairs. In contrast, incongruent stimulus pairs result in behavioral decrements for both multisensory and paired unimodal stimuli. These results highlight that in addition to such simple stimulus features as space, time and relative effectiveness, the semantic content of a multisensory stimulus plays a critical role in determining how it is processed by the nervous system.

Original languageEnglish (US)
Pages (from-to)405-414
Number of pages10
JournalExperimental Brain Research
Volume158
Issue number4
DOIs
StatePublished - Oct 1 2004

Fingerprint

Semantics
Cues
Knowledge Bases
Nervous System
Discrimination (Psychology)

Keywords

  • Auditory
  • Behavior
  • Cross-modal
  • Integration
  • Multisensory
  • Visual

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Semantic congruence is a critical factor in multisensory behavioral performance. / Laurienti, Paul J.; Kraft, Robert A.; Maldjian, Joseph A; Burdette, Jonathan H.; Wallace, Mark T.

In: Experimental Brain Research, Vol. 158, No. 4, 01.10.2004, p. 405-414.

Research output: Contribution to journalArticle

Laurienti, Paul J. ; Kraft, Robert A. ; Maldjian, Joseph A ; Burdette, Jonathan H. ; Wallace, Mark T. / Semantic congruence is a critical factor in multisensory behavioral performance. In: Experimental Brain Research. 2004 ; Vol. 158, No. 4. pp. 405-414.
@article{ef96c2f8d09c4eb4bea26dfc8538ab6d,
title = "Semantic congruence is a critical factor in multisensory behavioral performance",
abstract = "It has repeatedly been demonstrated that the presence of multiple cues in different sensory modalities can enhance behavioral performance by speeding responses, increasing accuracy, and/or improving stimulus detection. Despite an extensive knowledge base as to how the spatial, temporal, and physical (e.g., intensity) characteristics of multisensory stimuli influence such enhancements, little is known about the role of semantic or contextual congruence. Our hypothesis was that semantically congruent multisensory stimuli would result in enhanced behavioral performance, and that semantically incongruent multisensory stimuli would result in either no enhancement or a decrement in behavioral performance. The results from a redundant cue feature discrimination task clearly demonstrate that congruent cross-modal stimulation improves behavioral performance. This effect is specific to the multisensory stimuli, as no improvements are seen in the presence of redundant unimodal stimulus pairs. In contrast, incongruent stimulus pairs result in behavioral decrements for both multisensory and paired unimodal stimuli. These results highlight that in addition to such simple stimulus features as space, time and relative effectiveness, the semantic content of a multisensory stimulus plays a critical role in determining how it is processed by the nervous system.",
keywords = "Auditory, Behavior, Cross-modal, Integration, Multisensory, Visual",
author = "Laurienti, {Paul J.} and Kraft, {Robert A.} and Maldjian, {Joseph A} and Burdette, {Jonathan H.} and Wallace, {Mark T.}",
year = "2004",
month = "10",
day = "1",
doi = "10.1007/s00221-004-1913-2",
language = "English (US)",
volume = "158",
pages = "405--414",
journal = "Experimental Brain Research",
issn = "0014-4819",
publisher = "Springer Verlag",
number = "4",

}

TY - JOUR

T1 - Semantic congruence is a critical factor in multisensory behavioral performance

AU - Laurienti, Paul J.

AU - Kraft, Robert A.

AU - Maldjian, Joseph A

AU - Burdette, Jonathan H.

AU - Wallace, Mark T.

PY - 2004/10/1

Y1 - 2004/10/1

N2 - It has repeatedly been demonstrated that the presence of multiple cues in different sensory modalities can enhance behavioral performance by speeding responses, increasing accuracy, and/or improving stimulus detection. Despite an extensive knowledge base as to how the spatial, temporal, and physical (e.g., intensity) characteristics of multisensory stimuli influence such enhancements, little is known about the role of semantic or contextual congruence. Our hypothesis was that semantically congruent multisensory stimuli would result in enhanced behavioral performance, and that semantically incongruent multisensory stimuli would result in either no enhancement or a decrement in behavioral performance. The results from a redundant cue feature discrimination task clearly demonstrate that congruent cross-modal stimulation improves behavioral performance. This effect is specific to the multisensory stimuli, as no improvements are seen in the presence of redundant unimodal stimulus pairs. In contrast, incongruent stimulus pairs result in behavioral decrements for both multisensory and paired unimodal stimuli. These results highlight that in addition to such simple stimulus features as space, time and relative effectiveness, the semantic content of a multisensory stimulus plays a critical role in determining how it is processed by the nervous system.

AB - It has repeatedly been demonstrated that the presence of multiple cues in different sensory modalities can enhance behavioral performance by speeding responses, increasing accuracy, and/or improving stimulus detection. Despite an extensive knowledge base as to how the spatial, temporal, and physical (e.g., intensity) characteristics of multisensory stimuli influence such enhancements, little is known about the role of semantic or contextual congruence. Our hypothesis was that semantically congruent multisensory stimuli would result in enhanced behavioral performance, and that semantically incongruent multisensory stimuli would result in either no enhancement or a decrement in behavioral performance. The results from a redundant cue feature discrimination task clearly demonstrate that congruent cross-modal stimulation improves behavioral performance. This effect is specific to the multisensory stimuli, as no improvements are seen in the presence of redundant unimodal stimulus pairs. In contrast, incongruent stimulus pairs result in behavioral decrements for both multisensory and paired unimodal stimuli. These results highlight that in addition to such simple stimulus features as space, time and relative effectiveness, the semantic content of a multisensory stimulus plays a critical role in determining how it is processed by the nervous system.

KW - Auditory

KW - Behavior

KW - Cross-modal

KW - Integration

KW - Multisensory

KW - Visual

UR - http://www.scopus.com/inward/record.url?scp=5644244420&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=5644244420&partnerID=8YFLogxK

U2 - 10.1007/s00221-004-1913-2

DO - 10.1007/s00221-004-1913-2

M3 - Article

C2 - 15221173

AN - SCOPUS:5644244420

VL - 158

SP - 405

EP - 414

JO - Experimental Brain Research

JF - Experimental Brain Research

SN - 0014-4819

IS - 4

ER -