Abstract Coding of Audiovisual Speech: Beyond Sensory Representation

Uri Hasson, Jeremy I. Skipper, Howard C. Nusbaum, Steven L. Small

Research output: Contribution to journalArticle

59 Citations (Scopus)

Abstract

Is there a neural representation of speech that transcends its sensory properties? Using fMRI, we investigated whether there are brain areas where neural activity during observation of sublexical audiovisual input corresponds to a listener's speech percept (what is "heard") independent of the sensory properties of the input. A target audiovisual stimulus was preceded by stimuli that (1) shared the target's auditory features (auditory overlap), (2) shared the target's visual features (visual overlap), or (3) shared neither the target's auditory or visual features but were perceived as the target (perceptual overlap). In two left-hemisphere regions (pars opercularis, planum polare), the target invoked less activity when it was preceded by the perceptually overlapping stimulus than when preceded by stimuli that shared one of its sensory components. This pattern of neural facilitation indicates that these regions code sublexical speech at an abstract level corresponding to that of the speech percept.

Original languageEnglish (US)
Pages (from-to)1116-1126
Number of pages11
JournalNeuron
Volume56
Issue number6
DOIs
StatePublished - Dec 20 2007
Externally publishedYes

Fingerprint

Temporal Lobe
Magnetic Resonance Imaging
Observation
Brain
Transcend
Broca Area

Keywords

  • SYSNEURO

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Abstract Coding of Audiovisual Speech : Beyond Sensory Representation. / Hasson, Uri; Skipper, Jeremy I.; Nusbaum, Howard C.; Small, Steven L.

In: Neuron, Vol. 56, No. 6, 20.12.2007, p. 1116-1126.

Research output: Contribution to journalArticle

Hasson, Uri ; Skipper, Jeremy I. ; Nusbaum, Howard C. ; Small, Steven L. / Abstract Coding of Audiovisual Speech : Beyond Sensory Representation. In: Neuron. 2007 ; Vol. 56, No. 6. pp. 1116-1126.
@article{9ca8774d40264aa8902e2f036bab9a66,
title = "Abstract Coding of Audiovisual Speech: Beyond Sensory Representation",
abstract = "Is there a neural representation of speech that transcends its sensory properties? Using fMRI, we investigated whether there are brain areas where neural activity during observation of sublexical audiovisual input corresponds to a listener's speech percept (what is {"}heard{"}) independent of the sensory properties of the input. A target audiovisual stimulus was preceded by stimuli that (1) shared the target's auditory features (auditory overlap), (2) shared the target's visual features (visual overlap), or (3) shared neither the target's auditory or visual features but were perceived as the target (perceptual overlap). In two left-hemisphere regions (pars opercularis, planum polare), the target invoked less activity when it was preceded by the perceptually overlapping stimulus than when preceded by stimuli that shared one of its sensory components. This pattern of neural facilitation indicates that these regions code sublexical speech at an abstract level corresponding to that of the speech percept.",
keywords = "SYSNEURO",
author = "Uri Hasson and Skipper, {Jeremy I.} and Nusbaum, {Howard C.} and Small, {Steven L.}",
year = "2007",
month = "12",
day = "20",
doi = "10.1016/j.neuron.2007.09.037",
language = "English (US)",
volume = "56",
pages = "1116--1126",
journal = "Neuron",
issn = "0896-6273",
publisher = "Cell Press",
number = "6",

}

TY - JOUR

T1 - Abstract Coding of Audiovisual Speech

T2 - Beyond Sensory Representation

AU - Hasson, Uri

AU - Skipper, Jeremy I.

AU - Nusbaum, Howard C.

AU - Small, Steven L.

PY - 2007/12/20

Y1 - 2007/12/20

N2 - Is there a neural representation of speech that transcends its sensory properties? Using fMRI, we investigated whether there are brain areas where neural activity during observation of sublexical audiovisual input corresponds to a listener's speech percept (what is "heard") independent of the sensory properties of the input. A target audiovisual stimulus was preceded by stimuli that (1) shared the target's auditory features (auditory overlap), (2) shared the target's visual features (visual overlap), or (3) shared neither the target's auditory or visual features but were perceived as the target (perceptual overlap). In two left-hemisphere regions (pars opercularis, planum polare), the target invoked less activity when it was preceded by the perceptually overlapping stimulus than when preceded by stimuli that shared one of its sensory components. This pattern of neural facilitation indicates that these regions code sublexical speech at an abstract level corresponding to that of the speech percept.

AB - Is there a neural representation of speech that transcends its sensory properties? Using fMRI, we investigated whether there are brain areas where neural activity during observation of sublexical audiovisual input corresponds to a listener's speech percept (what is "heard") independent of the sensory properties of the input. A target audiovisual stimulus was preceded by stimuli that (1) shared the target's auditory features (auditory overlap), (2) shared the target's visual features (visual overlap), or (3) shared neither the target's auditory or visual features but were perceived as the target (perceptual overlap). In two left-hemisphere regions (pars opercularis, planum polare), the target invoked less activity when it was preceded by the perceptually overlapping stimulus than when preceded by stimuli that shared one of its sensory components. This pattern of neural facilitation indicates that these regions code sublexical speech at an abstract level corresponding to that of the speech percept.

KW - SYSNEURO

UR - http://www.scopus.com/inward/record.url?scp=37049000152&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=37049000152&partnerID=8YFLogxK

U2 - 10.1016/j.neuron.2007.09.037

DO - 10.1016/j.neuron.2007.09.037

M3 - Article

C2 - 18093531

AN - SCOPUS:37049000152

VL - 56

SP - 1116

EP - 1126

JO - Neuron

JF - Neuron

SN - 0896-6273

IS - 6

ER -