Speech-associated gestures, Broca's area, and the human mirror system

Jeremy I. Skipper, Susan Goldin-Meadow, Howard C. Nusbaum, Steven L. Small

Research output: Contribution to journalArticle

143 Citations (Scopus)

Abstract

Speech-associated gestures are hand and arm movements that not only convey semantic information to listeners but are themselves actions. Broca's area has been assumed to play an important role both in semantic retrieval or selection (as part of a language comprehension system) and in action recognition (as part of a "mirror" or "observation-execution matching" system). We asked whether the role that Broca's area plays in processing speech-associated gestures is consistent with the semantic retrieval/selection account (predicting relatively weak interactions between Broca's area and other cortical areas because the meaningful information that speech-associated gestures convey reduces semantic ambiguity and thus reduces the need for semantic retrieval/selection) or the action recognition account (predicting strong interactions between Broca's area and other cortical areas because speech-associated gestures are goal-direct actions that are "mirrored"). We compared the functional connectivity of Broca's area with other cortical areas when participants listened to stories while watching meaningful speech-associated gestures, speech-irrelevant self-grooming hand movements, or no hand movements. A network analysis of neuroimaging data showed that interactions involving Broca's area and other cortical areas were weakest when spoken language was accompanied by meaningful speech-associated gestures, and strongest when spoken language was accompanied by self-grooming hand movements or by no hand movements at all. Results are discussed with respect to the role that the human mirror system plays in processing speech-associated movements.

Original languageEnglish (US)
Pages (from-to)260-277
Number of pages18
JournalBrain and language
Volume101
Issue number3
DOIs
StatePublished - Jun 1 2007
Externally publishedYes

Fingerprint

Gestures
Semantics
Hand
semantics
Grooming
Language
spoken language
interaction
Broca Area
Gesture
Broca's Area
Neuroimaging
network analysis
Arm
listener
Observation
comprehension
Interaction
Semantic Retrieval

Keywords

  • Action recognition
  • Action understanding
  • Broca's area
  • Face
  • Gesture
  • Language
  • Mirror neurons
  • Pars opercularis
  • Pars triangularis
  • Premotor cortex
  • Structural equation models
  • The human mirror system
  • The motor system

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Language and Linguistics
  • Linguistics and Language
  • Cognitive Neuroscience
  • Speech and Hearing

Cite this

Speech-associated gestures, Broca's area, and the human mirror system. / Skipper, Jeremy I.; Goldin-Meadow, Susan; Nusbaum, Howard C.; Small, Steven L.

In: Brain and language, Vol. 101, No. 3, 01.06.2007, p. 260-277.

Research output: Contribution to journalArticle

Skipper, Jeremy I. ; Goldin-Meadow, Susan ; Nusbaum, Howard C. ; Small, Steven L. / Speech-associated gestures, Broca's area, and the human mirror system. In: Brain and language. 2007 ; Vol. 101, No. 3. pp. 260-277.
@article{e86ae501fd8040d9a93822cc8980f74a,
title = "Speech-associated gestures, Broca's area, and the human mirror system",
abstract = "Speech-associated gestures are hand and arm movements that not only convey semantic information to listeners but are themselves actions. Broca's area has been assumed to play an important role both in semantic retrieval or selection (as part of a language comprehension system) and in action recognition (as part of a {"}mirror{"} or {"}observation-execution matching{"} system). We asked whether the role that Broca's area plays in processing speech-associated gestures is consistent with the semantic retrieval/selection account (predicting relatively weak interactions between Broca's area and other cortical areas because the meaningful information that speech-associated gestures convey reduces semantic ambiguity and thus reduces the need for semantic retrieval/selection) or the action recognition account (predicting strong interactions between Broca's area and other cortical areas because speech-associated gestures are goal-direct actions that are {"}mirrored{"}). We compared the functional connectivity of Broca's area with other cortical areas when participants listened to stories while watching meaningful speech-associated gestures, speech-irrelevant self-grooming hand movements, or no hand movements. A network analysis of neuroimaging data showed that interactions involving Broca's area and other cortical areas were weakest when spoken language was accompanied by meaningful speech-associated gestures, and strongest when spoken language was accompanied by self-grooming hand movements or by no hand movements at all. Results are discussed with respect to the role that the human mirror system plays in processing speech-associated movements.",
keywords = "Action recognition, Action understanding, Broca's area, Face, Gesture, Language, Mirror neurons, Pars opercularis, Pars triangularis, Premotor cortex, Structural equation models, The human mirror system, The motor system",
author = "Skipper, {Jeremy I.} and Susan Goldin-Meadow and Nusbaum, {Howard C.} and Small, {Steven L.}",
year = "2007",
month = "6",
day = "1",
doi = "10.1016/j.bandl.2007.02.008",
language = "English (US)",
volume = "101",
pages = "260--277",
journal = "Brain and Language",
issn = "0093-934X",
publisher = "Academic Press Inc.",
number = "3",

}

TY - JOUR

T1 - Speech-associated gestures, Broca's area, and the human mirror system

AU - Skipper, Jeremy I.

AU - Goldin-Meadow, Susan

AU - Nusbaum, Howard C.

AU - Small, Steven L.

PY - 2007/6/1

Y1 - 2007/6/1

N2 - Speech-associated gestures are hand and arm movements that not only convey semantic information to listeners but are themselves actions. Broca's area has been assumed to play an important role both in semantic retrieval or selection (as part of a language comprehension system) and in action recognition (as part of a "mirror" or "observation-execution matching" system). We asked whether the role that Broca's area plays in processing speech-associated gestures is consistent with the semantic retrieval/selection account (predicting relatively weak interactions between Broca's area and other cortical areas because the meaningful information that speech-associated gestures convey reduces semantic ambiguity and thus reduces the need for semantic retrieval/selection) or the action recognition account (predicting strong interactions between Broca's area and other cortical areas because speech-associated gestures are goal-direct actions that are "mirrored"). We compared the functional connectivity of Broca's area with other cortical areas when participants listened to stories while watching meaningful speech-associated gestures, speech-irrelevant self-grooming hand movements, or no hand movements. A network analysis of neuroimaging data showed that interactions involving Broca's area and other cortical areas were weakest when spoken language was accompanied by meaningful speech-associated gestures, and strongest when spoken language was accompanied by self-grooming hand movements or by no hand movements at all. Results are discussed with respect to the role that the human mirror system plays in processing speech-associated movements.

AB - Speech-associated gestures are hand and arm movements that not only convey semantic information to listeners but are themselves actions. Broca's area has been assumed to play an important role both in semantic retrieval or selection (as part of a language comprehension system) and in action recognition (as part of a "mirror" or "observation-execution matching" system). We asked whether the role that Broca's area plays in processing speech-associated gestures is consistent with the semantic retrieval/selection account (predicting relatively weak interactions between Broca's area and other cortical areas because the meaningful information that speech-associated gestures convey reduces semantic ambiguity and thus reduces the need for semantic retrieval/selection) or the action recognition account (predicting strong interactions between Broca's area and other cortical areas because speech-associated gestures are goal-direct actions that are "mirrored"). We compared the functional connectivity of Broca's area with other cortical areas when participants listened to stories while watching meaningful speech-associated gestures, speech-irrelevant self-grooming hand movements, or no hand movements. A network analysis of neuroimaging data showed that interactions involving Broca's area and other cortical areas were weakest when spoken language was accompanied by meaningful speech-associated gestures, and strongest when spoken language was accompanied by self-grooming hand movements or by no hand movements at all. Results are discussed with respect to the role that the human mirror system plays in processing speech-associated movements.

KW - Action recognition

KW - Action understanding

KW - Broca's area

KW - Face

KW - Gesture

KW - Language

KW - Mirror neurons

KW - Pars opercularis

KW - Pars triangularis

KW - Premotor cortex

KW - Structural equation models

KW - The human mirror system

KW - The motor system

UR - http://www.scopus.com/inward/record.url?scp=34249052967&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34249052967&partnerID=8YFLogxK

U2 - 10.1016/j.bandl.2007.02.008

DO - 10.1016/j.bandl.2007.02.008

M3 - Article

C2 - 17533001

AN - SCOPUS:34249052967

VL - 101

SP - 260

EP - 277

JO - Brain and Language

JF - Brain and Language

SN - 0093-934X

IS - 3

ER -