Abstract
Since the discovery of ‘mirror neurons’ in the monkey premotor and parietal cortex, an increasing body of evidence in animals and humans alike has supported the notion of the inextricable link between action execution and action perception. Although research originally focused on the relationship between performed and viewed actions, more recent studies highlight the importance of representing the actions of others through audition. In the first part of this article, we discuss animal studies, which provide direct evidence that action is inherently linked to multi-sensory cues, as well as the studies carried out on healthy subjects by using state-of-the-art cognitive neuroscience techniques such as functional magnetic resonance imaging (fMRI), event-related potentials (ERP), magnetoencephalography (MEG), and transcranial magnetic stimulation (TMS). In the second section, we review the lesion analysis studies in brain-damaged patients demonstrating the link between ‘resonant’ fronto-parieto-temporal networks and the ability to represent an action by hearing its sound. Moreover, we examine the evidence in favour of somatotopy as a possible representational rule underlying the auditory mapping of actions and consider the links between language and audio-motor action mapping. We conclude with a discussion of some outstanding questions for future research on the link between actions and the sounds they produce.
Similar content being viewed by others
References
Aglioti SM, Cesari P, Romani M, Urgesi C (2008) Action anticipation and motor resonance in elite basketball players. Nat Neurosci 11:1109–1116
Alaerts K, Swinnen SP, Wenderoth N (2009) Interaction of sound and sight during action perception: evidence for shared modality-dependent action representations. Neuropsychologia 47:2593–2599
Amedi A, von Kriegstein K, van Atteveldt NM, Beauchamp MS, Naumer MJ (2005) Functional imaging of human crossmodal identification and object recognition. Exp Brain Res 166:559–571
Arbib MA (2005) From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics. Behav Brain Sci 28:105–124
Avenanti A, Bolognini N, Maravita A, Aglioti SM (2007) Somatic and motor components of action simulation. Curr Biol 17:2129–2135
Aziz-Zadeh L, Iacoboni M, Zaidel E, Wilson S, Mazziotta J (2004) Left hemisphere motor facilitation in response to manual action sounds. Eur J Neurosci 19:2609–2612
Aziz-Zadeh L, Wilson SM, Rizzolatti G, Iacoboni M (2006) Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Curr Biol 16:1818–1823
Barsalou LW (2008) Grounded cognition. Annu Rev Psychol 59:617–645
Belin P (2006) Voice processing in human and non-human primates. Philos Trans R Soc Lond B Biol Sci 361:2091–2107
Bidet-Caulet A, Voisin J, Bertrand O, Fonlupt P (2005) Listening to a walking human activates the temporal biological motion area. Neuroimage 28:132–139
Buccino G, Binkofski F, Fink GR, Fadiga L, Fogassi L, Gallese V, Seitz RJ, Zilles K, Rizzolatti G, Freund HJ (2001) Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur J Neurosci 13:400–404
Buccino G, Vogt S, Ritzl A, Fink GR, Zilles K, Freund HJ, Rizzolatti G (2004) Neural circuits underlying imitation learning of hand actions: an event-related fMRI study. Neuron 42:323–334
Caetano G, Jousmäki V, Hari R (2007) Actor’s and observer’s primary motor cortices stabilize similarly after seen or heard motor actions. Proc Natl Acad Sci USA 104:9058–9062
Calvo-Merino B, Grèzes J, Glaser DE, Passingham RE, Haggard P (2006) Seeing or doing? Influence of visual and motor familiarity in action observation. Curr Biol 16:1905–1910
Campanella S, Belin P (2007) Integrating face and voice in person perception. Trends Cogn Sci 11:535–543
Candidi M, Vicario CM, Abreu AM, Aglioti SM (2010) Competing mechanisms for mapping action-related categorical knowledge and observed actions. Cereb Cortex [Epub ahead of print]
Casile A, Giese MA (2006) Nonvisual motor training influences biological motion perception. Curr Biol 16:69–74
Celnik P, Webster B, Glasser DM, Cohen LG (2008) Effects of action observation on physical training after stroke. Stroke 39:1814–1820. Epub 2008 Apr 10
Chen YC, Spence C (2009) When hearing the bark helps to identify the dog: semantically-congruent sounds modulate the identification of masked pictures. Cognition
Corballis MC (2002) From hand to mouth: the origins of language Princeton University Press, Princeton
Corballis MC (2009) The evolution of language. Ann NY Acad Sci 1156:19–43
Costantini M, Galati G, Ferretti A, Caulo M, Tartaro A, Romani GL, Aglioti SM (2005) Neural systems underlying observation of humanly impossible movements: an fMRI study. Cereb Cortex 15:1761–1767
D’Ausilio A, Pulvermüller F, Salmas P, Bufalari I, Begliomini C, Fadiga L (2009) The motor somatotopy of speech perception. Curr Biol 19:381–385 (Epub 2009 Feb 12)
Dapretto M, Davies MS, Pfeifer JH, Scott AA, Sigman M, Bookheimer SY, Iacoboni M (2006) Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders. Nat Neurosci 9:28–30
De Lucia M, Camen C, Clarke S, Murray MM (2009) The role of actions in auditoryobject discrimination. Neuroimage 48:475–485 (Epub 2009 Jun 24)
de Zubicaray G, Postle N, McMahon K, Meredith M, Ashton R (2010) Mirror neurons, the representation of word meaning, and the foot of the third left frontal convolution. Brain Lang 112:77–84 (Epub 2008 Nov 1)
Decety J, Grèzes J, Costes N, Perani D, Jeannerod M, Procyk E, Grassi F, Fazio F (1997) Brain activity during observation of actions. Influence of action content and subject’s strategy. Brain 120:1763–1777
di Pellegrino G, Fadiga L, Fogassi L, Gallese V, Rizzolatti G (1992) Understanding motor events: a neurophysiological study. Exp Brain Res 91:176–180
Dick F, Saygin AP, Galati G, Pitzalis S, Bentrovato S et al (2007) What is involved and what is necessary for complex linguistic and nonlinguistic auditory processing: evidence from functional magnetic resonance imaging and lesion data. J Cogn Neurosci 19:799–816
Driver J, Spence C (2000) Multisensory perception: beyond modularity and convergence. Curr Biol 10:R731–R735
Drost UC, Rieger M, Brass M, Gunter TC, Prinz W (2005) When hearing turns into playing: movement induction by auditory stimuli in pianists. Q J Exp Psychol A 58:1376–1389
Ekimov A, Sabatier JM (2006) Vibration and sound signatures of human footsteps in buildings. J Acoust Soc Am 120:762–768
Engel LR, Frum C, Puce A, Walker NA, Lewis JW (2009) Different categories of living and non-living sound-sources activate distinct cortical networks. Neuroimage 47:1778–1791 (Epub 2009 May 22)
Fadiga L, Fogassi L, Pavesi G, Rizzolatti G (1995) Motor facilitation during action observation: a magnetic stimulation study. J Neurophysiol 73:2608–2611
Fadiga L, Craighero L, Buccino G, Rizzolatti G (2002) Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur J Neurosci 15:399–402
Fernandino L, Iacoboni M (2010) Are cortical motor maps based on body parts or coordinated actions? Implications for embodied semantics. Brain Lang 112:44–53 (Epub 2009 Apr 3)
Fogassi L, Ferrari PF, Gesierich B, Rozzi S, Chersi F, Rizzolatti G et al (2005) Parietal lobe: from action organization to intention understanding. Science 308:662–667
Galati G, Committeri G, Spitoni G, Aprile T, Pitzalis S et al (2008) A selective representation of the meaning of actions in the auditory mirror system. Neuroimage 40:1274–1286
Gallese V (2007) Before and below ‘theory of mind’: embodied simulation and the neural correlates of social cognition. Philos Trans R Soc Lond B Biol Sci 362:659–669
Gallese V, Fadiga L, Fogassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brain 119:593–609
Gallese V, Rochat M, Cossu G, Sinigaglia C (2009) Motor cognition and its role in the phylogeny and ontogeny of action understanding. Dev Psychol 45:103–113
Gangitano M, Mottaghy FM, Pascual-Leone A (2001) Phase-specific modulation of cortical motor output during movement observation. Neuroreport 12:1489–1492
Gazzola V, Keysers C (2009) The observation and execution of actions share motor and somatosensory voxels in all tested subjects: single-subject analyses of unsmoothed fMRI data. Cereb Cortex 19:1239–1255
Gazzola V, Aziz-Zadeh L, Keysers C (2006) Empathy and the somatotopic auditory mirror system in humans. Curr Biol 16:1824–1829
Gentilucci M, Dalla Volta R (2008) Spoken language and arm gestures are controlled by the same motor control system. Q J Exp Psychol (Colchester) 61:944–957
Gori M, Del Viva M, Sandini G, Burr DC (2008) Young children do not integrate visual and haptic form information. Curr Biol 18:694–698
Hari R, Kujala MV (2009) Brain basis of human social interaction: from concepts to brain imaging. Physiol Rev 89:453–479
Haslinger B, Erhard P, Altenmüller E, Schroeder U, Boecker H, Ceballos-Baumann AO (2005) Transmodal sensorimotor networks during action observation in professional pianists. J Cogn Neurosci 17:282–293
Hauk O, Johnsrude I, Pulvermüller F (2004) Somatotopic representation of action words in human motor and premotor cortex. Neuron 41:301–307
Hauk O, Shtyrov Y, Pulvermuller F (2006) The sound of actions as reflected by mismatch negativity: rapid activation of cortical sensory-motor networks by sounds associated with finger and tongue movements. Eur J Neurosci 23:811–821
Hauk O, Shtyrov Y, Pulvermüller F (2008) The time course of action and action-word comprehension in the human brain as revealed by neurophysiology. J Physiol Paris 102:50–58 (Epub Apr 1)
Kaplan JT, Iacoboni M (2007) Multimodal action representation in human left ventral premotor cortex. Cogn Process 8:103–113
Kemmerer D, Castillo JG, Talavage T, Patterson S, Wiley C (2008) Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI. Brain Lang 107:16–43
Keysers C, Kohler E, Umilta MA, Nanetti L, Fogassi L et al (2003) Audiovisual mirror neurons and action recognition. Exp Brain Res 153:628–636
Knoblich G, Repp BH (2009) Inferring agency from sound. Cognition 111:248–262
Kohler E, Keysers C, Umiltà MA, Fogassi L, Gallese V et al (2002) Hearing sounds, understanding actions: action representation in mirror neurons. Science 297:846–848
Lahav A, Saltzman E, Schlaug G (2007) Action representation of sound: audiomotor recognition network while listening to newly acquired actions. J Neurosci 27:308–314
Le Bel RM, Pineda JA, Sharma A (2009) Motor-auditory-visual integration: the role of the human mirror neuron system in communication and communication disorders. J Commun Disord 42:299–304
Lepage JF, Théoret H (2006) EEG evidence for the presence of an action observation-execution matching system in children. Eur J Neurosci 23:2505–2510
Lepage JF, Théoret H (2007) The mirror neuron system: grasping others’ actions from birth. Dev Sci 10:513–523
Lepage JF, Tremblay S, Nguyen DK, Champoux F, Lassonde M, Théoret H (2010) Action related sounds induce early and late modulations of motor cortex activity. Neuroreport 21:250–253
Leroi-Gourhan Le Geste et la Parole I (1964) Technique et Langage, Parigi, Albin Michel (coll. Sciences d’aujourd’hui), p 323
Leroi-Gourhan Le Geste et la Parole II (1965) La Mémoire et les rythmes, Parigi, Albin Michel (coll. Sciences d’aujourd’hui), p 285
Leslie KR, Johnson-Frey S, Grafton ST (2004) Functional imaging of face and hand imitation: towards a motor theory of empathy. NeuroImage 21:601–607
Lewis JW, Brefczynski JA, Phinney RE, Janik JJ, DeYoe EA (2005) Distinct cortical pathways for processing tool versus animal sounds. J Neurosci 25:5148–5158
Lewis JW, Phinney RE, Brefczynski-Lewis JA, DeYoe EA (2006) Lefties get it “right” when hearing tool sounds. J Cogn Neurosci 18:1313–1314
Liberman AM, Mattingly IG (1985) The motor theory of speech perception revised. Cognition 21:1–36
Meltzoff AN, Moore MK (1977) Imitation of facial and manual gestures by human neonates. Science 198:74–78
Möttönen R, Watkins KE (2009) Motor representations of articulators contribute to categorical perception of speech sounds. J Neurosci 29:9819–9825
Nelissen N, Pazzaglia M, Vandenbulcke M, Sunaert S, Fannes K, Dupont P, Aglioti SM, Vandenberghe R (2010) Gesture discrimination in primary progressive aphasia: the intersection between gesture and language processing pathways. J Neurosci (in press)
Pazzaglia M, Pizzamiglio L, Pes E, Aglioti SM (2008a) The sound of actions in apraxia. Curr Biol 18:1766–1772 (Epub 2008 Nov 13)
Pazzaglia M, Smania N, Corato E, Aglioti SM (2008b) Neural underpinnings of gesture discrimination in patients with limb apraxia. J Neurosci 28:3030–3041
Penfield W, Rasmussen T (1950) The cerebral cortex of man. MacMillan, New York
Pietrini P, Furey ML, Ricciardi E, Gobbini MI, Wu WH, Cohen L, Guazzelli M, Haxby JV (2004) Beyond sensory images: object-based representation in the human ventral pathway. Proc Natl Acad Sci USA 101:5658–5663
Pizzamiglio L, Aprile T, Spitoni G, Pitzalis S, Bates E, D’Amico S, Di Russo F (2005) Separate neural systems for processing action- or non-action-related sounds. Neuroimage 24:852–861
Postle N, McMahon K, Ashton R, Meredith M, de Zubicaray G (2008) Action word meaning representations in cytoarchitectonically defined primary and premotor cortices. NeuroImage 43:634–644
Prather JF, Peters S, Nowicki S, Mooney R (2008) Precise auditory-vocal mirroring in neurons for learned vocal communication. Nature 451:305–310
Pulvermüller F (2001) Brain reflections of words and their meaning. Trends Cogn Sci 5:517–524
Pulvermüller F (2005) Brain mechanisms linking language and action. Nat Rev Neurosci 6:576–682
Ricciardi E, Bonino D, Sani L, Vecchi T, Guazzelli M, Haxby JV, Fadiga L, Pietrini P (2009) Do we really need vision? How blind people “see” the actions of others. J Neurosci 29:9719–9724
Rizzolatti G, Arbib MA (1998) Language within our grasp. Trends Neurosci 21:188–194
Rizzolatti G, Craighero L (2004) The mirror-neuron system. Annu Rev Neurosci 27:169–192
Rizzolatti G, Sinigaglia C (2008) Further reflections on how we interpret the actions of others. Nature 455:589
Rizzolatti G, Fadiga L, Matelli M, Bettinardi V, Paulesu E, Perani D, Fazio F (1996) Localization of grasp representations in humans by PET: 1. Observation versus execution. Exp Brain Res 111:246–252
Romani M, Cesari P, Urgesi C, Facchini S, Aglioti SM (2005) Motor facilitation of the human cortico-spinal system during observation of bio-mechanically impossible movements. Neuroimage 26:755–763
Rossi S, De Capua A, Pasqualetti P, Ulivelli M, Fadiga L, Falzarano V, Bartalini S, Passero S, Nuti D, Rossini PM (2008) Distinct olfactory cross-modal effects on the human motor system. PLoS One 27(3):e1702
Saarela MV, Hari R (2008) Listening to humans walking together activates the social brain circuitry. Soc Neurosci 3:401–409
Sauter DA, Eimer M (2010) Rapid detection of emotion from human vocalizations. J Cogn Neurosci 22:474–481
Saygin AP, Dick F, Wilson SM, Dronkers NF, Bates E (2003) Neural resources for processing language and environmental sounds: evidence from aphasia. Brain 126:928–945
Schubotz RI, von Cramon DY, Lohmann G (2003) Auditory what, where, and when: a sensory somatotopy in lateral premotor cortex. Neuroimage 20:173–185
Shams L, Kamitani Y, Shimojo S (2000) Illusions. What you see is what you hear. Nature 408:788
Smania N, Aglioti SM, Girardi F, Tinazzi M, Fiaschi A, Cosentino A, Corato E (2006) Rehabilitation of limb apraxia improves daily life activities in patients with stroke. Neurology 67:2050–2052
Stefan K, Cohen LG, Duque J, Mazzocchio R, Celnik P, Sawaki L, Ungerleider L, Classen J (2005) Formation of a motor memory by action observation. J Neurosci 25:9339–9346
Strafella AP, Paus T (2000) Modulation of cortical excitability during action observation: a transcranial magnetic stimulation study. Neuroreport 11:2289–2292
Takada M, Tokuno H, Nambu A, Inase M (1998) Corticostriatal projections from the somatic motor areas of the frontal cortex in the macaque monkey: segregation versus overlap of input zones from the primary motor cortex, the supplementary motor area, and the premotor cortex. Exp Brain Res 120:114–128
Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. Thieme, New York
Tettamanti M, Buccino G, Saccuman MC, Gallese V, Danna M et al (2005) Listening to action-related sentences activates fronto-parietal motor circuits. J Cogn Neurosci 17:273–281
Theoret H, Pascual-Leone A (2002) Language acquisition: do as you hear. Curr Biol 12:R736–R737
Tokuno H, Takada M, Nambu A, Inase M (1997) Reevaluation of ipsilateral corticocortical inputs to the orofacial region of the primary motor cortex in the macaque monkey. J Comp Neurol 389:34–48
Urgesi C, Candidi M, Fabbro F, Romani M, Aglioti SM (2006) Motor facilitation during action observation: topographic mapping of the target muscle and influence of the onlooker’s posture. Eur J Neurosci 23:2522–2530
Urgesi C, Maieron M, Avenanti A, Tidoni E, Fabbro F, Aglioti SM (2010) Simulating the future of actions in the human corticospinal system. Cereb Cortex [Epub ahead of print]
Van den Stock J, Grèzes J, de Gelder B (2008) Human and animal sounds influence recognition of body language. Brain Res 1242:185–190
Vogt S, Buccino G, Wohlschläger AM, Canessa N, Shah NJ, Zilles K, Eickhoff SB, Freund HJ, Rizzolatti G, Fink GR (2007) Prefrontal involvement in imitation learning of hand actions: effects of practice and expertise. Neuroimage 37:1371–1383
Warren JE, Sauter DA, Eisner F, Wiland J, Dresner MA et al (2006) Positive emotions preferentially engage an auditory-motor “mirror” system. J Neurosci 26:13067–13075
Watkins KE, Strafella AP, Paus T (2003) Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 41:989–994
Wheaton KJ, Thompson JC, Syngeniotis A, Abbott DF, Puce A (2004) Viewing the motion of human body parts activates different regions of premotor, temporal, and parietal cortex. NeuroImage 22:277–288
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Aglioti, S.M., Pazzaglia, M. Representing actions through their sound. Exp Brain Res 206, 141–151 (2010). https://doi.org/10.1007/s00221-010-2344-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-010-2344-x