Audiovisual integration of emotional signals in voice and face: An event-related fMRI study

No abstract is available for this paper.

• Publication year

  2007

• Venue

  NeuroImage

• Publication date

  2007-10-01

• Fields of study

  Medicine, Computer Science, Psychology

• Identifiers
  DOI 10.1016/J.NEUROIMAGE.2007.06.020PMID 17659885
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Cerebral response to ‘voiceness’: a functional magnetic resonance imaging study

  2007cited by this paper
• Cerebral pathways in processing of affective prosody: A dynamic causal modeling study

  2006influential reference
• Impact of voice on emotional judgment of faces: An event‐related fMRI study

  2006influential reference
• From preparation to online control: Reappraisal of neural circuitry mediating internally generated and externally guided actions

  2006cited by this paper
• Implicit Multisensory Associations Influence Voice Recognition

  2006cited by this paper
• Investigating audiovisual integration of emotional signals in the human brain.

  2006influential reference
• Cerebral processing of linguistic and emotional prosody: fMRI studies.

  2006cited by this paper
• Effects of prosodic emotional intensity on activation of associative auditory cortex

  2006influential reference
• Auditory thalamus integrates visual inputs into behavioral gains

  2005cited by this paper
• Valid conjunction inference with the minimum statistic

  2005cited by this paper
• Perception of facial expressions and voices and of their combination in the human brain.

  2005influential reference
• The case for feedforward multisensory convergence during early cortical processing

  2005influential reference
• Identification of emotional intonation evaluated by fMRI

  2005cited by this paper
• Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex

  2005cited by this paper
• The voices of wrath: brain responses to angry prosody in meaningless speech

  2005cited by this paper
• Unraveling multisensory integration: patchy organization within human STS multisensory cortex

  2004influential reference
• Is voice processing species-specific in human auditory cortex? An fMRI study

  2004influential reference
• Integration of letters and speech sounds in the human brain.

  2004influential reference
• Distinct functional substrates along the right superior temporal sulcus for the processing of voices

  2004cited by this paper
• Action sets and decisions in the medial frontal cortex.

  2004cited by this paper
• Contributions of sensory input, auditory search and verbal comprehension to cortical activity during speech processing.

  2004cited by this paper
• Integration of auditory and visual information about objects in superior temporal sulcus.

  2004influential reference
• On the lateralization of emotional prosody: an event-related functional MR investigation.

  2003cited by this paper
• The neural response to emotional prosody, as revealed by functional magnetic resonance imaging.

  2003cited by this paper
• Processing Faces and Facial Expressions

  2003cited by this paper
• Modeling regional and psychophysiologic interactions in fMRI: the importance of hemodynamic deconvolution

  2003cited by this paper
• Neocortical modulation of the amygdala response to fearful stimuli.

  2003cited by this paper
• Task instructions modulate neural responses to fearful facial expressions.

  2003cited by this paper
• Polysensory interactions along lateral temporal regions evoked by audiovisual speech.

  2003influential reference
• Dynamic Brain Activation during Processing of Emotional Intonation: Influence of Acoustic Parameters, Emotional Valence, and Sex

  2002cited by this paper
• Classical and Bayesian Inference in Neuroimaging: Applications

  2002influential reference
• The neurophysics of consciousness.

  2002cited by this paper
• The Preparation and Execution of Self-Initiated and Externally-Triggered Movement: A Study of Event-Related fMRI

  2002cited by this paper
• Phonetic Perception and the Temporal Cortex

  2002cited by this paper
• Facial expressions modulate the time course of long latency auditory brain potentials.

  2002cited by this paper
• Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain

  2002cited by this paper
• Crossmodal binding of fear in voice and face

  2001cited by this paper
• Consciousness and the Brain

  2001cited by this paper
• Consciousness and the brain. The thalamocortical dialogue in health and disease.

  2001cited by this paper
• Is cross-modal integration of emotional expressions independent of attentional resources?

  2001cited by this paper
• Recognition of emotional prosody and verbal components of spoken language: an fMRI study.

  2000cited by this paper
• Modulating emotional responses: effects of a neocortical network on the limbic system

  2000cited by this paper
• Voice-selective areas in human auditory cortex

  2000influential reference
• Selective spatial attention in vision and touch: unimodal and multimodal mechanisms revealed by PET.

  2000cited by this paper
• Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex.

  2000influential reference
• The time‐course of intermodal binding between seeing and hearing affective information

  2000cited by this paper
• The perception of emotions by ear and by eye

  2000influential reference
• Non-conscious recognition of affect in the absence of striate cortex.

  1999cited by this paper
• Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study

  1999cited by this paper
• Dissociable neural responses to facial expressions of sadness and anger.

  1999cited by this paper
• “sparse” temporal sampling in auditory fMRI

  1999cited by this paper
• Speeded responses to audiovisual signal changes result from bimodal integration.

  1998cited by this paper
• The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception

  1997influential reference
• Psychophysiological and modulatory interactions in neuroimaging.

  1997cited by this paper
• Vocal identification of speaker and emotion activates differerent brain regions

  1997cited by this paper
• A specific neural substrate for perceiving facial expressions of disgust

  1997cited by this paper
• Searching scale space for activation in PET images

  1996cited by this paper
• Perceiving affect from the voice and the face

  1996cited by this paper
• A differential neural response in the human amygdala to fearful and happy facial expressions

  1996cited by this paper
• Understanding emotional prosody activates right hemisphere regions.

  1996cited by this paper
• A unified statistical approach for determining significant signals in images of cerebral activation

  1996cited by this paper
• Response and habituation of the human amygdala during visual processing of facial expression.

  1996cited by this paper
• The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations

  1994influential reference
• Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space

  1994cited by this paper
• On measuring performance in category judgment studies of nonverbal behavior

  1993cited by this paper
• Functional neuroanatomy of face and object processing. A positron emission tomography study.

  1992influential reference
• Thalamic connections of the insula in the rhesus monkey and comments on the paralimbic connectivity of the medial pulvinar nucleus

  1984cited by this paper
• Divided attention: evidence for coactivation with redundant signals.

  1982cited by this paper
• Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey.

  1978cited by this paper
• The assessment and analysis of handedness: the Edinburgh inventory.

  1971cited by this paper
• An anatomical study of converging sensory pathways within the cerebral cortex of the monkey.

  1970cited by this paper
• An Extension of Box's Results on the Use of the $F$ Distribution in Multivariate Analysis

  1958cited by this paper
• Human Brain Mapping 6:239–249(1998) � Effect of Temporal Autocorrelation Due to Physiological Noise and Stimulus Paradigm on Voxel-Level False-Positive Rates in fMRI

  year unknowninfluential reference
• Cerebral Cortex Advance Access published June 24, 2004 Distinct Frontal Regions Subserve Evaluation of Linguistic and Emotional Aspects of Speech Intonation

  year unknowncited by this paper

• The psychophysiology of interpreting emotional language in the audiovisual modality

  2026cites this paper
• Neural dynamics of induced throat vibrations during vocal emotion recognition

  2026cites this paper
• Contextual cues shape facial emotion recognition: a combined behavioral and ERP study

  2026cites this paper
• Multimodal Advantage in Android Emotional Expressions

  2026cites this paper
• Altered Selective Attention or Increased Imagination: Effects of Eye Closure on Vocal Expression Perception.

  2026cites this paper
• The representation of facial emotion expands from sensory to prefrontal cortex with development

  2026cites this paper
• Awareness and Prevalence of Deepfake Cyberbullying: A Study of Polish Students Aged 12‒15

  2025cites this paper
• Function of the auditory cortex characterized by its intrinsic dynamic coactivation patterns estimated in individuals

  2025cites this paper
• The representation of facial emotion expands from sensory to prefrontal cortex with development

  2025cites this paper
• Immigration modulates audiovisual emotional processing in adults: is this really an influence of the host culture?

  2025cites this paper
• An fMRI study of crossmodal emotional congruency and the role of semantic content in the aesthetic appreciation of naturalistic art

  2025cites this paper
• Validation of the Emotionally Congruent and Incongruent Face–Body Static Set (ECIFBSS)

  2025cites this paper
• Deep neural network models of emotion understanding.

  2025cites this paper
• Brain Imaging Studies of Multisensory Integration in Emotion Perception: A Scoping Review.

  2025cites this paper
• Temporal cortex activation reveals emotional multisensory integration in preschoolers: An fNIRS study

  2025cites this paper
• Tasting emotions: An in-depth fmri study exploring gustatory and visual cross-modal associations across various spatio-temporal regions of the human brain

  2025cites this paper
• No evidence for disruption of empathy and mentalizing by face coverage in multimodal settings

  2025cites this paper
• Contributions of audio and visual modalities to perception of Mandarin Chinese emotions in valence-arousal space

  2024cites this paper
• Emotional multisensory integration in 5- to 6-year-old children occurs early rather than late: ERP evidence

  2024cites this paper
• Abnormal stability of dynamic functional architecture in drug‐naïve children with attention‐deficit/hyperactivity disorder

  2024cites this paper
• Valence and arousal perception among first language users, foreign language users, and naïve listeners of Mandarin across various communication modalities

  2024cites this paper
• Neural Representations of Emotions in Visual, Auditory, and Modality‐Independent Regions Reflect Idiosyncratic Conceptual Knowledge

  2024cites this paper
• Impaired emotional multimodal integration in inhibition of return in children with attention-deficit/hyperactivity disorder

  2024cites this paper
• Effects of executive function on age-related emotion recognition decline varied by sex.

  2024cites this paper
• Conversational facial signals combine into compositional meanings that change the interpretation of speaker intentions

  2024cites this paper
• The emotion of sound target modulates the auditory gaze cueing effect

  2024cites this paper
• When the central integrator disintegrates: A review of the role of the thalamus in cognition and dementia

  2023cites this paper
• Attentional Relevance Modulates Nonverbal Attractiveness Perception in Multimodal Display

  2023cites this paper
• Dominance of face over voice in human attractiveness judgments: ERP evidence.

  2023cites this paper
• Dynamic causal modeling analysis reveals the modulation of motor cortex and integration in superior temporal gyrus during multisensory speech perception

  2023influential citation
• Aberrant neural correlates of multisensory processing of audiovisual social cues related to social anxiety: An electrophysiological study

  2023cites this paper
• Pupil dilation reflects the dynamic integration of audiovisual emotional speech

  2023influential citation
• Impairments in recognition of emotional facial expressions, affective prosody, and multisensory facilitation of response time in high-functioning autism

  2023cites this paper
• How Communication Happens—Where Physical Properties and Meaning Meet in the Brain: Evidence from Semantic, Prosodic and Face Processing Studies

  2022cites this paper
• Multisensory integration effect of humanoid robot appearance and voice on users’ affective preference and visual attention

  2022cites this paper
• Neural correlates of multisensory integration in the human brain: an ALE meta-analysis

  2022cites this paper
• Hippocampal temporal-parietal junction interaction in the production of psychotic symptoms: a framework for understanding the schizophrenic syndrome

  2022cites this paper
• Anterior cingulate glutamate levels associate with functional activation and connectivity during sensory integration in schizophrenia: a multimodal 1H-MRS and fMRI study

  2022cites this paper
• Impact of Background Noise and Contribution of Visual Information in Emotion Identification by Native Mandarin Speakers

  2022cites this paper
• Predicting emotion from music videos: exploring the relative contribution of visual and auditory information to affective responses

  2022cites this paper
• Distinct functional levels of human voice processing in the auditory cortex

  2022cites this paper
• Brain responses in aggression-prone individuals: A systematic review and meta-analysis of functional magnetic resonance imaging (fMRI) studies of anger- and aggression-eliciting tasks

  2022cites this paper
• Integrative interaction of emotional speech in audio-visual modality

  2022cites this paper
• Auditory cortical micro-networks show differential connectivity during voice and speech processing in humans

  2021cites this paper
• Performing Early Christian Literature

  2021cites this paper
• Nonverbal cues of anxiety in English class presentation: From self- and other-perspectives

  2021cites this paper
• Judgmental perception of co-speech gestures in MDD.

  2021cites this paper
• Auditory cortical micro-networks show differential connectivity during voice and speech processing in humans

  2021cites this paper
• Pre-SMA activation and the perception of contagiousness and authenticity in laughter sounds.

  2021cites this paper
• Bupropion increases cerebral activation in auditory affective processing: A randomized controlled fMRI study.

  2021cites this paper
• Incongruence effects in cross-modal emotional processing in autistic traits:An fMRI study.

  2021cites this paper
• Meta-Analyses Support a Taxonomic Model for Representations of Different Categories of Audio-Visual Interaction Events in the Human Brain

  2021influential citation
• Weighted RSA: an improved framework on the perception of audio-visual affective speech in left insula and superior temporal gyrus

  2020cites this paper
• Vibrotactile Captioning of Musical Effects in Audio-Visual Media as an Alternative for Deaf and Hard of Hearing People: An EEG Study

  2020cites this paper
• Prosodic influence in face emotion perception: evidence from functional near-infrared spectroscopy

  2020cites this paper
• Nonverbal Auditory Communication - Evidence for Integrated Neural Systems for Voice Signal Production and Perception.

  2020cites this paper
• Behavioral and neural fusion of expectation with sensation

  2020cites this paper
• Behavioral inhibition system sensitivity moderates audio-visual neutral information processing.

  2020cites this paper
• Neural Basis of Impaired Emotion Recognition in Adult Attention-Deficit/Hyperactivity Disorder.

  2020cites this paper
• Culture influences audiovisual emotion perception in early sensory areas

  2020cites this paper
• Audiovisual Representations of Valence: a Cross-study Perspective

  2020cites this paper
• The Body-Threat Assessment Battery (BTAB): A new instrument for the quantification of threat-related autonomic affective responses induced via dynamic movie clips.

  2020cites this paper
• Brain Networks of Emotional Prosody Processing

  2020cites this paper
• Facial expressions of authenticity: Emotion variability increases judgments of trustworthiness and leadership.

  2019cites this paper
• Multisensory processing of facial expressions in binocular rivalry.

  2019cites this paper
• Aggression modulates neural correlates of hostile intention attribution to laughter in children

  2019cites this paper
• The brain basis of audiovisual affective processing: Evidence from a coordinate-based activation likelihood estimation meta-analysis.

  2019cites this paper
• Event-Related Potentials Reveal Evidence for Late Integration of Emotional Prosody and Facial Expression in Dynamic Stimuli: An ERP Study.

  2019cites this paper
• Combined Processing of Facial and Vocal Emotion in Remitted Patients With Bipolar I Disorder

  2019cites this paper
• Idiomatic expressions evoke stronger emotional responses in the brain than literal sentences.

  2019cites this paper
• Hormonal and modality specific effects on males’ emotion recognition ability

  2019cites this paper
• Hear it, fear it: Fear generalizes from conditioned pictures to semantically related sounds.

  2019cites this paper
• Happy emotion cognition of bimodal audiovisual stimuli optimizes the performance of the P300 speller

  2019cites this paper
• Musical Expertise Affects Audiovisual Speech Perception: Findings From Event-Related Potentials and Inter-trial Phase Coherence

  2019cites this paper
• No intermodal interference effects of threatening information during concurrent audiovisual stimulation.

  2019cites this paper
• Multimodal Integration of Emotional Signals from Voice, Body, and Context: Effects of (In)Congruence on Emotion Recognition and Attitudes Towards Robots

  2019cites this paper
• Human amygdala response to unisensory and multisensory emotion input: No evidence for superadditivity from intracranial recordings.

  2019cites this paper
• The Neural Correlates of Face-Voice-Integration in Social Anxiety Disorder

  2019cites this paper
• The integration of facial expression and vocal emotion and its brain mechanism

  2019cites this paper
• Intégration sensorielle chez les individus ayant un trouble du spectre de l’autisme

  2019cites this paper
• Examining face-sensitive brain potentials in natural environments using mobile EEG

  2019cites this paper
• Functional connectivity of PAG with core limbic system and laryngeal cortico-motor structures during human phonation.

  2019cites this paper
• The audio-visual integration effect on music emotion: Behavioral and physiological evidence

  2019cites this paper
• Sulcus temporalis superior a jeho funkční význam superior temporal sulcus and its functions

  2019cites this paper
• Clinical experience changes the combination and the weighting of audio-visual sources of information.

  2018cites this paper
• Temporal dynamics of audiovisual affective processing.

  2018cites this paper
• The cognition of auditory smiles: a computational approach

  2018cites this paper
• Dynamic Facial Expressions Prime the Processing of Emotional Prosody

  2018influential citation
• McGurk Effect by Individuals with Autism Spectrum Disorder and Typically Developing Controls: A Systematic Review and Meta-analysis

  2018cites this paper
• Visual and auditory brain areas share a representational structure that supports emotion perception

  2018cites this paper
• The connectivity signature of co‐speech gesture integration: The superior temporal sulcus modulates connectivity between areas related to visual gesture and auditory speech processing

  2018cites this paper
• Examining the role of temporal prediction in multisensory emotion perception

  2018cites this paper
• Visual and auditory brain areas share a neural code for perceived emotion

  2018cites this paper
• Artificial agents as social companions: design guidelines for emotional interactions

  2018cites this paper
• Emotion recognition ability across different modalities: The role of language status (L1/LX), proficiency and cultural background

  2018cites this paper
• Emotion recognition problems after brain injury : development of the Brief Emotion Recognition Test (BERT)

  2018cites this paper
• Cerebral resting state markers of biased perception in social anxiety

  2018cites this paper
• Effects of the Simultaneous Presentation of Corresponding Auditory and Visual Stimuli on Size Variance Perception

  2018cites this paper
• The role of autistic traits in the perception of emotion from faces and voices: a behavioural and fMRI investigation

  2018cites this paper
• Modeling Development of Multimodal Emotion Perception Guided by Tactile Dominance and Perceptual Improvement

  2018cites this paper