Mechanisms of facial emotion recognition in autism spectrum disorders: Insights from eye tracking and electroencephalography

HIGHLIGHTSIndividuals with Autism Spectrum Disorder present with atypical gaze and cortical activation to facially expressed emotions.Individuals with Autism Spectrum Disorder may use compensatory strategies during facial emotion recognition.Individuals with Autism Spectrum Disorder may employ self‐regulatory strategies during facial emotion recognition.Eye tracking and electroencephalography findings may provide potential markers for diagnosis and treatment targets. ABSTRACT While behavioural difficulties in facial emotion recognition (FER) have been observed in individuals with Autism Spectrum Disorder (ASD), behavioural studies alone are not suited to elucidate the specific nature of FER challenges in ASD. Eye tracking (ET) and electroencephalography (EEG) provide insights in to the attentional and neurological correlates of performance, and may therefore provide insight in to the mechanisms underpinning FER in ASD. Given that these processes develop over the course of the developmental trajectory, there is a need to synthesise findings in regard to the developmental stages to determine how the maturation of these systems may impact FER in ASD. We conducted a systematic review of fifty‐four studies investigating ET or EEG meeting inclusion criteria. Findings indicate divergence of visual processing pathways in individuals with ASD. Altered function of the social brain in ASD impacts the processing of facial emotion across the developmental trajectory, resulting in observable differences in ET and EEG outcomes.

• Publication year

  2017

• Venue

  Neuroscience and Biobehavioral Reviews

• Publication date

  2017-09-01

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1016/j.neubiorev.2017.06.016PMID 28698082
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Face Recognition

  2018cited by this paper
• Continuous EEG monitoring in the intensive care unit.

  2017cited by this paper
• The “Eye Avoidance” Hypothesis of Autism Face Processing

  2016cited by this paper
• Facial affect recognition in autism, ADHD and typical development

  2016influential reference
• Basic and complex emotion recognition in children with autism: cross-cultural findings

  2016cited by this paper
• The Prevalence of Mild Cognitive Impairment in Diverse Geographical and Ethnocultural Regions: The COSMIC Collaboration

  2015cited by this paper
• Diagnostic and Statistical Manual of Mental Disorders (DSM-5)

  2015cited by this paper
• Voluntary attention in Asperger's syndrome: Brain electrical oscillation and phase-synchronization during facial emotion recognition

  2015cited by this paper
• Morphing technique reveals intact perception of object motion and disturbed perception of emotional expressions by low-functioning adolescents with Autism Spectrum Disorder.

  2015influential reference
• Face Recognition and Visual Search Strategies in Autism Spectrum Disorders: Amending and Extending a Recent Review by Weigelt et al.

  2015cited by this paper
• Autistic traits influence gaze-oriented attention to happy but not fearful faces

  2015influential reference
• Comorbid Social Anxiety Disorder in Adults with Autism Spectrum Disorder

  2015cited by this paper
• Implicit Discrimination of Basic Facial Expressions of Positive/Negative Emotion in Fragile X Syndrome and Autism Spectrum Disorder.

  2015influential reference
• Training-induced plasticity of the social brain in autism spectrum disorder

  2015cited by this paper
• Mapping the development of facial expression recognition.

  2015cited by this paper
• Fear of Negative Evaluation Influences Eye Gaze in Adolescents with Autism Spectrum Disorder: A Pilot Study

  2015influential reference
• The time course of emotional picture processing: an event-related potential study using a rapid serial visual presentation paradigm

  2015cited by this paper
• Positive Affect Processing and Joint Attention in Infants at High Risk for Autism: An Exploratory Study

  2015influential reference
• Pupillometry reveals reduced unconscious emotional reactivity in autism.

  2014influential reference
• Altered right frontal cortical connectivity during facial emotion recognition in children with autism spectrum disorders

  2014cited by this paper
• Autism Spectrum Disorder: Defining Dimensions and Subgroups

  2014cited by this paper
• Impairments in facial affect recognition associated with autism spectrum disorders: A meta-analysis

  2014cited by this paper
• Altered neurophysiological responses to emotional faces discriminate children with ASD, ADHD and ASD+ADHD.

  2014cited by this paper
• Age-related differences in working memory evoked gamma oscillations.

  2014cited by this paper
• Elevated amygdala response to faces and gaze aversion in autism spectrum disorder.

  2014influential reference
• Reactivity to fearful expressions of familiar and unfamiliar people in children with autism: an eye-tracking pupillometry study

  2014influential reference
• No Differences in Emotion Recognition Strategies in Children with Autism Spectrum Disorder: Evidence from Hybrid Faces

  2014cited by this paper
• Assessing the Utility of a Virtual Environment for Enhancing Facial Affect Recognition in Adolescents with Autism

  2014influential reference
• Facial emotion recognition and visual search strategies of children with high functioning autism and Asperger syndrome

  2013influential reference
• Multimodal emotion processing in autism spectrum disorders: an event-related potential study.

  2013influential reference
• Dopaminergic foundations of schizotypy as measured by the German version of the Oxford-Liverpool Inventory of Feelings and Experiences (O-LIFE)—a suitable endophenotype of schizophrenia

  2013cited by this paper
• Understanding How Adolescents with Autism Respond to Facial Expressions in Virtual Reality Environments

  2013influential reference
• Altered automatic face processing in individuals with high-functioning autism spectrum disorders: Evidence from visual evoked potentials

  2013influential reference
• Recognition of Emotions in Autism: A Formal Meta-Analysis

  2013influential reference
• Spontaneous attention to faces in Asperger syndrome using ecologically valid static stimuli

  2013cited by this paper
• Are emotion impairments unique to, universal, or specific in autism spectrum disorder? A comprehensive review

  2013influential reference
• The language of emotions: An analysis of a semantic field

  2013cited by this paper
• Divergent Patterns of Social Cognition Performance in Autism and 22q11.2 Deletion Syndrome (22q11DS)

  2013influential reference
• Beta event-related desynchronization as an index of individual differences in processing human facial expression: further investigations of autistic traits in typically developing adults

  2013influential reference
• Visual Afterimages of Emotional Faces in High Functioning Autism

  2012cited by this paper
• Differentiating High-Functioning Autism and Social Phobia

  2012cited by this paper
• Investigating phenotypic heterogeneity in children with autism spectrum disorder: a factor mixture modeling approach.

  2012cited by this paper
• Measuring affective reactivity in individuals with autism spectrum personality traits using the visual mismatch negativity event-related brain potential

  2012influential reference
• The Influence of Shyness on the Scanning of Own- and Other-Race Faces in Adults

  2012cited by this paper
• Eye-Tracking, Autonomic, and Electrophysiological Correlates of Emotional Face Processing in Adolescents with Autism Spectrum Disorder

  2012cited by this paper
• Win-Stay-Lose-Learn Promotes Cooperation in the Spatial Prisoner's Dilemma Game

  2012cited by this paper
• The Role of the Amygdala in Atypical Gaze on Emotional Faces in Autism Spectrum Disorders

  2012influential reference
• Is EEG-biofeedback an Effective Treatment in Autism Spectrum Disorders? A Randomized Controlled Trial

  2012cited by this paper
• The eyes have it: making positive expressions more positive and negative expressions more negative.

  2012cited by this paper
• Face identity recognition in autism spectrum disorders: a review of behavioral studies.

  2012cited by this paper
• Emotional Cues during Simultaneous Face and Voice Processing: Electrophysiological Insights

  2012cited by this paper
• INDUCED EEG GAMMA OSCILLATION ALIGNMENT IMPROVES DIFFERENTIATION BETWEEN AUTISM AND ADHD GROUP RESPONSES IN A FACIAL CATEGORIZATION TASK.

  2012cited by this paper
• Multisensory Integration and Attention in Autism Spectrum Disorder: Evidence from Event-Related Potentials

  2011cited by this paper
• The N170 component and its links to configural face processing: a rapid neural adaptation study.

  2011influential reference
• Face recognition in Asperger syndrome: a study on EEG spectral power changes.

  2011cited by this paper
• The Face-Sensitivity of the N170 Component

  2011cited by this paper
• Cross-frequency coupling of brain oscillations in studying motivation and emotion

  2011cited by this paper
• Psychophysiological Markers of Vulnerability to Psychopathology in Men with an Extra X Chromosome (XXY)

  2011cited by this paper
• Evidence for a general face salience signal in human amygdala

  2011cited by this paper
• Happy mouth and sad eyes: scanning emotional facial expressions.

  2011cited by this paper
• Early processing of emotional faces in children with autism: An event-related potential study.

  2011influential reference
• Autistic Symptomatology, Face Processing Abilities, and Eye Fixation Patterns

  2011influential reference
• Can Gaze Avoidance Explain Why Individuals with Asperger’s Syndrome Can’t Recognise Emotions From Facial Expressions?

  2011cited by this paper
• Neurofeedback in autism spectrum disorders

  2011cited by this paper
• Behavioral and Neural Representation of Emotional Facial Expressions Across the Lifespan

  2011cited by this paper
• Recognition of Facially Expressed Emotions and Visual Search Strategies in Adults with Asperger Syndrome.

  2011influential reference
• Emotion Recognition in Children with Autism Spectrum Disorders: Relations to Eye Gaze and Autonomic State

  2010influential reference
• Facial Emotion Recognition in Autism Spectrum Disorders: A Review of Behavioral and Neuroimaging Studies

  2010influential reference
• The Heavy Burden of Psychiatric Comorbidity in Youth with Autism Spectrum Disorders: A Large Comparative Study of a Psychiatrically Referred Population

  2010cited by this paper
• Basic abnormalities in visual processing affect face processing at an early age in autism spectrum disorder.

  2010cited by this paper
• The effect of gaze direction on the processing of facial expressions in children with autism spectrum disorder: an ERP study.

  2010influential reference
• Atypical Reflexive Gaze Patterns on Emotional Faces in Autism Spectrum Disorders

  2010influential reference
• Is Emotion Recognition Impaired in Individuals with Autism Spectrum Disorders?

  2010cited by this paper
• Face scanning distinguishes social from communication impairments in autism.

  2010influential reference
• Cochrane Handbook for Systematic Reviews of Interventions

  2010cited by this paper
• Eight Problems for the Mirror Neuron Theory of Action Understanding in Monkeys and Humans

  2009cited by this paper
• Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement

  2009cited by this paper
• Exploration of core features of a human face by healthy and autistic adults analyzed by visual scanning.

  2009influential reference
• The Role of Rapid Diagnostic Tests in Managing Malaria

  2009cited by this paper
• Event-related potential: An overview

  2009cited by this paper
• Emotion Recognition in Children and Adolescents with Autism Spectrum Disorders

  2009cited by this paper
• Atypical eye contact in autism: models, mechanisms and development.

  2009cited by this paper
• Avoidance of emotionally arousing stimuli predicts social-perceptual impairment in Asperger's syndrome.

  2008influential reference
• Rapid Interactions between the Ventral Visual Stream and Emotion-Related Structures Rely on a Two-Pathway Architecture

  2008cited by this paper
• ReviewWhat does phase information of oscillatory brain activity tell us about cognitive processes ?

  2008cited by this paper
• Brief Report: Perception of Genuine and Posed Smiles by Individuals with Autism

  2008influential reference
• Do hyperactivity, impulsivity and inattention have an impact on the ability of facial affect recognition in children with autism and ADHD?

  2008cited by this paper
• Mirror neuron activation is associated with facial emotion processing.

  2008cited by this paper
• Attentional effects of gaze shifts are influenced by emotion and spatial frequency, but not in autism.

  2008cited by this paper
• Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample.

  2008cited by this paper
• Atypical processing of fearful face-voice pairs in Pervasive Developmental Disorder: an ERP study.

  2008influential reference
• Young children with Autism Spectrum Disorder look differently at positive versus negative emotional faces

  2008influential reference
• Abnormal spatiotemporal processing of emotional facial expressions in childhood autism: dipole source analysis of event‐related potentials

  2008cited by this paper
• Brain function and gaze fixation during facial‐emotion processing in fragile X and autism

  2008influential reference
• Continuous EEG monitoring in the Intensive Care Unit

  2008cited by this paper
• Scan Path Differences and Similarities During Emotion Perception in those With and Without Autism Spectrum Disorders

  2008influential reference
• Neurophysiological responses to face, facial regions and objects in adults with Asperger's syndrome: an ERP investigation.

  2007cited by this paper
• Abnormal Use of Facial Information in High-Functioning Autism

  2007cited by this paper
• Orienting to social stimuli differentiates social cognitive impairment in autism and schizophrenia.

  2007cited by this paper
• Assessing emotion recognition in 9–15-years olds: Preliminary analysis of abilities in reading emotion from faces, voices and eyes

  2007cited by this paper

• Understanding emotions through biological motion in autism spectrum disorder: A systematic review

  2026cites this paper
• Specific Brain Activity During Theory of Mind Tasks in Autistic Individuals: A Meta‐Analysis of fMRI Studies

  2026cites this paper
• A reverse hierarchy theory of social perception

  2026cites this paper
• Pupil Dilation to Dynamic Audiovisual Emotional Speech Reflects Autistic‐Trait Variation in Neurotypical Adults

  2026cites this paper
• Examining Virtual Reality Interventions for Social Skills in Children with Autism Spectrum Disorder: A Systematic Review.

  2025cites this paper
• Identifying Children With Autism Spectrum Disorder via Transformer-Based Representation Learning From Dynamic Facial Cues

  2025cites this paper
• Emotion Recognition in Autistic Children Through Facial Expressions Using Advanced Deep Learning Architectures

  2025cites this paper
• Exploring the Broader Autism Phenotype: How Alexithymia Impacts Recognition of Facial Expressions of Pain.

  2025cites this paper
• Machine learning in automated diagnosis of autism spectrum disorder: a comprehensive review

  2025cites this paper
• Eye-Tracking as a Screening Tool in the Early Diagnosis of Autism Spectrum Disorder: A Systematic Review and Meta-Analysis

  2025cites this paper
• Autistic traits, alexithymia, and emotion recognition of human and anime faces.

  2025cites this paper
• Altered interactive dynamics of gaze behavior during face-to-face interaction in autistic individuals: a dual eye-tracking study

  2025cites this paper
• Evolutionary constrained genes associated with autism spectrum disorder across 2,054 nonhuman primate genomes

  2025cites this paper
• Investigating Eye Movements to Examine Attachment-Related Differences in Facial Emotion Perception and Face Memory

  2025cites this paper
• The traumatic stress response in children with autism spectrum disorder – a case series

  2025cites this paper
• Social cognition in autism and ADHD.

  2025cites this paper
• Understanding face processing in autism spectrum disorder: insights from cognitive neuroscience

  2025cites this paper
• Social rejection in minority groups and its impact on current and future mental health: a study in transgender people

  2025cites this paper
• Teach Yourself to Learn (Facial) Expressions: An Acceptability and Usability Study of an App Teaching Facial Emotion Recognition Skills to Autistic Children

  2025cites this paper
• Facial Expression Databases and Autism Spectrum Disorder: A Scoping Review

  2025cites this paper
• Using EEG and Eye Tracking to Evaluate an Emotion Recognition iPad App for Autistic Children

  2025cites this paper
• Social Cognition in Cervical Dystonia: Integrating EEG and Eye-Tracking for Insights on Emotional Face Recognition

  2025cites this paper
• Recognition of Authentic Happy and Sad Facial Expressions in Chinese Elementary School Children: Evidence from Behavioral and Eye-Movement Studies

  2025cites this paper
• Neuroimaging Evidence of Facial Emotion Processing in Autism Spectrum Disorder: A Meta-Analysis of Functional Neuroimaging Studies.

  2025cites this paper
• A New AI Framework to Support Social-Emotional Skills and Emotion Awareness in Children with Autism Spectrum Disorder

  2025cites this paper
• Emotion recognition deficits in children and adolescents with autism spectrum disorder: a comprehensive meta-analysis of accuracy and response time

  2025cites this paper
• Cortico-Ocular Coupling Analysis for Developmental and Behavioral Disorders: A Review

  2025cites this paper
• Differential mask effects on emotion recognition and eye movements in Psychotic-like experiences and autism: Insights from hidden Markov Modeling.

  2025cites this paper
• Investigating face exploration patterns and facial emotion recognition abilities in children with autism spectrum disorder (ASD)

  2025cites this paper
• Feasibility of internet-based multimodal emotion recognition training in adolescents with and without autism: A pilot study

  2025cites this paper
• From Gaze to Interaction: Links Between Visual Attention, Facial Expression Identification, and Behavior of Children Diagnosed with ASD or Typically Developing Children with an Assistance Dog

  2025cites this paper
• Facial Emotion Recognition in Neurodevelopmental Disorders: A Comparative Study in Children and Adolescents With and Without Autism, ADHD and Specific Learning Disorders.

  2025cites this paper
• Intact representation of vocal smile in autism: A reverse correlation approach

  2025cites this paper
• Bridging Genetic Insights with Neuroimaging in Autism Spectrum Disorder—A Systematic Review

  2024cites this paper
• Bilingualism Predicts Affective Theory of Mind in Autistic Adults.

  2024cites this paper
• Temporal dynamics and neural variabilities underlying the interplay between emotion and inhibition in autistic children.

  2024cites this paper
• Correlation Between Gaze Behaviors and Social Communication Skills of Young Autistic Children: A Meta-Analysis of Eye-Tracking Studies

  2024cites this paper
• Temporal characteristics of facial ensemble in individuals with autism spectrum disorder: examination from arousal and attentional allocation

  2024cites this paper
• EEG Emotion Recognition Network Based on Attention and Spatiotemporal Convolution

  2024cites this paper
• Characterizing Autism Spectrum Disorder Through Fusion of Local Cortical Activation and Global Functional Connectivity Using Game-Based Stimuli and a Mobile EEG System

  2024cites this paper
• Let's face it! The role of social anxiety and executive functions in recognizing others' emotions from faces: Evidence from autism and specific learning disorders.

  2024cites this paper
• Probing a neural unreliability account of auditory sensory processing atypicalities in Rett Syndrome.

  2024cites this paper
• Mapping brain function in adults and young children during naturalistic viewing with high‐density diffuse optical tomography

  2024cites this paper
• Troubles psychiques et reconnaissance des émotions faciales

  2024cites this paper
• Emotion recognition based on EEG source signals and dynamic brain function network

  2024cites this paper
• Parental Sensory Processing Sensitivity Predicts Children’s Visual Scanning Pattern of Emotional Faces

  2024cites this paper
• Evaluation of the Social Attention Hypothesis: Do Children with Autism Prefer to See Objects Rather than People?

  2024cites this paper
• Facial animacy in anthropomorphised designs: Insights from leveraging self-report and facial expression analysis for multimedia learning

  2024cites this paper
• An fMRI study on alexithymia and affective state recognition in the Reading the Mind in the Eyes Test

  2024cites this paper
• Physiological signal analysis using explainable artificial intelligence: A systematic review

  2024cites this paper
• Otizm Belirtilerinin Erken Tespitinde Duygu Durumlarına Yöneltilen Görsel Dikkatin Makine Öğrenmesi Aracılığıyla Değerlendirilmesi

  2024cites this paper
• Deep Learning Methods on Recognizing Autism Spectrum Disorder

  2024cites this paper
• New eye tracking metrics system: the value in early diagnosis of autism spectrum disorder

  2024cites this paper
• Exploring the impact of parents' face-mask wearing on dyadic interactions in infants at higher likelihood for autism compared with general population.

  2024cites this paper
• Utilizing deep learning models in an intelligent eye-tracking system for autism spectrum disorder diagnosis

  2024cites this paper
• Emotional processing in binge drinking, tobacco use disorder and their comorbidity in youth: A preregistered PRISMA scoping review.

  2024cites this paper
• P‐4.9: A comprehensive study of VR exposure therapy combined with EEG signals in the treatment of psychiatric disorders

  2024cites this paper
• Nostalgia, authenticity and wellbeing in autistic and non-autistic young adults

  2024cites this paper
• Seeing beyond words: Visualizing autism spectrum disorder biomarker insights

  2024cites this paper
• Research and Analysis on the Characteristics of College Students' Emotional Face Processing Based on Computer Vision Technology

  2024cites this paper
• A Review of the Application of Eye Tracking Technology in Personnel Psychological Selection

  2024cites this paper
• A comparison of visual attention to pictures in the Autism Diagnostic Observation Schedule in children and adolescents with ADHD and/or autism

  2024cites this paper
• The differential outcomes procedure for improving the recognition of dynamic facial expressions of emotion in people with autism spectrum disorders and first-degree relatives

  2024cites this paper
• Probing a neural unreliability account of auditory sensory processing atypicalities in Rett Syndrome

  2024cites this paper
• Sensorimotor regulation of facial expression – An untouched frontier

  2024cites this paper
• Eye-Tracking Methodology to Detect Differences in Attention to Faces Between Developmental Language Disorder and Autism.

  2024cites this paper
• Facial emotion recognition in children with autism spectrum disorder: Are emotional primes effective?

  2024cites this paper
• Self-Supervised EEG Emotion Recognition Models Based on CNN

  2023cites this paper
• Emotional Intelligence in Autistic Adults: A Review with Considerations for Employers

  2023cites this paper
• Facial emotion recognition processes according to schizotypal personality traits: An eye-tracking study.

  2023cites this paper
• Attentional biases in facial emotion processing in individuals at clinical high risk for psychosis

  2023cites this paper
• Impairment in reading negative social cues extends beyond the face in autism.

  2023cites this paper
• Design and Development of Application for Children Suffering from Autism Spectrum Disorder using Machine Learning

  2023cites this paper
• Neural Network Implementation of Gaze-Target Prediction for Human-Robot Interaction

  2023cites this paper
• Eye gaze During Semi-naturalistic Face-to-Face Interactions in Autism

  2023cites this paper
• Emotion recognition in autism spectrum condition during the COVID-19 pandemic

  2023cites this paper
• Evolutionary constraint genes implicated in autism spectrum disorder across 2,054 nonhuman primate genomes

  2023cites this paper
• Altered task induced functional brain networks and small-world properties in autism

  2023influential citation
• Current development of biosensing technologies towards diagnosis of mental diseases

  2023cites this paper
• Discriminative Few Shot Learning of Facial Dynamics in Interview Videos for Autism Trait Classification

  2023cites this paper
• Neural sensitivity to facial identity and facial expression discrimination in adults with autism

  2023cites this paper
• Detection of auditory hallucinations from electroencephalographic brain-computer interface signals

  2023cites this paper
• A review of machine learning-based methods for automatically detecting autism spectrum disorder in children's faces

  2023cites this paper
• Face perception and facial emotional expression recognition ability: Both unique predictors of the broader autism phenotype

  2023cites this paper
• Preventive effects of resveratrol against early-life impairments in the animal model of autism induced by valproic acid

  2023cites this paper
• Facial Expression Recognition Through Cross-Modality Attention Fusion

  2023cites this paper
• Identification of diagnostic markers for ASD: a restrictive interest analysis based on EEG combined with eye tracking

  2023cites this paper
• Eye Tracking Biomarkers for Autism Spectrum Disorder Detection using Machine Learning and Deep Learning Techniques: Review

  2023cites this paper
• A Hybrid Wearable Technology Model for Autism Behaviour Intervention: Components and Elements Analysis

  2023cites this paper
• Emotion Recognition in Children and Adolescents with ASD and ADHD: a Systematic Review

  2023cites this paper
• Design of Cloud-Based Real-Time Eye-Tracking Monitoring and Storage System

  2023cites this paper
• Social attention and autism in early childhood: Evidence on behavioral markers based on visual scanning of emotional faces with eye-tracking methodology

  2022cites this paper
• Associations between emotion recognition and autistic and callous‐unemotional traits: differential effects of cueing to the eyes

  2022cites this paper
• Frequent experience with face coverings for 10 months improves emotion perception among individuals with high autistic traits: A repeated cross-sectional study

  2022cites this paper
• Emotion processing differences mediate the link between sex and autistic traits in young adulthood

  2022cites this paper
• Effects of Parent Intervention via Tele-Practice on Children with Autism Spectrum Disorder in Rural Mississippi

  2022cites this paper
• An exploration of the impact of contextual information on the emotion recognition ability of autistic adults

  2022cites this paper
• Face Masks Impair Basic Emotion Recognition

  2022cites this paper
• A Trend on Autism Spectrum Disorder Research: Eye Tracking-EEG Correlative Analytics

  2022cites this paper
• The dual neural effects of oxytocin in autistic youth: results from a randomized trial

  2022cites this paper