Exploring emotional and cognitive engagement during playing a serious game: using EEG and interview data

Serious games have been widely designed and applied in various fields. Engagement with multidimensional nature is a crucial quality of user experience. This study aimed to investigate the emotional and cognitive engagement during playing a serious game by evidence from electroencephalography (EEG) and interview data. The experiment was conducted to collect participants’ EEG signals including resting phase and serious game phase. There were 40 participants in the experiment, and the data obtained from 36 participants were analyzed. User engagement was quantified based on EEG band power, and examined through statistical analysis. Additionally, the content of semi-structured interviews was recorded for qualitative interpretation. The results indicated that valence and arousal served as parallel partial mediators in the influence of attention on holistic engagement with similar effects. The oscillations in the theta, alpha, beta, and gamma frequency bands of players demonstrated the cognitive and emotional processing during playing a serious game. The present study contributes to the understanding of the multidimensionality of engagement and the neural mechanism underlying engagement during playing a serious game. Furthermore, the results may have implications for the development of more effective serious games for learning and training purposes.

• Publication year

  2024

• Venue

  Proceedings of the Twelfth International Symposium of Chinese CHI

• Publication date

  2024-11-22

• Fields of study

  Not labeled

• Identifiers
  DOI 10.1145/3758871.3758916
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Brand embeddedness in advergames through brand–game congruence and brand prominence: a typology of ways to design a game around a brand

  2024cited by this paper
• Real-time estimation of EEG-based engagement in different tasks

  2024cited by this paper
• Psychophysiological Investigation of the Effects of Virtual Reality, the New Dimension of Retail Shopping, on Generation Z

  2024cited by this paper
• Game elements enhance engagement and mitigate attrition in online learning tasks

  2023cited by this paper
• Understanding the Impacts of Storytelling and Player Perspective on Learning Outcomes: The Mediating Roles of Engagements

  2023cited by this paper
• Factors Influencing Engagement in Hybrid Virtual and Augmented Reality

  2023cited by this paper
• EEG-based measurement system for monitoring student engagement in learning 4.0

  2022cited by this paper
• A Mixed-Methods Study of Cultural Heritage Learning through Playing a Serious Game

  2022cited by this paper
• Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review

  2022cited by this paper
• Predict Students’ Attention in Online Learning Using EEG Data

  2022cited by this paper
• Frontal EEG-Based Multi-Level Attention States Recognition Using Dynamical Complexity and Extreme Gradient Boosting

  2021cited by this paper
• EEG in game user analysis: A framework for expertise classification during gameplay

  2021cited by this paper
• A digital role-playing game for learning: effects on critical thinking and motivation

  2021cited by this paper
• Analyzing the relationships between learners' motivation and observable engaged behaviors in a gamified learning environment

  2021cited by this paper
• Attention: The grounds of self-regulated cognition.

  2021cited by this paper
• Multiple Exposures Enhance Both Item Memory and Contextual Memory Over Time

  2020cited by this paper
• Enhancing Learning Performance and Motivation of Cultural Heritage Using Serious Games

  2020cited by this paper
• Acting, thinking, feeling, making, collaborating: The engagement process in foreign language learning

  2019cited by this paper
• Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI

  2019cited by this paper
• A Systematic Review of the Definition and Measurement of Engagement in Serious Games

  2019cited by this paper
• Effects of Valence and Emotional Intensity on the Comprehension and Memorization of Texts

  2019cited by this paper
• Tracking Students’ Mental Engagement Using EEG Signals during an Interaction with a Virtual Learning Environment

  2019cited by this paper
• Video Games

  2018cited by this paper
• Engagement in HCI

  2018cited by this paper
• Investigating the multidimensionality of engagement: Affective, behavioral, and cognitive engagement across science activities and contexts

  2018cited by this paper
• Identifying Cognitive Assistance with Mobile Electroencephalography

  2018cited by this paper
• A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form

  2018cited by this paper
• Emotion and the Prefrontal Cortex: An Integrative Review

  2017cited by this paper
• Frontal EEG theta/beta ratio as an electrophysiological marker for attentional control and its test-retest reliability.

  2016cited by this paper
• From Behavior to Neural Dynamics: An Integrated Theory of Attention.

  2015cited by this paper
• Evaluating player task engagement and arousal using electroencephalography

  2015cited by this paper
• Emotional conflict processing induce boosted theta oscillation.

  2015cited by this paper
• Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns

  2014cited by this paper
• Emotional valence and arousal affect reading in an interactive way: Neuroimaging evidence for an approach-withdrawal framework

  2014cited by this paper
• Recognizing the Degree of Human Attention Using EEG Signals from Mobile Sensors

  2013cited by this paper
• Theta and Gamma Power Increases and Alpha/Beta Power Decreases with Memory Load in an Attractor Network Model

  2011cited by this paper
• A taxonomy of external and internal attention.

  2011cited by this paper
• From game design elements to gamefulness: defining "gamification"

  2011cited by this paper
• Complex brain networks: graph theoretical analysis of structural and functional systems

  2009cited by this paper
• What is user engagement? A conceptual framework for defining user engagement with technology

  2008cited by this paper
• Emotional Valence and Arousal Interact in Attentional Control

  2008cited by this paper
• Human gamma-frequency oscillations associated with attention and memory.

  2007cited by this paper
• EEG differences between eyes-closed and eyes-open resting conditions.

  2007cited by this paper
• School Engagement: Potential of the Concept, State of the Evidence

  2004cited by this paper
• EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis.

  2004cited by this paper
• Biocybernetic system evaluates indices of operator engagement in automated task.

  1995cited by this paper
• Cerebral asymmetry and emotion: Conceptual and methodological conundrums

  1993cited by this paper
• EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes.

  1985cited by this paper
• Human Neuroscience Original Research Article Correlated Components of Ongoing Eeg Point to Emotionally Laden Attention – a Possible Marker of Engagement?

  year unknowncited by this paper

• No citing papers are available for this paper.