Multimodal Fusion of Muscle and Brain Signals for a Hybrid-BCI

Practical Brain-Computer Interfaces (BCIs) for disabled people should allow them to use all their remaining functionalities as control possibilities. Sometimes these people have residual activity of their muscles, most likely in the morning when they are not exhausted. In this work we fuse electromyographic (EMG) with electroencephalographic (EEG) activity in the framework of a so called “Hybrid-BCI” (hBCI) approach. Thereby, subjects could achieve a good control of their hBCI independently of their level of muscular fatigue. Furthermore, although EMG alone yields good performance, it is outperformed by the hybrid fusing of EEG and EMG. Two different fusion techniques are explored showing graceful performance degradation in the case of signal attenuation. Such a system allows a very reliable control and a smooth handover if the subjects get exhausted or fatigued during the day.

• Publication year

  2010

• Venue

  2010 Annual International Conference of the IEEE Engineering in Medicine and Biology

• Publication date

  2010-08-01

• Fields of study

  Medicine, Computer Science, Engineering, Psychology

• Identifiers
  DOI 10.1109/IEMBS.2010.5626233PMID 21096001
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• I and J

  2012cited by this paper
• Brain-computer interfaces for communication and control

  2011cited by this paper
• Toward a hybrid brain–computer interface based on imagined movement and visual attention

  2010cited by this paper
• Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges

  2010cited by this paper
• Improved signal processing approaches in an offline simulation of a hybrid brain-computer interface.

  2010cited by this paper
• Simultaneous Real-Time Detection of Motor Imagery and Error-Related Potentials for Improved BCI Accuracy

  2008cited by this paper
• A brain-actuated wheelchair: asynchronous and non-invasive Brain-computer interfaces for continuous control of robots.

  2008influential reference
• Feature Extraction for Multi-class BCI using Canonical Variates Analysis

  2007cited by this paper
• Brain–computer interface systems: progress and prospects

  2007cited by this paper
• LETTERS AND COMMENTS: Self-initiation of EEG-based brain computer communication using the heart rate response

  2007cited by this paper
• Noninvasive brain-actuated control of a mobile robot by human EEG

  2004influential reference
• Reliability In Information Fusion : Literature Survey

  2004cited by this paper
• Brain-computer interfaces for communication and control.

  2002cited by this paper
• AND T

  year unknowncited by this paper

• An investigation of multimodal EMG-EEG fusion strategies for upper-limb gesture classification

  2025cites this paper
• Challenges and Methodological Insights in Real-Time Multimodal Biosignal Processing

  2025cites this paper
• Stay Quiet: Investigating the Effect of Overt Speech on EEG Classification Performance

  2025cites this paper
• Design and Implementation of a Decision Making System for Controlling a Hand Exoskeleton Based on EEG/EMG Signals

  2025cites this paper
• Wearable multimodal sensing platform for contraction and fatigue transition monitoring of biceps in motion using machine learning

  2025cites this paper
• Differentially Private Multimodal Laplacian Dropout (DP-MLD) for EEG Representative Learning

  2024cites this paper
• Deep Learning-Based Classification of Finger Movements using tEEG and EEG Signals

  2023cites this paper
• CONVOLUTIONAL NEURAL NETWORKS FOR CLASSIFICATION TEEG AND EEG

  2023cites this paper
• Lower limb exoskeleton robot and its cooperative control: A review, trends, and challenges for future research

  2023cites this paper
• EEG- and EMG-Driven Poststroke Rehabilitation: A Review

  2022cites this paper
• fNIRS-Based Upper Limb Motion Intention Recognition Using an Artificial Neural Network for Transhumeral Amputees

  2022cites this paper
• Combined Use of EMG and EEG Techniques for Neuromotor Assessment in Rehabilitative Applications: A Systematic Review

  2021cites this paper
• Disjoint Subspaces for Common and DistinctComponent Analysis: Application to the Fusion of Multi-taskFMRI Data.

  2021cites this paper
• Design and Development of EMG Based Prosthetic Arm

  2020cites this paper
• EEG Feature Extraction Based on a Bilevel Network: Minimum Spanning Tree and Regional Network

  2020cites this paper
• Hybrid control approaches for hands-free high level human–computer interface-a review

  2020cites this paper
• Modeling of Human Operator Behavior for Brain-Actuated Mobile Robots Steering

  2020cites this paper
• Comprehensive review on brain-controlled mobile robots and robotic arms based on electroencephalography signals

  2020cites this paper
• Brain Computer Interface Classifiers for Semi-Autonomous Wheelchair Using Fuzzy Logic Optimization

  2020cites this paper
• Transfer Learning for a Multimodal Hybrid EEG-fTCD Brain–Computer Interface

  2019cites this paper
• Construction and Preliminary Testing of the Force Feedback Device for Use in Industrial Robot Control Based on the BCI Hybrid Interface

  2019cites this paper
• Controlling the industrial robot model with the hybrid BCI based on EOG and eye tracking

  2019cites this paper
• WPT-ANN and Belief Theory Based EEG/EMG Data Fusion for Movement Identification

  2019cites this paper
• Recent Advances in Hybrid Brain-Computer Interface Systems: A Technological and Quantitative Review

  2018cites this paper
• A hybrid EEG-EMG BMI improves the detection of movement intention in cortical stroke patients with complete hand paralysis

  2018cites this paper
• ROS-health: An open-source framework for neurorobotics

  2018cites this paper
• Consecutive Independence and Correlation Transform for Multimodal Fusion: Application to Eeg and Fmri Data

  2018cites this paper
• Correlation‐based classifier combination in the field of pattern recognition

  2018cites this paper
• Factors that affect error potentials during a grasping task: toward a hybrid natural movement decoding BCI

  2018cites this paper
• Brain-Computer Interface Systems Based On the Near-Infrared Spectroscopy

  2018cites this paper
• Hybrid EEG-EMG Based Brain Computer Interface (BCI) System For Real-Time Robotic Arm Control

  2018cites this paper
• Robotics and High-Throughput Techniques

  2018cites this paper
• Supervising SSSEP Experiments with a Bluetooth Android Remote Control Application

  2018cites this paper
• Hybrid Brain-Computer Interface (BCI) Based on Electrooculography (EOG) and Center Eye Tracking

  2018cites this paper
• Enhancement of steady‐state visual evoked potential‐based brain–computer interface systems via a steady‐state motion visual stimulus modality

  2017cites this paper
• Improved Gender Recognition during Stepping Activity for Rehab Application Using the Combinatorial Fusion Approach of EMG and HRV

  2017cites this paper
• Vers des interfaces cérébrales adaptées aux utilisateurs : interaction robuste et apprentissage statistique basé sur la géométrie riemannienne. (Toward user-adapted brain computer interfaces : robust interaction and machine learning based on riemannian geometry)

  2017cites this paper
• Gaze controlled prosthetic arm with EMG and EEG input interface

  2017cites this paper
• The role of EMG module in hybrid interface of prosthetic arm

  2017cites this paper
• Sensor fusion in upper limb area networks: A survey

  2017cites this paper
• A Semi-Autonomous Neuroprosthesis using Probabilistic Time-Series Inference

  2017influential citation
• Neuroimaging of human motor control in real world scenarios : from lab to urban environment

  2017cites this paper
• Review of Brain Computer Interface Components and Corresponding Research Topics

  2016cites this paper
• Multifunctional Neurodevice for Recognition of Electrophysiological Signals and Data Transmission in an Exoskeleton Construction

  2016cites this paper
• Hybrid BCI system to operate an electric wheelchair and a robotic arm for navigation and manipulation tasks

  2016cites this paper
• Hand-in-hand advances in biomedical engineering and sensorimotor restoration.

  2015cites this paper
• Relevant HCI for Hybrid BCI and Severely Impaired Patients

  2015cites this paper
• Machine learning techniques for neurotechnology with applications for healthy users and patients

  2015cites this paper
• Fuzzy Logic Based Eye-Brain Controlled Web Access System

  2015cites this paper
• Learning From More Than One Data Source: Data Fusion Techniques for Sensorimotor Rhythm-Based Brain–Computer Interfaces

  2015cites this paper
• A new classifier fusion method based on historical and on-line classification reliability for recognizing common CT imaging signs of lung diseases

  2015cites this paper
• Attention-level transitory response: a novel hybrid BCI approach

  2015cites this paper
• Hybrid BCI Coupling EEG and EMG for Severe Motor Disabilities

  2015cites this paper
• Multimodal Input for Perceptual User Interfaces

  2014cites this paper
• A Study of Controlling Upper-Limb Exoskeletons Using EMG and EEG signals

  2014cites this paper
• Are We the Robots?: Man-Machine Integration

  2014cites this paper
• SSVEP-based BCIs: study of classifier stability over time and effects of human learning on classification accuracy

  2014cites this paper
• BCI exploitant les SSVEP : étude de la stabilité du classifieur dans le temps et des effets de l’apprentissage humain sur les performances de classification

  2014cites this paper
• Hybrid interface: Integrating BCI in multimodal human-machine interfaces

  2014cites this paper
• An Ethernet sniffer for On-line acquisition of EEG with the BrainNet36® device applied to a BCI

  2014cites this paper
• Towards User-Friendly Spelling with an Auditory Brain-Computer Interface: The CharStreamer Paradigm

  2014cites this paper
• Title: Contribution to Roadmap

  2014cites this paper
• P300-Based Brain-Neuronal Computer Interaction for Spelling Applications

  2013cites this paper
• EEG-signals based control strategy for prosthetic drive systems

  2013cites this paper
• EEG-Based Brain-Controlled Mobile Robots: A Survey

  2013cites this paper
• Hybrid SSVEP-motion visual stimulus based BCI system for intelligent wheelchair

  2013cites this paper
• Medical Image Fusion: A survey of the state of the art

  2013cites this paper
• Proposing a Standardized Protocol for Raw Biosignal Transmission

  2012cites this paper
• Modified corticomuscular coherence measurement and computation under static force output of human-machine interaction

  2012cites this paper
• Enhanced performance by a hybrid NIRS-EEG brain computer interface

  2012cites this paper
• Development of upper and lower extremity rehabilitation device for brain computer interface

  2012cites this paper
• Adaptive Classification on Brain-Computer Interfaces Using Reinforcement Signals

  2012influential citation
• Information fusion in the realm of medical applications - A bibliographic glimpse at its growing appeal

  2012cites this paper
• Toward EEG control of upper limb power-assist exoskeletons: A preliminary study of decoding elbow joint velocities using EEG signals

  2012cites this paper
• Brain– Computer Interfaces: Effects on Brain Activation and Behavior

  2012cites this paper
• TiA – Standardizing Raw Biosignal Delivery in BCIs

  2011cites this paper
• Decoding of multichannel EEG activity from the visual cortex in response to pseudorandom binary sequences of visual stimuli

  2011cites this paper
• Multimodal human-machine interface based on a brain-computer interface and an electrooculography interface

  2011cites this paper
• Information fusion in the realm of medical applications – A bibliographic glimpse at its growing appeal

  2011cites this paper
• Advances in Neurotechnology for Brain Computer Interfaces

  2011cites this paper
• Enhanced performance by a hybrid NIRS – EEG brain computer interface

  2011cites this paper
• Asynchronous, parallel on-line classification of P300 and ERD for an efficient hybrid BCI

  2011cites this paper
• BCI system for upper and lower limb rehabilitation

  2011cites this paper
• A concept to standardize raw biosignal transmission for brain-computer interfaces

  2011cites this paper
• Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges

  2010cites this paper
• RADIO FREQUENCY BASED HIGH RESPONSIVE PROSTHETIC ARM ACTUATING SYSTEM USING EEG

  year unknowncites this paper