Making muscle-computer interfaces more practical

Recent work in muscle sensing has demonstrated the poten-tial of human-computer interfaces based on finger gestures sensed from electrodes on the upper forearm. While this approach holds much potential, previous work has given little attention to sensing finger gestures in the context of three important real-world requirements: sensing hardware suitable for mobile and off-desktop environments, elec-trodes that can be put on quickly without adhesives or gel, and gesture recognition techniques that require no new training or calibration after re-donning a muscle-sensing armband. In this note, we describe our approach to over-coming these challenges, and we demonstrate average clas-sification accuracies as high as 86% for pinching with one of three fingers in a two-session, eight-person experiment.

• Publication year

  2010

• Venue

  International Conference on Human Factors in Computing Systems

• Publication date

  2010-04-10

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1145/1753326.1753451
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Enabling always-available input with muscle-computer interfaces

  2009influential reference
• Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors

  2009cited by this paper
• Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces

  2008cited by this paper
• EMG-based hand gesture recognition for realtime biosignal interfacing

  2008cited by this paper
• Intimate interfaces in action: assessing the usability and subtlety of emg-based motionless gestures

  2007cited by this paper
• Gesture-based control and EMG decomposition

  2006cited by this paper
• Classification of finger activation for use in a robotic prosthesis arm

  2002cited by this paper
• State-based Classification of Finger Gestures from Electromyographic Signals

  2000cited by this paper
• Computational requirements for control of the utah arm

  1974cited by this paper

• Objestures: Everyday Objects Meet Mid-Air Gestures for Expressive Interaction

  2025cites this paper
• Objestures: Bimanual Interactions with Everyday Objects and Mid-Air Gestures in Mixed Reality (Video Showcase)

  2025cites this paper
• SparseEMG: Computational Design of Sparse EMG Layouts for Sensing Gestures

  2025cites this paper
• Lower Limb Motion Recognition Based on Surface Electromyography Decoding Using S-Transform Energy Concentration

  2025cites this paper
• 3D Vr vs. 2D screen in touchless gesture-interaction: a multi-group SEM study on system/service quality, flow, satisfaction, and usage intention

  2025cites this paper
• ecSkin: Low-Cost Fabrication of Epidermal Electrochemical Sensors for Detecting Biomarkers in Sweat

  2024cites this paper
• Improving Electromyographic Muscle Response Times through Visual and Tactile Prior Stimulation in Virtual Reality

  2024cites this paper
• Development of a Wearable Electromyographic Sensor with Aerosol Jet Printing Technology

  2024cites this paper
• Muscle intent-based continuous passive motion machine in a gaming context using a lightweight CNN

  2024cites this paper
• Big data in myoelectric control: large multi-user models enable robust zero-shot EMG-based discrete gesture recognition

  2024cites this paper
• The Effects of Body Location and Biosignal Feedback Modality on Performance and Workload Using Electromyography in Virtual Reality

  2023cites this paper
• A Framework and Call to Action for the Future Development of EMG-Based Input in HCI

  2023cites this paper
• Characterization of signal features for real-time sEMG onset detection

  2023cites this paper
• PPG2EMG: Estimating Upper-Arm Muscle Activities and EMG from Wrist PPG Values

  2023cites this paper
• sEMG-based Hand Gesture Recognition with Deep Learning

  2023cites this paper
• An End-to-End Musical Instrument System That Translates Electromyogram Biosignals to Synthesized Sound

  2023cites this paper
• Implementation of an Intelligent EMG Signal Classifier Using Open-Source Hardware

  2023cites this paper
• A Simple Reshaping Method of sEMG Training Data for Faster Convergence in CNN-Based HAR Applications

  2023cites this paper
• Multi-Grasp Classification for the Control of Robot Hands Employing Transformers and Lightmyography Signals

  2023cites this paper
• Electromyography Based Gesture Decoding Employing Few-Shot Learning, Transfer Learning, and Training From Scratch

  2023cites this paper
• LibEMG: An Open Source Library to Facilitate the Exploration of Myoelectric Control

  2023cites this paper
• Surface EMG-Based Intersession/Intersubject Gesture Recognition by Leveraging Lightweight All-ConvNet and Transfer Learning

  2023cites this paper
• Recent trends and challenges of surface electromyography in prosthetic applications

  2023cites this paper
• Imprecise but Fun

  2022cites this paper
• Lightmyography Based Decoding of Human Intention Using Temporal Multi-Channel Transformers

  2022cites this paper
• The effects of touchless interaction on usability and sense of presence in a virtual environment

  2022cites this paper
• Cybernetic Hive Minds: A Review

  2022cites this paper
• A Wearable, Open-Source, Lightweight Forcemyography Armband: On Intuitive, Robust Muscle-Machine Interfaces

  2021cites this paper
• Acoustic Sensing-based Hand Gesture Detection for Wearable Device Interaction

  2021cites this paper
• Elements Influencing sEMG-Based Gesture Decoding: Muscle Fatigue, Forearm Angle and Acquisition Time

  2021cites this paper
• Deep Learning-Based Hand Posture Recognition for Pen Interaction Enhancement

  2021cites this paper
• Computational design and optimization of electro-physiological sensors

  2021cites this paper
• A Shared Control Framework for Robotic Telemanipulation Combining Electromyography Based Motion Estimation and Compliance Control

  2021cites this paper
• Upper-Limb Electromyogram Classification of Reaching-to-Grasping Tasks Based on Convolutional Neural Networks for Control of a Prosthetic Hand

  2021cites this paper
• Facilitating Bodily Insights Using Electromyography-Based Biofeedback during Physical Activity

  2021cites this paper
• sEMG-based Regression of Hand Kinematics with Temporal Convolutional Networks on a Low-Power Edge Microcontroller

  2021cites this paper
• Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future

  2021cites this paper
• Electromyography-Based Decoding of Dexterous, In-Hand Manipulation of Objects: Comparing Task Execution in Real World and Virtual Reality

  2021cites this paper
• Surface Electromyography as a Natural Human–Machine Interface: A Review

  2021cites this paper
• A Subject-Transfer Framework Based on Single-Trial EMG Analysis Using Convolutional Neural Networks

  2020cites this paper
• Interacting with Smart Devices - Advancements in Gesture Recognition and Augmented Reality

  2020cites this paper
• Independent component analysis in multi-channel forearm surface electromyography processing on armband approach for hand gesture classification

  2020cites this paper
• Feature Extraction and Classification of Gestures from Myo-Electric Data Using a Neural Network Classifier

  2020cites this paper
• An electromyogram-based tapping gesture model with differentiated vibration feedback by low-fidelity actuators

  2020cites this paper
• High accurate lightweight deep learning method for gesture recognition based on surface electromyography

  2020cites this paper
• All-ConvNet: A Lightweight All CNN for Neuromuscular Activity Recognition Using Instantaneous High-Density Surface EMG Images

  2020cites this paper
• A novel muscle-computer interface for hand gesture recognition using depth vision

  2020cites this paper
• Forearm Orientation Invariant Analysis for Surface Myoelectric Pattern Recognition

  2020cites this paper
• Body Physiology, Cross Modality, and Sonic Experience

  2020influential citation
• PhysioSkin: Rapid Fabrication of Skin-Conformal Physiological Interfaces

  2020influential citation
• Gesture interaction in virtual reality

  2019cites this paper
• Robust hand gesture identification using envelope of HD-sEMG signal

  2019cites this paper
• Bi-Level Thresholding

  2019cites this paper
• Recognition of Libras Static Alphabet with MyoTM and Multi-Layer Perceptron

  2019cites this paper
• S-Convnet: A Shallow Convolutional Neural Network Architecture for Neuromuscular Activity Recognition Using Instantaneous High-Density Surface EMG Images

  2019cites this paper
• USE OF DEEP MACHINE LEARNING METHODS OF ARTIFICIAL NEURAL NETWORKS FOR DESIGNING ALGORITHMS OF ELECTROMYOGRAPHY SIGNAL RECOGNITION IN BIONIC PROSTHESIS

  2019cites this paper
• A Learning Scheme for EMG Based Decoding of Dexterous, In-Hand Manipulation Motions

  2019cites this paper
• Implementation of Hand Gesture Recognition Device Applicable to Smart Watch Based on Flexible Epidermal Tactile Sensor Array

  2019cites this paper
• Surface Electromyography (EMG) Signal Processing, Classification, and Practical Considerations

  2019cites this paper
• Robust Real-Time Embedded EMG Recognition Framework Using Temporal Convolutional Networks on a Multicore IoT Processor

  2019cites this paper
• Embodied Musical Interaction - Body Physiology, Cross Modality, and Sonic Experience

  2019cites this paper
• Exploring the Potential of Wrist-Worn Gesture Sensing

  2018cites this paper
• What is That in Your Hand?

  2018cites this paper
• Research on gesture recognition based on sEMG and inertial sensor fusion

  2018cites this paper
• Automatic monitoring of physical activity related affective states for chronic pain rehabilitation

  2018cites this paper
• TouchSense: Classifying and Measuring the Force of Finger Touches with an Electromyography Armband

  2018cites this paper
• Exploring Arm Posture and Temporal Variability in Myoelectric Hand Gesture Recognition

  2018cites this paper
• FinDroidHR

  2018cites this paper
• Control with Gestures: A Hand Gesture Recognition System Using Off-the-Shelf Smartwatch

  2018cites this paper
• A soft robotic hand: design, analysis, sEMG control, and experiment

  2018cites this paper
• A soft robotic hand: design, analysis, sEMG control, and experiment

  2018cites this paper
• Sparsity Analysis of a Sonomyographic Muscle–Computer Interface

  2018cites this paper
• Finger gesture recognition using a smartwatch with integrated motion sensors

  2018cites this paper
• MuscleIO

  2018cites this paper
• Touchsense: classifying finger touches and measuring their force with an electromyography armband

  2018cites this paper
• User-independent real-time hand gesture recognition based on surface electromyography

  2017cites this paper
• Subtle finger motion recognition based on the cots smartwatch

  2017cites this paper
• Implicit Intention Communication in Human–Robot Interaction Through Visual Behavior Studies

  2017cites this paper
• TriTap: Identifying Finger Touches on Smartwatches

  2017cites this paper
• Simple space-domain features for low-resolution sEMG pattern recognition

  2017cites this paper
• Real-time myoelectric prosthetic-hand control to reject outlier motion interference using one-class classifier

  2017cites this paper
• Influence of sEMG electrode matrix configuration on hand gesture recognition performance

  2017cites this paper
• An incremental EMG classification model to detect and recognize randomly-occurred outlier motion

  2017cites this paper
• Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation

  2017cites this paper
• Subtle finger motion recognition based on the cots smartwatch

  2017cites this paper
• Localisation method for sEMG electrode array, towards hand gesture recognition HMI development

  2017cites this paper
• Design Guidelines for Wearable Pointing Devices

  2016cites this paper
• Framework for Sinhala Sign Language recognition and translation using a wearable armband

  2016cites this paper
• Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch

  2016cites this paper
• Raspberry Pi based Implementation of Internet of Things using Mobile Messaging Application - ‘Telegram’

  2016cites this paper
• Gesture recognition by instantaneous surface EMG images

  2016cites this paper
• American Sign Language Recognition system by using surface EMG signal

  2016cites this paper
• Position-Independent Decoding of Movement Intention for Proportional Myoelectric Interfaces

  2016cites this paper
• Extraction and Classification of Multichannel Electromyographic Activation Trajectories for Hand Movement Recognition

  2016cites this paper
• Beauty Technology Definition

  2016cites this paper
• Kinemic Wave: A Mobile Freehand Gesture And Text-Entry System

  2016cites this paper
• Open-box muscle-computer interface: introduction to human-computer interactions in bioengineering, physiology, and neuroscience courses.

  2016cites this paper
• Estimation of Wrist Movements based on a Regression Technique for Wearable Robot Interfaces

  2015cites this paper
• 0 Understanding Gesture Expressivity through Muscle Sensing

  2015cites this paper
• Design of Mobile Application Control based on Hand Gesture

  2015cites this paper