EMG-to-Speech: Direct Generation of Speech From Facial Electromyographic Signals

No abstract is available for this paper.

• Publication year

  2017

• Venue

  IEEE/ACM Transactions on Audio Speech and Language Processing

• Publication date

  2017-12-01

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/TASLP.2017.2738568
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Towards a Silent Speech Interface for Portuguese - Surface Electromyography and the Nasality Challenge

  2018cited by this paper
• Biosignal-Based Spoken Communication: A Survey

  2017cited by this paper
• A Spectral Mapping Method for EMG-based Recognition of Silent Speech

  2016cited by this paper
• An initial investigation into the real-time conversion of facial surface EMG signals to audible speech

  2016cited by this paper
• Surface Electromyographic Activity of Extrinsic Laryngeal Muscles in Cantonese Tone Production

  2015cited by this paper
• LSTM: A Search Space Odyssey

  2015cited by this paper
• Introducing CURRENNT: the munich open-source CUDA recurrent neural network toolkit

  2015cited by this paper
• Direct conversion from facial myoelectric signals to speech using Deep Neural Networks

  2015influential reference
• Codebook clustering for unit selection based EMG-to-speech conversion

  2015cited by this paper
• Multi-task deep neural network acoustic models with model adaptation using discriminative speaker identity for whisper recognition

  2015cited by this paper
• Brain-to-text: decoding spoken phrases from phone representations in the brain

  2015cited by this paper
• Long short-term memory recurrent neural network architectures for large scale acoustic modeling

  2014cited by this paper
• Fast and Robust Training of Recurrent Neural Networks for Offline Handwriting Recognition

  2014cited by this paper
• Conversion from facial myoelectric signals to speech: a unit selection approach

  2014cited by this paper
• An Overview of Noise-Robust Automatic Speech Recognition

  2014cited by this paper
• Alaryngeal Speech Enhancement Based on One-to-Many Eigenvoice Conversion

  2014cited by this paper
• Towards excluding redundancy in electrode grid for automatic speech recognition based on surface EMG

  2014cited by this paper
• Fundamental frequency generation for whisper-to-audible speech conversion

  2014cited by this paper
• An introduction to computational networks and the computational network toolkit (invited talk)

  2014cited by this paper
• Robust articulatory speech synthesis using deep neural networks for BCI applications

  2014cited by this paper
• Whisper-to-speech conversion using restricted Boltzmann machine arrays

  2014cited by this paper
• BeaqleJS : HTML 5 and JavaScript based Framework for the Subjective Evaluation of Audio Quality

  2014cited by this paper
• Dropout: a simple way to prevent neural networks from overfitting

  2014cited by this paper
• Exemplar-based unit selection for voice conversion utilizing temporal information

  2013cited by this paper
• Audiovisual corpus to analyze whisper speech

  2013cited by this paper
• Recent developments in automated lip-reading

  2013cited by this paper
• On the number of response regions of deep feed forward networks with piece-wise linear activations

  2013cited by this paper
• The Blizzard Challenge 2013 - Indian Language Task

  2013cited by this paper
• Speech recognition with deep recurrent neural networks

  2013cited by this paper
• On rectified linear units for speech processing

  2013cited by this paper
• Array-based Electromyographic Silent Speech Interface

  2013influential reference
• Feature enhancement by bidirectional LSTM networks for conversational speech recognition in highly non-stationary noise

  2013cited by this paper
• Signal processing advances for the MUTE sEMG-based silent speech recognition system

  2012cited by this paper
• Deep Architectures for Articulatory Inversion

  2012cited by this paper
• Statistical Voice Conversion Techniques for Body-Conducted Unvoiced Speech Enhancement

  2012cited by this paper
• Further investigations on EMG-to-speech conversion

  2012cited by this paper
• Speaking-aid systems using GMM-based voice conversion for electrolaryngeal speech

  2012cited by this paper
• Implementation of Computationally Efficient Real-Time Voice Conversion

  2012cited by this paper
• Announcing the Electromagnetic Articulography (Day 1) Subset of the mngu0 Articulatory Corpus

  2011cited by this paper
• Statistical Mapping Between Articulatory and Acoustic Data for an Ultrasound-Based Silent Speech Interface

  2011cited by this paper
• Speech interfaces based upon surface electromyography

  2010cited by this paper
• EEG classification of imagined syllable rhythm using Hilbert spectrum methods

  2010cited by this paper
• Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips

  2010cited by this paper
• Prediction of Acoustic Feature Parameters Using Myoelectric Signals

  2010cited by this paper
• Silent-speech enhancement using body-conducted vocal-tract resonance signals

  2010cited by this paper
• BiosignalsStudio: A Flexible Framework for Biosignal Capturing and Processing

  2010cited by this paper
• Brain-computer interfaces for speech communication

  2010cited by this paper
• Speech synthesis using artificial neural networks

  2010cited by this paper
• The physiological microphone (PMIC): A competitive alternative for speaker assessment in stress detection and speaker verification

  2010cited by this paper
• Silent speech interfaces

  2010cited by this paper
• Silent vs vocalized articulation for a portable ultrasound-based silent speech interface

  2010cited by this paper
• Modeling coarticulation in EMG-based continuous speech recognition

  2010influential reference
• Isolated word recognition of silent speech using magnetic implants and sensors.

  2010cited by this paper
• Synthesizing speech from electromyography using voice transformation techniques

  2009cited by this paper
• Text-to-Speech Synthesis

  2009cited by this paper
• Deafness.

  2009cited by this paper
• EEG-based Speech Recognition - Impact of Temporal Effects

  2009influential reference
• Electromyographic control of a hands-free electrolarynx using neck strap muscles.

  2009cited by this paper
• Neck and Face Surface Electromyography for Prosthetic Voice Control After Total Laryngectomy

  2009cited by this paper
• Disordered speech recognition using acoustic and sEMG signals

  2009cited by this paper
• "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech

  2008cited by this paper
• Predicting F0 and voicing from NAM-captured whispered speech

  2008cited by this paper
• A Speech synthesizer Using Facial EMG Signals

  2008cited by this paper
• Low-delay voice conversion based on maximum likelihood estimation of spectral parameter trajectory

  2008cited by this paper
• Improved Phoneme-Based Myoelectric Speech Recognition

  2008cited by this paper
• Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model

  2008cited by this paper
• Evaluation of Objective Quality Measures for Speech Enhancement

  2008cited by this paper
• Improvement to a NAM-captured whisper-to-speech system

  2008cited by this paper
• Speech recognition for vocalized and subvocal modes of production using surface EMG signals from the neck and face

  2008cited by this paper
• Acoustic analysis of consonants in whispered speech.

  2008cited by this paper
• Development of a (silent) speech recognition system for patients following laryngectomy.

  2008cited by this paper
• Myoelectric Signal Classification for Phoneme-Based Speech Recognition

  2007cited by this paper
• Eigentongue Feature Extraction for an Ultrasound-Based Silent Speech Interface

  2007cited by this paper
• OUISPER: CORPUS BASED SYNTHESIS DRIVEN BY ARTICULATORY DATA

  2007cited by this paper
• Unvoiced Speech Recognition Using Tissue-Conductive Acoustic Sensor

  2007cited by this paper
• Non-Audible Murmur (NAM) Recognition

  2006cited by this paper
• Frame-Based SEMG-to-Speech Conversion

  2006cited by this paper
• Articulatory Feature Classification using Surface Electromyography

  2006cited by this paper
• Improving body transmitted unvoiced speech with statistical voice conversion

  2006cited by this paper
• Techniques of EMG signal analysis: detection, processing, classification and applications

  2006cited by this paper
• Towards continuous speech recognition using surface electromyography

  2006cited by this paper
• Sub-word unit based non-audible speech recognition using surface electromyography

  2006cited by this paper
• Analysis and recognition of whispered speech

  2005cited by this paper
• Framewise phoneme classification with bidirectional LSTM networks

  2005cited by this paper
• Electromyography: Physiology, Engineering and Non-Invasive Applications

  2005cited by this paper
• Session independent non-audible speech recognition using surface electromyography

  2005cited by this paper
• Myoelectric signals for multimodal speech recognition

  2005cited by this paper
• A neural network model of the articulatory-acoustic forward mapping trained on recordings of articulatory parameters.

  2004cited by this paper
• Canonical Correlation Analysis: An Overview with Application to Learning Methods

  2004cited by this paper
• Speech synthesis from real time ultrasound images of the tongue

  2004cited by this paper
• Information Theory, Inference, and Learning Algorithms

  2004cited by this paper
• Mapping from articulatory movements to vocal tract spectrum with Gaussian mixture model for articulatory speech synthesis

  2004cited by this paper
• The CMU Arctic speech databases

  2004cited by this paper
• Functional organisation of corticonuclear pathways to motoneurones of lower facial muscles in man

  2004cited by this paper
• Non-audible murmur recognition

  2003cited by this paper
• Sub auditory speech recognition based on EMG signals

  2003cited by this paper
• "Unvoiced speech recognition using EMG - mime speech recognition"

  2003cited by this paper
• Combining acoustic and articulatory feature information for robust speech recognition

  2002cited by this paper
• Hidden Markov model classification of myoelectric signals in speech

  2002cited by this paper
• Exact indexing of dynamic time warping

  2002cited by this paper

• Uncertainty-aware few-shot learning for silent speech decoding

  2026cites this paper
• Lip-Siri: Contactless Open-Sentence Silent Speech with Wi-Fi Backscatter

  2026cites this paper
• From Muscle to Text with MyoText: sEMG to Text via Finger Classification and Transformer-Based Decoding

  2026cites this paper
• Harmonic Reduction Using Periodic/Aperiodic Separation Filter for Surface-EMG-Based Force Estimation With Power Line Interference

  2026cites this paper
• Beyond-Voice: Leveraging Articulatory Motion for Next-gen AI-Assistants

  2026cites this paper
• EMG-SENet: Multi-Modal Speech Enhancement With Electromyography Signals

  2025cites this paper
• Confidence-Based Self-Training for EMG-to-Speech: Leveraging Synthetic EMG for Robust Modeling

  2025cites this paper
• Oct-HD: A Wearable Distributed Wireless HD-sEMG Synchronous Acquisition System for Long-Term Monitoring

  2025cites this paper
• NAM-to-Speech Conversion with Multitask-Enhanced Autoregressive Models

  2025cites this paper
• KGMV-net: Knowledge-guided multi-view network for audio-visual dysarthria severity assessment

  2025cites this paper
• DiffMV-ETS: Diffusion-based Multi-Voice Electromyography-to-Speech Conversion using Speaker-Independent Speech Training Targets

  2025cites this paper
• An Artificial Intelligence Approach to Augmentative and Assistive Communication for Patients with Amyotrophic Lateral Sclerosis

  2025cites this paper
• An Introduction to Silent Paralinguistics

  2025cites this paper
• A Cross-Subject sEMG-to-Speech Conversion System Using Content Features and Model Calibration

  2025cites this paper
• Predicting Fundamental Frequency Patterns in Electrolaryngeal Speech Using Automated Phoneme Extraction

  2025cites this paper
• Neural Chinese silent speech recognition with facial electromyography

  2025cites this paper
• Silent speech recognition using visual cascading fusion of tongue-lip movements based on pre-trained and fine-tuned model

  2025cites this paper
• Machine learning-assisted wearable sensing systems for speech recognition and interaction

  2025cites this paper
• Mandarin Speech Reconstruction from Surface Electromyography Based on Generative Adversarial Networks

  2025cites this paper
• Non-invasive electromyographic speech neuroprosthesis: a geometric perspective

  2025cites this paper
• Electrode Setup for Electromyography-Based Silent Speech Interfaces: A Pilot Study

  2025cites this paper
• Infrared thermal radiation images and electromyography sensors for identifying badminton hitting force

  2025cites this paper
• Multi-modal Speech Enhancement with Limited Electromyography Channels

  2025cites this paper
• Design and Implementation of Metaheuristic-Driven BiLSTM Hybrid Model for Silent Communication

  2025cites this paper
• Emg2speech: Synthesizing Speech from Electromyography Using Self-supervised Speech Models

  2025cites this paper
• Cross-Speaker Training and Adaptation for Electromyography-to-Speech Conversion

  2024cites this paper
• Prosodic Preferences of Surface Electromyography-based Subvocal Speech for People With Laryngectomy.

  2024cites this paper
• Brain-to-text decoding with context-aware neural representations and large language models

  2024cites this paper
• Direct Speech Synthesis from Non-audible Speech Biosignals: A Comparative Study

  2024influential citation
• Geometry of orofacial neuromuscular signals: speech articulation decoding using surface electromyography

  2024cites this paper
• Speech synthesis from three-axis accelerometer signals using conformer-based deep neural network

  2024cites this paper
• A Wearable Acoustic Sensor for Identification in Harsh Noisy Environments

  2024cites this paper
• UltraSR: Silent Speech Reconstruction via Acoustic Sensing

  2024cites this paper
• A deep learning approach to classifying flow-induced vibration response regimes of an elliptical cylinder

  2024cites this paper
• An Investigation of Fundamental Frequency Pattern Prediction for Japanese Electrolaryngeal Speech Enhancement Based on Frame-Wise Phoneme Representations

  2024cites this paper
• Hybrid Adaptive Systems

  2024cites this paper
• Intelligent, Flexible Artificial Throats with Sound Emitting, Detecting, and Recognizing Abilities

  2024cites this paper
• A Fusion of EMG and IMU for an Augmentative Speech Detection and Recognition System

  2024cites this paper
• Advancing NAM-to-Speech Conversion with Novel Methods and the MultiNAM Dataset

  2024cites this paper
• Silent Speech Recognition Based on High-Density Surface Electromyogram Using Hybrid Neural Networks

  2023cites this paper
• Multi-Speaker Speech Synthesis from Electromyographic Signals by Soft Speech Unit Prediction

  2023cites this paper
• Silent Speech Interface With Vocal Speaker Assistance Based on Convolution-Augmented Transformer

  2023cites this paper
• Articulator Muscle Contraction Evaluation in Vowel Phonemes Articulation Based on Facial Images and Electromyography Signal

  2023cites this paper
• A review of surface electromyography applications for the jaw muscles characterization in rehabilitation and disorders diagnosis

  2023cites this paper
• Hybrid Silent Speech Interface Through Fusion of Electroencephalography and Electromyography

  2023cites this paper
• Mixed-modality speech recognition and interaction using a wearable artificial throat

  2023cites this paper
• STE-GAN: Speech-to-Electromyography Signal Conversion using Generative Adversarial Networks

  2023cites this paper
• A Comparison of Data Augmentation Methods on Ultrasound Tongue Images for Articulatory- to-Acoustic Mapping towards Silent Speech Interfaces

  2023cites this paper
• Decoding Silent Speech Based on High-Density Surface Electromyogram Using Spatiotemporal Neural Network

  2023cites this paper
• Spanish Phone Confusion Analysis for EMG-Based Silent Speech Interfaces

  2023cites this paper
• Frame-Based Phone Classification Using EMG Signals

  2023cites this paper
• Data Augmentation Methods on Ultrasound Tongue Images for Articulation-to-Speech Synthesis

  2023cites this paper
• Extracting Spatial Muscle Activation Patterns in Facial and Neck Muscles for Silent Speech Recognition Using High-Density sEMG

  2023cites this paper
• Silent Speech Recognition Based on Surface Electromyography Using a Few Electrode Sites Under the Guidance From High-Density Electrode Arrays

  2023cites this paper
• Novel three-axis accelerometer-based silent speech interface using deep neural network

  2023cites this paper
• Management of Parkinson's Disease Dysarthria: Can Artificial Intelligence Provide the Solution?

  2022cites this paper
• Non-Parallel Articulatory-to-Acoustic Conversion Using Multiview-Based Time Warping

  2022cites this paper
• Deep-learning-based real-time silent speech recognition using facial electromyogram recorded around eyes for hands-free interfacing in a virtual reality environment

  2022cites this paper
• EMGSE: Acoustic/EMG Fusion for Multimodal Speech Enhancement

  2022cites this paper
• E-MASK: A Mask-Shaped Interface for Silent Speech Interaction with Flexible Strain Sensors

  2022cites this paper
• A Complex Human-Machine Coordination Problem: Essential Constraints on Interaction Control in Bionic Communication Systems

  2022cites this paper
• EPG2S: Speech Generation and Speech Enhancement Based on Electropalatography and Audio Signals Using Multimodal Learning

  2022cites this paper
• EarCommand

  2022cites this paper
• A identificação da fala interna por meio da eletromiografia de superfície e da encefalografia: uma revisão de escopo / The Identification of Internal Speech Through Surface Electromyography and Encephalography: a Scope Review

  2022cites this paper
• Subvocal Interface in Assistive Information Technology

  2022cites this paper
• 1D Convolutional Autoencoder-Based PPG and GSR Signals for Real-Time Emotion Classification

  2022cites this paper
• Prediction of Voice Fundamental Frequency and Intensity from Surface Electromyographic Signals of the Face and Neck

  2022cites this paper
• Optimizing the Ultrasound Tongue Image Representation for Residual Network-Based Articulatory-to-Acoustic Mapping

  2022cites this paper
• Phone classification using electromyographic signals

  2022cites this paper
• Voicing Silent Speech

  2022cites this paper
• SVoice: Enabling Voice Communication in Silence via Acoustic Sensing on Commodity Devices

  2022cites this paper
• Quality-aware aggregated conformal prediction for silent speech recognition

  2022cites this paper
• A multidimensional facial surface EMG analysis for objective assessment of bulbar involvement in amyotrophic lateral sclerosis.

  2021cites this paper
• Automatic Speech Recognition in Different Languages Using High-Density Surface Electromyography Sensors

  2021cites this paper
• A Comparative Study of Different EMG Features for Acoustics-to-EMG Mapping

  2021cites this paper
• Speech Recognition Using RFID Tattoos (Extended Abstract)

  2021cites this paper
• Voice Reconstruction from Silent Speech with a Sequence-to-Sequence Model

  2021influential citation
• Adaptation of Tacotron2-based Text-To-Speech for Articulatory-to-Acoustic Mapping using Ultrasound Tongue Imaging

  2021cites this paper
• Future Solutions for Voice Rehabilitation in Laryngectomees: A Review of Technologies Based on Electrophysiological Signals

  2021cites this paper
• 3D Convolutional Neural Networks for Ultrasound-Based Silent Speech Interfaces

  2021cites this paper
• An Improved Model for Voicing Silent Speech

  2021cites this paper
• Surface Electromyography-Based Recognition, Synthesis, and Perception of Prosodic Subvocal Speech.

  2021cites this paper
• Pattern Recognition of Facial Electromyography (FEMG) Signal for Aceh Language Speech using Naïve Bayes and Learning Vector Quantization (LVQ)

  2021cites this paper
• Towards a practical lip-to-speech conversion system using deep neural networks and mobile application frontend

  2021cites this paper
• Improving Neural Silent Speech Interface Models by Adversarial Training

  2021influential citation
• SoundLip

  2021cites this paper
• Voice Restoration with Silent Speech Interfaces (ReSSInt)

  2021cites this paper
• Biosignal Sensors and Deep Learning-Based Speech Recognition: A Review

  2021cites this paper
• EMA2S: An End-to-End Multimodal Articulatory-to-Speech System

  2021cites this paper
• Creating Song From Lip and Tongue Videos With a Convolutional Vocoder

  2021cites this paper
• Sequence-to-Sequence Voice Reconstruction for Silent Speech in a Tonal Language

  2021cites this paper
• Applying DNN Adaptation to Reduce the Session Dependency of Ultrasound Tongue Imaging-based Silent Speech Interfaces

  2020cites this paper
• Multi-view Temporal Alignment for Non-parallel Articulatory-to-Acoustic Speech Synthesis

  2020cites this paper
• Critical Issues and Imminent Challenges in the Use of sEMG in Return-To-Work Rehabilitation of Patients Affected by Neurological Disorders in the Epoch of Human–Robot Collaborative Technologies

  2020cites this paper
• Towards optimizing electrode configurations for silent speech recognition based on high-density surface electromyography

  2020cites this paper
• CSL-EMG_Array: An Open Access Corpus for EMG-to-Speech Conversion

  2020cites this paper
• Towards Silent Paralinguistics: Deriving Speaking Mode and Speaker ID from Electromyographic Signals

  2020cites this paper
• Toward Silent Paralinguistics: Speech-to-EMG - Retrieving Articulatory Muscle Activity from Speech

  2020cites this paper
• Silent Speech Interface Using Ultrasonic Doppler Sonar

  2020cites this paper
• Digital Voicing of Silent Speech

  2020cites this paper