Dynamic modality weighting for multi-stream hmms inaudio-visual speech recognition

No abstract is available for this paper.

• Publication year

  2008

• Venue

  International Conference on Multimodal Interaction

• Publication date

  2008-10-20

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/1452392.1452442
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Unsupervised Stream Weight Estimation using Anti-Models

  2007cited by this paper
• Audio-visual integration for robust speech recognition using maximum weighted stream posteriors

  2007cited by this paper
• Multi-stream Processing for Noise Robust Speech Recognition

  2006cited by this paper
• Exploiting lower face symmetry in appearance-based automatic speechreading

  2005cited by this paper
• A stream-weight optimization method for multi-stream HMMs based on likelihood value normalization

  2005cited by this paper
• Maximum entropy and MCE based HMM stream weight estimation for audio-visual ASR

  2002cited by this paper
• EURASIP Journal on Applied Signal Processing 2002:11, 1189–1201 c ○ 2002 Hindawi Publishing Corporation Moving-Talker, Speaker-Independent Feature Study, and Baseline Results Using the CUAVE Multimodal Speech Corpus

  2002cited by this paper
• Weighting schemes for audio-visual fusion in speech recognition

  2001cited by this paper
• Audio-Visual Speech Modeling for Continuous Speech Recognition

  2000cited by this paper
• Stream confidence estimation for audio-visual speech recognition

  2000cited by this paper
• A mew ASR approach based on independent processing and recombination of partial frequency bands

  1996influential reference
• The HTK book

  1995cited by this paper

• Enhanced audio-visual speech enhancement with posterior sampling methods in recurrent variational autoencoders

  2026cites this paper
• Multimodal Fusion Networks Based on Sparse Selfencoders

  2025cites this paper
• Component attention network for multimodal dance improvisation recognition

  2023cites this paper
• Perception and deception: Exploring individual responses to deepfakes across different modalities

  2023cites this paper
• Understanding Political Polarization via Jointly Modeling Users, Connections and Multimodal Contents on Heterogeneous Graphs

  2022cites this paper
• Multimodal Conversational AI: A Survey of Datasets and Approaches

  2022cites this paper
• A new multi-stream approach using acoustic and visual features for robust speech recognition system

  2022cites this paper
• Learning in Audio-visual Context: A Review, Analysis, and New Perspective

  2022cites this paper
• Multimodal Fusion Remote Sensing Image–Audio Retrieval

  2022cites this paper
• Reliability-Based Large-Vocabulary Audio-Visual Speech Recognition

  2022cites this paper
• Audio-Visual Transformer Based Crowd Counting

  2021cites this paper
• Large-vocabulary Audio-visual Speech Recognition in Noisy Environments

  2021influential citation
• T OWARDS RELIABILITY - GUIDED INFORMATION INTEGRATION IN AUDIO - VISUAL SPEECH RECOGNITION

  2021cites this paper
• Multimodal Categorization of Crisis Events in Social Media

  2020cites this paper
• Fusion of deep learning features with mixture of brain emotional learning for audio-visual emotion recognition

  2020cites this paper
• Gate-Fusion Transformer for Multimodal Sentiment Analysis

  2020cites this paper
• Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues

  2020cites this paper
• Multimodal Integration for Large-Vocabulary Audio-Visual Speech Recognition

  2020cites this paper
• Multimedia Intelligence: When Multimedia Meets Artificial Intelligence

  2020cites this paper
• Emotion recognition based on multimodal fusion using mixture of brain emotional learning

  2019cites this paper
• MMGCN: Multi-modal Graph Convolution Network for Personalized Recommendation of Micro-video

  2019cites this paper
• A Novel Multi-Modal One-Shot Learning Method for Texture Recognition

  2019cites this paper
• Remote Sensing and Time Series Data Fused Multimodal Prediction Model Based on Interaction Analysis

  2019cites this paper
• Emotional Analysis of Sentences Based on Machine Learning

  2019cites this paper
• Emergent spatio-temporal multimodal learning using a developmental network

  2018cites this paper
• Speech and Language in Humanoid Robots

  2018cites this paper
• Audio-Visual Event Localization in Unconstrained Videos

  2018cites this paper
• Learn to Combine Modalities in Multimodal Deep Learning

  2018cites this paper
• Development on SNR estimator for audio-visual speech recognition based on waveform amplitude distribution analysis

  2018cites this paper
• Multimodal Machine Learning: A Survey and Taxonomy

  2017cites this paper
• Non-Gaussian data modeling with hidden Markov models

  2017cites this paper
• An analysis of the effect of combining standard and alternate sensor signals on recognition of syllabic units for multimodal speech recognition

  2017cites this paper
• Development of audio-visual speech corpus toward speaker-independent Japanese LVCSR

  2016cites this paper
• GPS Trace Mining for Discovering Behaviour Patterns

  2015cites this paper
• Audiovisual Fusion: Challenges and New Approaches

  2015cites this paper
• Stream weight estimation using higher order statistics in multi-modal speech recognition

  2015cites this paper
• An automatic multimodal speech recognition system with audio and video information

  2014cites this paper
• Robot Visual Localization Through Local Feature Fusion: An Evaluation of Multiple Classifiers Combination Approaches

  2014influential citation
• Audio-visual speech recognition using deep learning

  2014cites this paper
• An evaluation of local feature combiners for robot visual localization

  2013influential citation
• Multimodal information fusion of audiovisual emotion recognition using novel information theoretic tools

  2013cites this paper
• A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors

  2011cites this paper
• Audio-visual automatic speech recognition using Dynamic Bayesian Networks

  2011cites this paper
• Audiovisual Information Fusion in Human–Computer Interfaces and Intelligent Environments: A Survey

  2010cites this paper
• Modality Integration Methods

  2010cites this paper
• Viseme-dependent weight optimization for CHMM-based audio-visual speech recognition

  2010cites this paper
• Multimodal feature extraction and fusion for audio-visual speech recognition

  2009cites this paper
• AUDIO-VISUAL RELIABILITY ESTIMATES USING STREAM ENTROPY FOR SPEECH RECOGNITION

  2009cites this paper