Laban movement analysis and hidden Markov models for dynamic 3D gesture recognition

In this paper, we propose a new approach for body gesture recognition. The body motion features considered quantify a set of Laban Movement Analysis (LMA) concepts. These features are used to build a dictionary of reference poses, obtained with the help of a k-medians clustering technique. Then, a soft assignment method is applied to the gesture sequences to obtain a gesture representation. The assignment results are used as input in a Hidden Markov Models (HMM) scheme for dynamic, real-time gesture recognition purposes. The proposed approach achieves high recognition rates (more than 92% for certain categories of gestures), when tested and evaluated on a corpus including 11 different actions. The high recognition rates obtained on two other datasets (Microsoft Gesture dataset and UTKinect-Human Detection dataset) show the relevance of our method.

• Publication year

  2017

• Venue

  EURASIP Journal on Image and Video Processing

• Publication date

  2017-08-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1186/s13640-017-0202-5
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Gaussian Mixture Models

  2018cited by this paper
• Dynamic Gesture Recognition with Laban Movement Analysis and Hidden Markov Models

  2016cited by this paper
• Laban descriptors for gesture recognition and emotional analysis

  2015cited by this paper
• Correlation-optimized time warping for motion

  2014cited by this paper
• Feature extraction for human motion indexing of acted dance performances

  2014cited by this paper
• Online robust action recognition based on a hierarchical model

  2014cited by this paper
• A decision forest based feature selection framework for action recognition from RGB-depth cameras

  2013cited by this paper
• Laban Effort and Shape Analysis of Affective Hand and Arm Movements

  2013cited by this paper
• Online human gesture recognition from motion data streams

  2013cited by this paper
• Efficient motion retrieval in large motion databases

  2013cited by this paper
• Categorical and dimensional affect analysis in continuous input: Current trends and future directions

  2013cited by this paper
• Fusing Spatiotemporal Features and Joints for 3D Action Recognition

  2013cited by this paper
• Distribution-sensitive learning for imbalanced datasets

  2013cited by this paper
• A Pilot Study of the Expressive Gestures Used by Classical Orchestra Conductors: Penny Boyes Braem and Thüring Bräm

  2013cited by this paper
• A Perceptual Study of the Relationship between Posture and Gesture for Virtual Characters

  2012cited by this paper
• View invariant human action recognition using histograms of 3D joints

  2012influential reference
• Instructing people for training gestural interactive systems

  2012influential reference
• In defense of soft-assignment coding

  2011cited by this paper
• Simultaneous tracking and action recognition for single actor human actions

  2011cited by this paper
• Tracking body and hands for gesture recognition: NATOPS aircraft handling signals database

  2011cited by this paper
• Toward a Minimal Representation of Affective Gestures

  2011cited by this paper
• Modified k-mean clustering method of HMM states for initialization of Baum-Welch training algorithm

  2011cited by this paper
• Action recognition based on a bag of 3D points

  2010influential reference
• A Dynamic Bayesian Approach to Computational Laban Shape Quality Analysis

  2009cited by this paper
• Une morphologie de la gestualité : structuration articulaire

  2008cited by this paper
• Detecting Affect from Non-stylised Body Motions

  2007influential reference
• Semantic Segmentation of Motion Capture Using Laban Movement Analysis

  2007cited by this paper
• Documentation Mocap Database HDM05

  2007cited by this paper
• Numerically Stable Hidden Markov Model Implementation

  2006cited by this paper
• Acquiring and validating motion qualities from live limb gestures

  2005cited by this paper
• Analysis and evaluation of dancing movement based on LMA

  2005cited by this paper
• Multimodal Analysis of Expressive Gesture in Music and Dance Performances

  2003cited by this paper
• Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques

  2003cited by this paper
• Analysis of Impression of Robot Bodily Expression

  2002cited by this paper
• Distances between intuitionistic fuzzy sets

  2000cited by this paper
• Comparison of Four Initialization Techniques for the K -Medians Clustering Algorithm

  2000cited by this paper
• La maîtrise du mouvement

  1994cited by this paper
• An introduction to hidden Markov models

  1986influential reference
• Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Human Action Recognition Using a Temporal Hierarchy of Covariance Descriptors on 3D Joint Locations

  year unknowncited by this paper

• MoRTELaban: a Neurosymbolic Framework for Motion Representation and Analysis based on Labanotation and Laban Movement Analysis

  2025cites this paper
• Towards Cultural Preservation of Traditional Motion Knowledge through Automated Annotations with MoRTELaban

  2025cites this paper
• Self-Updatable Database System Based on Human Motion Assessment Framework

  2022cites this paper
• Malware Classification with GMM-HMM Models

  2021cites this paper
• Transcreation of the Accent Class to the Online Platform

  2021cites this paper
• Method Development for Multimodal Data Corpus Analysis of Expressive Instrumental Music Performance

  2020cites this paper
• A Gaussian mixture based hidden Markov model for motion recognition with 3D vision device

  2020cites this paper
• Recognition of Laban Effort Qualities from Hand Motion

  2020cites this paper
• CGLER: Laban Effort Framework Analysis with Conducting Gestures Using Neural Networks

  2020influential citation
• Advanced Machine Learning for Gesture Learning and Recognition Based on Intelligent Big Data of Heterogeneous Sensors

  2019cites this paper
• Assessing the reliability of the Laban Movement Analysis system

  2019cites this paper
• How Shall I Count the Ways? A Method for Quantifying the Qualitative Aspects of Unscripted Movement With Laban Movement Analysis

  2019cites this paper
• Describing Upper-Body Motions Based on Labanotation for Learning-from-Observation Robots

  2018cites this paper
• A Review of Computational Approaches for Human Behavior Detection

  2018cites this paper