Detecting excessive load-carrying tasks using a deep learning network with a Gramian Angular Field

Abstract Manual load carrying without sufficient rest may cause work-related musculoskeletal disorders (WMSDs) and needs to be monitored at construction sites. While previous studies have been able to predict load-carrying modes using multiple wearable inertial measurement unit (IMU) sensors, wearing multiple sensors obtrudes on workers during various construction tasks. In this context, by using a single IMU sensor, this research proposes an automatic detecting technique for excessive carrying-load (DeTECLoad) to predict load-carrying weights and postures simultaneously. DeTECLoad converts the IMU data into image data using a Gramian Angular Field, and then uses a hybrid Convolutional Neural Network-Long Short-Term Memory to classify load-carrying modes from the image data. DeTECLoad provides 92.46% and 96.33% accuracies for the load-carrying weight and posture classifications, respectively. By exploiting DeTECLoad, a construction worker's excessive load-carrying tasks could be managed in situ, helping to prevent construction site WMSDs.

• Publication year

  2020

• Venue

  Automation in Construction

• Publication date

  2020-12-01

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1016/J.AUTCON.2020.103390
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Deep learning-based classification of work-related physical load levels in construction

  2020cited by this paper
• Inferring workplace safety hazards from the spatial patterns of workers' wearable data

  2019cited by this paper
• Jerk as an indicator of physical exertion and fatigue

  2019cited by this paper
• Statistical prediction of load carriage mode and magnitude from inertial sensor derived gait kinematics.

  2019cited by this paper
• Validating ambulatory gait assessment technique for hazard sensing in construction environments

  2019cited by this paper
• An automatic and non-invasive physical fatigue assessment method for construction workers

  2019cited by this paper
• Wearable insole pressure system for automated detection and classification of awkward working postures in construction workers

  2018cited by this paper
• A Novel Walking Detection and Step Counting Algorithm Using Unconstrained Smartphones

  2018cited by this paper
• Identification of potential biomechanical risk factors for low back disorders during repetitive rebar lifting

  2018cited by this paper
• Fall risk assessment of construction workers based on biomechanical gait stability parameters using wearable insole pressure system

  2018cited by this paper
• Feasibility Study of a Wristband-Type Wearable Sensor to Understand Construction Workers’ Physical and Mental Status

  2018cited by this paper
• Wearable Insole Pressure Sensors for Automated Detection and Classification of Slip-Trip-Loss of Balance Events in Construction Workers

  2018cited by this paper
• Ergonomic analysis of construction worker's body postures using wearable mobile sensors.

  2017cited by this paper
• Identifying Safety Hazards Using Collective Bodily Responses of Workers

  2017cited by this paper
• Construction worker's awkward posture recognition through supervised motion tensor decomposition

  2017cited by this paper
• RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices

  2017cited by this paper
• Collective sensing of workers’ gait patterns to identify fall hazards in construction

  2017cited by this paper
• A data-driven approach to modeling physical fatigue in the workplace using wearable sensors.

  2017cited by this paper
• Development of ergonomic posture recognition technique based on 2D ordinary camera for construction hazard prevention through view-invariant features in 2D skeleton motion

  2017cited by this paper
• Wearable IMU-based real-time motion warning system for construction workers' musculoskeletal disorders prevention

  2017cited by this paper
• Wearable sensors for monitoring on-duty and off-duty worker physiological status and activities in construction

  2017cited by this paper
• Visualization technology-based construction safety management: A review

  2017cited by this paper
• Noise modeling and analysis of an IMU-based attitude sensor: improvement of performance by filtering and sensor fusion

  2016cited by this paper
• Inertial Measurement Unit-Based Wearable Computers for Assisted Living Applications: A signal processing perspective

  2016cited by this paper
• Building healthy construction workers: Their views on health, wellbeing and better workplace design.

  2016cited by this paper
• Musculoskeletal disorders in construction: A review and a novel system for activity tracking with body area network.

  2016cited by this paper
• Effect of Buildability on Labor Productivity: A Practical Quantification Approach

  2016cited by this paper
• Semi-supervised near-miss fall detection for ironworkers with a wearable inertial measurement unit

  2016cited by this paper
• Psychophysiological, Subjective and Behavioral Differences between High and Low Anger Drivers in a Simulation Task

  2016cited by this paper
• Artificial Neural Network–Based Slip-Trip Classifier Using Smart Sensor for Construction Workplace

  2016cited by this paper
• Imaging Time-Series to Improve Classification and Imputation

  2015cited by this paper
• Motion Data-Driven Biomechanical Analysis during Construction Tasks on Sites

  2015cited by this paper
• Very Deep Convolutional Networks for Large-Scale Image Recognition

  2014cited by this paper
• A feasibility study of using smartphone built-in accelerometers to detect fall portents

  2014cited by this paper
• Automated task-level activity analysis through fusion of real time location sensors and worker's tho

  2013cited by this paper
• Carrying and spine loading

  2013cited by this paper
• Robot-based construction automation: An application to steel beam assembly (Part II)

  2013cited by this paper
• A reliable and accurate indoor localization method using phone inertial sensors

  2012cited by this paper
• Real-time construction worker posture analysis for ergonomics training

  2012cited by this paper
• Tolerance of the lumbar spine to shear: a review and recommended exposure limits.

  2012cited by this paper
• Effects of load carriage and fatigue on gait characteristics.

  2011cited by this paper
• Detection of Cognitive Injured Body Region Using Multiple Triaxial Accelerometers for Elderly Falling

  2011cited by this paper
• A Literature Review of Ergonomics Risk Factors in Construction Industry

  2011cited by this paper
• Standard Normal Theory Inference Problems

  2011cited by this paper
• A continuous measure of phasic electrodermal activity

  2010cited by this paper
• A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity

  2010cited by this paper
• The effect of evenly distributed load carrying on lower body gait dynamics for normal weight and overweight subjects.

  2010cited by this paper
• Effect of load carriage on gait due to firefighting air bottle configuration

  2010cited by this paper
• Effects of military load carriage on kinematics of gait

  2010cited by this paper
• Work fatigue and physiological symptoms in different occupations of high-elevation construction workers.

  2009cited by this paper
• Prevalence and Associated Factors for Thoracic Spine Pain in the Adult Working Population: A Literature Review

  2009cited by this paper
• A comparison of photoplethysmography and ECG recording to analyse heart rate variability in healthy subjects

  2009cited by this paper
• The influence of rifle carriage on the kinetics of human gait

  2008cited by this paper
• A biomechanical analysis of anterior load carriage

  2007cited by this paper
• Photoplethysmography and its application in clinical physiological measurement

  2007cited by this paper
• Nonfatal occupational injuries associated with slips and falls in the United States.

  2006cited by this paper
• Responses of the lower limb to load carrying in walking man

  2006cited by this paper
• Gait and posture responses to backpack load during level walking in children.

  2003cited by this paper
• How do load carriage and walking speed influence trunk coordination and stride parameters?

  2003cited by this paper
• Swing phase mechanics of healthy young and elderly men.

  2001cited by this paper
• Effects of varying backpack loads on peak forces in the lumbosacral spine during walking.

  1998cited by this paper
• Alterations in gait resulting from deliberate changes of arm-swing amplitude and phase.

  1997cited by this paper
• Effects of walking velocity on relative phase dynamics in the trunk in human walking.

  1996cited by this paper
• Applications manual for the revised NIOSH lifting equation

  1994cited by this paper
• The effectiveness of a joint labor-management program in controlling awkward postures of the trunk, neck, and shoulders: Results of a field study

  1993cited by this paper
• Effects of different loads and carrying systems on selected biomechanical parameters describing walking gait.

  1985cited by this paper
• Slip resistance testing of shoes — new developments

  1983cited by this paper
• Bayesian inference in statistical analysis

  1973cited by this paper

• IMU-based recognition of ergonomically unsafe postures in construction work using image encoding and Vision Mamba

  2026cites this paper
• Multi-sensor information fusion via integration of multiple non-euclidean graphs for industrial equipment feature extraction under limited task labels

  2026cites this paper
• Simultaneous detection and visualization of lipid and protein oxidation in frozen-thawed chicken meat using hyperspectral imaging.

  2026cites this paper
• Computer-aided technologies for posture-based ergonomic risk assessment in construction: a systematic review

  2025influential citation
• Multimodal Hybrid Aero‐Engine Mechanical Wear Fault Diagnosis Algorithm Based on Two‐Channel Data Input Types

  2025cites this paper
• Improved GAF and Siamese network based fresh waxy corn kernel force prediction using hyperspectral data

  2025cites this paper
• Local defects prediction in laser additive manufacturing via multisensor monitoring strategy and multi-feature fusion convolutional neural network

  2025cites this paper
• Intelligent fault diagnosis method for rotating machinery based on sample multirepresentation information fusion under limited labeled samples conditions

  2025cites this paper
• Generating High Spatial and Temporal Surface Albedo with Multispectral-Wavemix and Temporal-Shift Heatmaps

  2025cites this paper
• Lower Limb Exoskeletons, Application‐Centric Classifications: A Review

  2025cites this paper
• Research on Emergency Frequency Control in AC/DC Hybrid Power Systems

  2025cites this paper
• WMSDsNet: A Deep Learning Framework for Real-Time Ergonomic Risk Prediction in Human-Robot Collaboration in Disassembly

  2025cites this paper
• Research on the Identification Method of Maize Seed Origin Using NIR Spectroscopy and GAF-VGGNet

  2024cites this paper
• Insulation aging condition assessment of transformer in the visual domain based on SE-CNN

  2024cites this paper
• Rolling bearing fault diagnosis method based on gramian angular difference field and dynamic self-calibrated convolution module

  2024cites this paper
• Deep learning based on image analysis for refrigerant charging and leakage detection in building heat pump

  2024cites this paper
• Automated Kinect-based posture evaluation method for work-related musculoskeletal disorders of construction workers

  2024cites this paper
• EEG channel selection using Gramian Angular Fields and spectrograms for energy data visualization

  2024cites this paper
• Detecting Activities Exposing Construction Workers to the Risk of Developing Carpal Tunnel Syndrome

  2024cites this paper
• GASF-ConvNeXt-TF Algorithm for Perimeter Security Disturbance Identification Based on Distributed Optical Fiber Sensing System

  2024cites this paper
• HBOD: A Novel Dataset with Synchronized Hand, Body, and Object Manipulation Data for Human-Robot Interaction

  2023cites this paper
• GAF Representation of Millimeter Wave Drone RCS and Drone Classification Method Based on Deep Fusion Network Using ResNet

  2023cites this paper
• A science mapping-based review of work-related musculoskeletal disorders among construction workers.

  2023cites this paper
• Electricity Theft Detection Based on Contrastive Learning and Non-Intrusive Load Monitoring

  2023cites this paper
• Fine-Grained Intoxicated Gait Classification Using a Bilinear CNN

  2023cites this paper
• Determining susceptible body parts of construction workers due to occupational injuries using inclusive modelling

  2023cites this paper
• Motion Capture Benchmark of Real Industrial Tasks and Traditional Crafts for Human Movement Analysis

  2023cites this paper
• Investigation of Rolling Bearing Weak Fault Diagnosis Based on CNN with Two-Dimensional Image

  2023cites this paper
• Deep learning-based construction equipment operators' mental fatigue classification using wearable EEG sensor data

  2023cites this paper
• Prediction of brown tide algae using improved Gramian angular field and deep learning based on laser-induced fluorescence spectrum

  2023cites this paper
• Corrosion leakage risk diagnosis of oil and gas pipelines based on semi-supervised domain generalization model

  2023cites this paper
• A novel model for tourism demand forecasting with spatial-temporal feature enhancement and image-driven method

  2023cites this paper
• Non-Contact Measurement Algorithm of Load Swing Angle for Bridge Crane Based on Contour Detection

  2023cites this paper
• Intelligent Online Inspection of the Paste Quality of Prebaked Carbon Anodes Using an Anomaly Detection Algorithm

  2023cites this paper
• Research on mechanical property prediction of hot rolled steel based on lightweight multi-branch convolutional neural network

  2023cites this paper
• Smart SO2 Sensor Based on Cs3Cu2I5@Fe2O3 Nanocrystals for Eliminating Humidity Interference

  2023cites this paper
• Residual Swin transformer-based weld crack leakage monitoring of pressure pipeline

  2023cites this paper
• EEG Channel Analysis for Energy Data Visualizations Using GAF Encoding and Deep Learning

  2023influential citation
• Prediction of mechanical properties of hot-rolled steel based on multi-channel convolutional neural network

  2023cites this paper
• Success factors to large-scale adoption of wearable technology for musculoskeletal disorders (MSDs) prevention: a case study

  2022cites this paper
• Deep Learning in Construction: Review of Applications and Potential Avenues

  2022cites this paper
• Capturing Environmental Distress of Pedestrians Using Multimodal Data: The Interplay of Biosignals and Image-Based Data

  2022cites this paper
• Creating 3D Gramian Angular Field Representations for Higher Performance Energy Data Classification

  2022cites this paper
• Determination of alcohols-diesel oil by near infrared spectroscopy based on gramian angular field image coding and deep learning

  2022cites this paper
• Cost-Benefit Analysis of Melanoma Screening

  2022cites this paper
• Risk Assessment Methods of Low Back Pain among Masonry Apprentice

  2022cites this paper
• Improving posture recognition among construction workers through data augmentation with generative adversarial network

  2022cites this paper
• Lightweight Gramian Angular Field classification for edge internet of energy applications

  2022cites this paper
• Assessing exposure to slip, trip, and fall hazards based on abnormal gait patterns predicted from confidence interval estimation

  2022cites this paper
• Neural Networks in the Construction Industry: Knowledge Gaps and Possibilities

  2022cites this paper
• Toward Wi-Fi-Enabled Real-Time Communication for Proactive Safety Systems in Highway Work Zones: A Case Study

  2022cites this paper
• Deep learning-based networks for automated recognition and classification of awkward working postures in construction using wearable insole sensor data

  2022cites this paper
• Benchmarking Transfer Learning Strategies in Time-Series Imaging: Recommendations for Analyzing Raw Sensor Data

  2022cites this paper
• Using Machine Learning and Wearable Inertial Sensor Data for the Classification of Fractal Gait Patterns in Women and Men During Load Carriage

  2021cites this paper
• Using Convolutional Neural Network and Candlestick Representation to Predict Sports Match Outcomes

  2021cites this paper
• Elevating Energy Data Analysis with M 2 GAF: Micro-Moment Driven Gramian Angular Field Visualizations

  2021cites this paper
• The role of machine learning in the primary prevention of work-related musculoskeletal disorders: A scoping review.

  2021cites this paper
• The application of “deep learning” in construction site management: scientometric, thematic and critical analysis

  2021cites this paper
• Current Status and Future Directions of Deep Learning Applications for Safety Management in Construction

  2021cites this paper
• Image-based gramian angular field processing for pedestrian stride-length estimation using convolutional neural network

  2021cites this paper
• Wearable inertial sensors for human movement analysis: a five-year update

  2021cites this paper
• A universal graph neural network framework with multiple strategies constraints for unsupervised fault feature extraction from industrial equipment signals

  year unknowncites this paper