An adaptive spatiotemporal feature learning approach for fault diagnosis in complex systems

Abstract The machine fault diagnosis is being considered in a larger-scale complex system with numerous measurements from diverse subsystems or components, where the collected data is with disparate characteristics and needs more prevailing methods for data preprocessing, feature extraction and selection. This work presents a novel diagnosis framework that combines the spatiotemporal pattern network (STPN) approach with convolutional neural networks (CNN) to build a hybrid ST-CNN scheme. The proposed framework is tested on two data sets for diagnosing unseen operating conditions and fault severities respectively, to evaluate its generalization ability, which is essential for the application in machine fault diagnosis as not all of the aforementioned scenarios have sufficient labeled data to train a model. The results show that the proposed ST-CNN framework outperforms or is comparable to shallow methods (support vector machine and random forest) and 1D CNN. Through visualizing the activations, it is verified that the spatial features can elevate the diagnosis accuracy, and more general features are determined by the proposed approach to form an adaptive classifier for diverse operating conditions and different fault severities.

• Publication year

  2019

• Venue

  Mechanical systems and signal processing

• Publication date

  2019-02-15

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1016/J.YMSSP.2018.07.048
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load

  2018cited by this paper
• A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines

  2018cited by this paper
• Fault Diagnosis for Rotating Machinery Using Multiple Sensors and Convolutional Neural Networks

  2018cited by this paper
• Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing

  2018cited by this paper
• Multivariate exploration of non-intrusive load monitoring via spatiotemporal pattern network

  2018cited by this paper
• On the use of temperature for online condition monitoring of geared systems - A review

  2018cited by this paper
• An unsupervised spatiotemporal graphical modeling approach for wind turbine condition monitoring

  2018cited by this paper
• A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders

  2018cited by this paper
• Comparison of random forest, artificial neural networks and support vector machine for intelligent diagnosis of rotating machinery

  2018cited by this paper
• An analysis of Convolutional Long Short-Term Memory Recurrent Neural Networks for gesture recognition

  2017cited by this paper
• A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals

  2017cited by this paper
• An Adaptive Multi-Sensor Data Fusion Method Based on Deep Convolutional Neural Networks for Fault Diagnosis of Planetary Gearbox

  2017cited by this paper
• Locally Linear Embedding on Grassmann Manifold for Performance Degradation Assessment of Bearings

  2017cited by this paper
• Using multi-scale entropy and principal component analysis to monitor gears degradation via the motor current signature analysis

  2017cited by this paper
• An unsupervised anomaly detection approach using energy-based spatiotemporal graphical modeling

  2017cited by this paper
• Gear wear monitoring by modulation signal bispectrum based on motor current signal analysis

  2017cited by this paper
• Energy prediction using spatiotemporal pattern networks

  2017cited by this paper
• Static air-gap eccentricity fault diagnosis using rotor slot harmonics in line neutral voltage of three-phase squirrel cage induction motor

  2017cited by this paper
• A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox

  2017cited by this paper
• Induction motor broken rotor bar fault location detection through envelope analysis of start-up current using Hilbert transform

  2017cited by this paper
• Bearing fault diagnosis of a permanent magnet synchronous motor via a fast and online order analysis method in an embedded system

  2017cited by this paper
• A method for reduction of Acoustic Emission (AE) data with application in machine failure detection and diagnosis

  2017cited by this paper
• Gearbox fault diagnosis based on deep random forest fusion of acoustic and vibratory signals

  2016cited by this paper
• Bridge damage detection using spatiotemporal patterns extracted from dense sensor network

  2016cited by this paper
• Centrifugal compressor fault diagnosis based on qualitative simulation and thermal parameters

  2016cited by this paper
• A composite discretization scheme for symbolic identification of complex systems

  2016cited by this paper
• Acoustic emission-based condition monitoring methods: Review and application for low speed slew bearing

  2016cited by this paper
• Detection of weak transient signals based on wavelet packet transform and manifold learning for rolling element bearing fault diagnosis

  2015cited by this paper
• Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study

  2015cited by this paper
• A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM

  2015cited by this paper
• A new method of accurate broken rotor bar diagnosis based on modulation signal bispectrum analysis of motor current signals

  2015cited by this paper
• Deep Learning

  2015cited by this paper
• A Survey on Wind Turbine Condition Monitoring and Fault Diagnosis—Part I: Components and Subsystems

  2015cited by this paper
• Induction machine faults detection using stator current parametric spectral estimation

  2015cited by this paper
• A survey on time and frequency characteristics of induction motors with broken rotor bars in line-start and inverter-fed modes

  2015cited by this paper
• Feature extraction method of bearing AE signal based on improved FAST-ICA and wavelet packet energy

  2015cited by this paper
• Envelope extraction based dimension reduction for independent component analysis in fault diagnosis of rolling element bearing

  2014cited by this paper
• Global geometric similarity scheme for feature selection in fault diagnosis

  2014cited by this paper
• Multi-sensor information fusion for fault detection in aircraft gas turbine engines

  2013cited by this paper
• A novel intelligent gear fault diagnosis model based on EMD and multi-class TSVM

  2012cited by this paper
• The prediction and diagnosis of wind turbine faults

  2011cited by this paper
• Review and comparative evaluation of symbolic dynamic filtering for detection of anomaly patterns

  2009cited by this paper
• Visualizing Data using t-SNE

  2008cited by this paper
• Gradient-based learning applied to document recognition

  1998cited by this paper

• VAVFormer: A general interpretable fault diagnosis framework based on variational fusion and adaptive volatility attention

  2026cites this paper
• Abnormal Sound Detection Method for Microfans Based on Lightweight Attention Capsule Network

  2025cites this paper
• A novel quality-related generative data-driven fault diagnosis method for complex industrial processes with incomplete data

  2025cites this paper
• From deterministic to Bayesian: Adapting pre-trained models for human-computer collaborative fault diagnosis via post-hoc uncertainty

  2025cites this paper
• Multi-Dimensional Feature Perception Network for Open-Switch Fault Diagnosis in Grid-Connected PV Inverters

  2025cites this paper
• Domain-augmented meta ensemble learning for mechanical fault diagnosis from heterogeneous source domains to unseen target domains

  2025cites this paper
• Evaluating calibration of deep fault diagnostic models under distribution shift

  2025cites this paper
• Fault diagnosis for complex systems: A differential sensitivity-aided canonical correlation analysis approach

  2025cites this paper
• Research, application, and challenges of causal inference in industrial fault diagnosis: A survey

  2025cites this paper
• Uncertainty-aware deep variational attention network: A trustworthy mechanical fault diagnostic model assisted by out-of-distribution detection

  2025cites this paper
• A novel deep multi‐task learning model for spatial–temporal fault detection and diagnosis in industrial systems

  2025cites this paper
• A Deep Learning On-Board Health Monitoring Method for Landing Gear Shock-Absorbing Systems

  2025cites this paper
• Collaborative human-computer fault diagnosis via calibrated confidence estimation

  2025cites this paper
• Dimensionality reduction of rolling bearing fault data based on graph-embedded semi-supervised deep auto-encoders

  2025cites this paper
• Tool Condition Monitoring Using Machine Tool Spindle Current and Long Short-Term Memory Neural Network Model Analysis

  2024cites this paper
• A Model Fusion of 1D CNN with NARX for Accurate Earthquake Time Series Prediction

  2024cites this paper
• Diagnosis of rotor faults through generative adversarial networks enhanced by embedded wavelet scattering transforms

  2024cites this paper
• Fault Diagnosis Method for Rolling Bearing Based on Probabilistic Diffusion Models Under Imbalanced Data

  2024cites this paper
• A sound-vibration physical-information fusion constraint-guided deep learning method for rolling bearing fault diagnosis

  2024cites this paper
• Utilizing Bayesian generalization network for reliable fault diagnosis of machinery with limited data

  2024cites this paper
• Fault diagnosis of the harmonic reducer based on dual-path convolutional network with multi-channel hybrid attention mechanism

  2024cites this paper
• Concept of Early Prediction and Identification of Truck Vehicle Failures Supported by In-Vehicle Telematics Platform Based on Abnormality Detection Algorithm

  2024cites this paper
• Uncertainty-Aware Fault Diagnosis Under Calibration

  2024cites this paper
• Enhancing Reliability Through Interpretability: A Comprehensive Survey of Interpretable Intelligent Fault Diagnosis in Rotating Machinery

  2024cites this paper
• Data-driven machinery fault diagnosis: A comprehensive review

  2024cites this paper
• A review of artificial intelligence applications in wind turbine health monitoring

  2024cites this paper
• Deep optimal feature extraction and selection-based motor fault diagnosis using vibration

  2024cites this paper
• An adaptive metaheuristic optimization approach for Tennessee Eastman process for an industrial fault tolerant control system

  2024cites this paper
• Uncertainty-aware deep learning for reliable health monitoring in safety-critical energy systems

  2024cites this paper
• Bayesian variational transformer: A generalizable model for rotating machinery fault diagnosis

  2024cites this paper
• An unsupervised transfer learning model based on convolutional auto encoder for non-alcoholic steatohepatitis activity scoring and fibrosis staging of liver histopathological images

  2023cites this paper
• Deep reinforcement learning for class imbalance fault diagnosis of equipment in nuclear power plants

  2023cites this paper
• Unknown Health States Recognition With Collective Decision Based Deep Learning Networks In Predictive Maintenance Applications

  2023cites this paper
• Bidirectional Shrinkage Gated Recurrent Unit Network With Multiscale Attention Mechanism for Multisensor Fault Diagnosis

  2023cites this paper
• Bearing Fault Diagnosis Under Multisensor Fusion Based on Modal Analysis and Graph Attention Network

  2023cites this paper
• Towards trustworthy rotating machinery fault diagnosis via attention uncertainty in transformer

  2023cites this paper
• A fault location method based on ensemble complex spatio-temporal attention network for complex systems under fluctuating operating conditions

  2023cites this paper
• Security and Privacy in 5G-IIoT Smart Factories: Novel Approaches, Trends, and Challenges

  2023cites this paper
• Transferable dynamic enhanced cost-sensitive network for cross-domain intelligent diagnosis of rotating machinery under imbalanced datasets

  2023cites this paper
• Small sample fault diagnosis for wind turbine gearbox based on lightweight multiscale convolutional neural network

  2023cites this paper
• Hybrid Multi-model Feature Fusion-Based Vibration Monitoring for Rotating Machine Fault Diagnosis

  2023influential citation
• Instance Weighting-Based Partial Domain Adaptation for Intelligent Fault Diagnosis of Rotating Machinery

  2023cites this paper
• A hybrid feature learning approach based on convolutional kernels for ATM fault prediction using event-log data

  2023cites this paper
• Abnormality Detection Method for Wind Turbine Bearings Based on CNN-LSTM

  2023cites this paper
• Fault Diagnosis and Health Management of Power Machinery

  2023cites this paper
• Recent deep learning models for diagnosis and health monitoring: A review of research works and future challenges

  2023influential citation
• Transfer learning algorithms for bearing remaining useful life prediction: A comprehensive review from an industrial application perspective

  2023cites this paper
• A Self-Supervised Fault Detection for UAV Based on Unbalanced Flight Data Representation Learning and Wavelet Analysis

  2023cites this paper
• Application of Multi-Scale Convolutional Neural Networks and Extreme Learning Machines in Mechanical Fault Diagnosis

  2023cites this paper
• Digital twin-driven partial domain adaptation network for intelligent fault diagnosis of rolling bearing

  2023cites this paper
• Deep Transfer Learning for Bearing Fault Diagnosis: A Systematic Review Since 2016

  2023cites this paper
• Novel morphological scale difference filter with application in localization diagnosis of outer raceway defect in rolling bearings

  2023cites this paper
• Transformer-Enabled Cross-Domain Diagnostics for Complex Rotating Machinery With Multiple Sensors

  2023cites this paper
• Universal source-free domain adaptation method for cross-domain fault diagnosis of machines

  2023cites this paper
• Multi-sensor open-set cross-domain intelligent diagnostics for rotating machinery under variable operating conditions

  2023cites this paper
• Fault Diagnosis of Rotating Machinery Based on 1D–2D Joint Convolution Neural Network

  2023influential citation
• A Rolling Bearing Fault Diagnosis Method Based on Switchable Normalization and a Deep Convolutional Neural Network

  2023cites this paper
• Flight Test Sensor Fault Diagnosis Based on Data-Fusion and Machine Learning Method

  2022cites this paper
• Imbalanced fault diagnosis of rolling bearing using improved MsR-GAN and feature enhancement-driven CapsNet

  2022cites this paper
• Crack fault diagnosis of rotating machine in nuclear power plant based on ensemble learning

  2022cites this paper
• Fault Diagnosis of Elevator Doors Using Control State Information

  2022cites this paper
• A multi-branch redundant adversarial net for intelligent fault diagnosis of multiple components under drastically variable speeds.

  2022cites this paper
• An improved reliability-based robust design optimization method using Bayesian seemingly unrelated regression and multivariate loss function

  2022cites this paper
• Bearing Fault Feature Extraction Method Based on GA-VMD and Center Frequency

  2022cites this paper
• Bearing Fault Diagnosis Method Based on Multidomain Heterogeneous Information Entropy Fusion and Model Self-Optimisation

  2022cites this paper
• Development of a Plug-and-Play Anti-Noise Module for Fault Diagnosis of Rotating Machines in Nuclear Power Plants

  2022cites this paper
• A Novel Performance Degradation Prognostics Approach and Its Application on Ball Screw

  2022cites this paper
• Multidomain Feature Fusion Network for Fault Diagnosis of Rolling Machinery

  2022cites this paper
• Research on Fault Diagnosis Method of Rolling Bearing Based on Feature Optimization and Self-Adaptive SVM

  2022cites this paper
• A novel fault diagnosis method for early faults of PMSMs under multiple operating conditions.

  2022cites this paper
• A Domain Adaption Based Closed-loop System for Fault Diagnosis of Generator Slot Wedge

  2022cites this paper
• Bearing Fault Diagnosis via Incremental Learning Based on the Repeated Replay Using Memory Indexing (R-REMIND) Method

  2022cites this paper
• Intelligent Machine Fault Diagnosis Using Convolutional Neural Networks and Transfer Learning

  2022cites this paper
• Pre-trained network-based transfer learning: A small-sample machine learning approach to nuclear power plant classification problem

  2022cites this paper
• An Adaptive Fusion Convolutional Denoising Network and Its Application to the Fault Diagnosis of Shore Bridge Lift Gearbox

  2022cites this paper
• Single Feature Extraction Method of Bearing Fault Signals Based on Slope Entropy

  2022cites this paper
• Intelligent Fault Diagnosis for BLDC with Incorporating Accuracy and False Negative Rate in Feature Selection Optimization

  2022cites this paper
• Ensemble Capsule Network with an Attention Mechanism for the Fault Diagnosis of Bearings from Imbalanced Data Samples

  2022cites this paper
• Application of machine learning for inter turn fault detection in pumping system

  2022cites this paper
• A two-stage estimation method based on Conceptors-aided unsupervised clustering and convolutional neural network classification for the estimation of the degradation level of industrial equipment

  2022cites this paper
• Deep Reinforcement Learning-Based Online Domain Adaptation Method for Fault Diagnosis of Rotating Machinery

  2022cites this paper
• A planetary gearbox fault diagnosis method based on time-series imaging feature fusion and a transformer model

  2022cites this paper
• Intelligent Motor Bearing Fault Diagnosis Using Channel Attention-Based CNN

  2022cites this paper
• An improved reliability-based robust design optimization method using Bayesian seemingly unrelated regression and multivariate loss function

  2022cites this paper
• A Multi-Input and Multi-Task Convolutional Neural Network for Fault Diagnosis Based on Bearing Vibration Signal

  2021cites this paper
• Feature Extraction Based on EWT With Scale Space Threshold and Improved MCKD for Fault Diagnosis

  2021cites this paper
• A Current Signal-Based Adaptive Semisupervised Framework for Bearing Faults Diagnosis in Drivetrains

  2021cites this paper
• Multi-branch convolutional neural network with generalized shaft orbit for fault diagnosis of active magnetic bearing-rotor system

  2021cites this paper
• Intelligent fault detection of reciprocating compressor using a novel discrete state space

  2021cites this paper
• Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice

  2021cites this paper
• Bearing Fault Diagnosis via Improved One-Dimensional Multi-Scale Dilated CNN

  2021cites this paper
• Majorities help minorities: Hierarchical structure guided transfer learning for few-shot fault recognition

  2021cites this paper
• Eigen-spectrograms: An interpretable feature space for bearing fault diagnosis based on artificial intelligence and image processing

  2021cites this paper
• State of health prediction based on multi-kernel relevance vector machine and whale optimization algorithm for lithium-ion battery

  2021cites this paper
• Imbalanced fault diagnosis of rotating machinery using autoencoder-based SuperGraph feature learning

  2021cites this paper
• The Stochastic Augmented Lagrangian method for domain adaptation

  2021cites this paper
• Multi-Scale Capsule Attention Network and Joint Distributed Optimal Transport for Bearing Fault Diagnosis under Different Working Loads

  2021cites this paper
• An Ensemble of LSTM Networks for Fault Detection, Classification, and Root Cause Identification in Quality Control Line

  2021cites this paper
• Diagnostics and prognostics for complex systems: A review of methods and challenges

  2021cites this paper
• Supervised-Learning-Based Intelligent Fault Diagnosis for Mechanical Equipment

  2021cites this paper