Fault Diagnosis of Rotating Machinery Based on Deep Reinforcement Learning and Reciprocal of Smoothness Index

Rotating machinery are widely used in industry, and vibration analysis is one of the most common methods to monitor health condition of rotating machinery. However, due to the presence of outliers and interference, vibration signal becomes very complicated in reality, and it is important to reduce the influence of outliers and interference. Since a bandpass filter can eliminate a lot of above influence, it is usually selected to process vibration signal in classic fault diagnosis. The selection of the lower and upper cutoff frequencies of the bandpass filter is very critical. In order to extract fault characteristics from vibration signal, this paper proposes a new method which uses deep reinforcement learning algorithm and the reciprocal of smoothness index to control the bandpass filter to select a frequency band with the highest signal-to-noise ratio. Then, envelope demodulation is performed on the filtered signal so as to diagnose the faults of rotating machinery. Two sets of data collected from the test rig are used to validate the effectiveness of the proposed method. The comparisons with fast kurtogram and GiniIndexgram show the superiority of the proposed method. It also suggests that reinforcement learning has a great potential in the field of mechanical fault diagnosis.

• Publication year

  2020

• Venue

  IEEE Sensors Journal

• Publication date

  2020-08-01

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/JSEN.2020.2970747
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Multiple Discolored Cyclic Harmonic Ratio Diagram Based on Meyer Wavelet Filters for Rotating Machine Fault Diagnosis

  2020cited by this paper
• Weighted Cyclic Harmonic-to-Noise Ratio for Rolling Element Bearing Fault Diagnosis

  2020influential reference
• Nonlinear-Drifted Fractional Brownian Motion With Multiple Hidden State Variables for Remaining Useful Life Prediction of Lithium-Ion Batteries

  2020cited by this paper
• Intelligent fault diagnosis for rotating machinery using deep Q-network based health state classification: A deep reinforcement learning approach

  2019cited by this paper
• Application of an enhanced fast kurtogram based on empirical wavelet transform for bearing fault diagnosis

  2019cited by this paper
• A Precise Diagnosis Method of Structural Faults of Rotating Machinery based on Combination of Empirical Mode Decomposition, Sample Entropy, and Deep Belief Network

  2019cited by this paper
• Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks

  2019cited by this paper
• Some further thoughts about spectral kurtosis, spectral L2/L1 norm, spectral smoothness index and spectral Gini index for characterizing repetitive transients

  2018influential reference
• A brief introduction to weakly supervised learning

  2018cited by this paper
• A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning

  2018cited by this paper
• Improvement of kurtosis-guided-grams via Gini index for bearing fault feature identification

  2017cited by this paper
• Optimal Resonant Band Demodulation Based on an Improved Correlated Kurtosis and Its Application in Bearing Fault Diagnosis

  2017cited by this paper
• A review on signal processing techniques utilized in the fault diagnosis of rolling element bearings

  2016cited by this paper
• A New Improved Kurtogram and Its Application to Bearing Fault Diagnosis

  2015cited by this paper
• Multi-Stage Feature Selection by Using Genetic Algorithms for Fault Diagnosis in Gearboxes Based on Vibration Signal

  2015cited by this paper
• Envelope analysis with a genetic algorithm-based adaptive filter bank for bearing fault detection.

  2015cited by this paper
• Rolling element bearings fault diagnosis based on correlated kurtosis kurtogram

  2015cited by this paper
• Smoothness index-guided Bayesian inference for determining joint posterior probability distributions of anti-symmetric real Laplace wavelet parameters for identification of different bearing faults

  2015cited by this paper
• Fault diagnosis of rolling bearing’s early weak fault based on minimum entropy de-convolution and fast Kurtogram algorithm

  2015cited by this paper
• Condition monitoring and fault diagnosis of planetary gearboxes: A review

  2014cited by this paper
• The relationship between kurtosis- and envelope-based indexes for the diagnostic of rolling element bearings

  2014cited by this paper
• Playing Atari with Deep Reinforcement Learning

  2013cited by this paper
• The design of a new sparsogram for fast bearing fault diagnosis: Part 1 of the two related manuscripts that have a joint title as “Two automatic vibration-based fault diagnostic methods using the novel sparsity measurement – Parts 1 and 2”

  2013cited by this paper
• Rolling element bearing diagnostics—A tutorial

  2011cited by this paper
• Deep auto-encoder neural networks in reinforcement learning

  2010cited by this paper
• Bearing fault detection based on optimal wavelet filter and sparse code shrinkage

  2009cited by this paper
• Dynamic analysis of multiagent Q-learning with ε-greedy exploration

  2009cited by this paper
• Early Detection of Fatigue Damage on Rolling Element Bearings Using Adapted Wavelet

  2007cited by this paper
• A smoothness index-guided approach to wavelet parameter selection in signal de-noising and fault detection

  2007cited by this paper
• Fast computation of the kurtogram for the detection of transient faults

  2007cited by this paper
• Wavelet filter-based weak signature detection method and its application on rolling element bearing prognostics

  2006cited by this paper
• The spectral kurtosis: application to the vibratory surveillance and diagnostics of rotating machines

  2006cited by this paper
• The spectral kurtosis: a useful tool for characterising non-stationary signals

  2006cited by this paper
• A review of vibration and acoustic measurement methods for the detection of defects in rolling element bearings

  1999cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Q-learning

  1992cited by this paper
• Connectionist Architectures for Artificial Intelligence

  1990cited by this paper
• Detection of non-Gaussian signals by frequency domain Kurtosis estimation

  1983cited by this paper

• Temporal sparse weight based gear health monitoring tool by multichannel phase synchronized fusion dual-lifting tree model

  2026cites this paper
• A fault diagnosis strategy for gearboxes based on reinforcement learning with balanced reward and cost- equilibrium sampling

  2026cites this paper
• Time-Frequency Conditional Enhanced Transformer-TimeGAN for Motor Fault Data Augmentation

  2025cites this paper
• Fault diagnosis of rolling bearings based on VMD-transformer-BiGRU

  2025cites this paper
• Demonstration-Based AI Learning for Dynamic Motion Response in Metal Powder 3D Printing

  2025cites this paper
• Gear Wear Mechanisms, Monitoring Techniques And Their Potential Use In Gear Predictive Maintenance

  2025cites this paper
• Bearing fault diagnosis in high noise environment using multi-scale processing, channel-attention and feature-enhanced convolutional neural network model

  2025cites this paper
• A survey of machine learning and deep learning methods for vibration-based Bearing fault diagnosis: The need, challenges, and potential future research directions

  2025cites this paper
• Cognitive intelligence in industrial robots and manufacturing

  2024cites this paper
• Data-driven machinery fault diagnosis: A comprehensive review

  2024cites this paper
• An Interpretable CNN With Wavelet Group Policy Embedded for Intelligent Fault Diagnosis

  2024cites this paper
• Multiscale Deep Attention Q Network: A New Deep Reinforcement Learning Method for Imbalanced Fault Diagnosis in Gearboxes

  2024cites this paper
• Enhancing Digital Twins With Deep Reinforcement Learning: A Use Case in Maintenance Prioritization

  2024cites this paper
• Research on Mechanical Equipment Fault Diagnosis and Prediction Technology Based on Vibration Signal Analysis

  2024cites this paper
• Contextual Knowledge-Informed Deep Domain Generalization for Bearing Fault Diagnosis

  2024cites this paper
• Machine learning based mechanical fault diagnosis and detection methods: a systematic review

  2024cites this paper
• Fault Diagnosis and Prediction of Remaining Useful Life (RUL) of Rolling Element Bearing : A review state of art

  2024cites this paper
• An Interpretable Multiplication-Convolution Sparse Network for Equipment Intelligent Diagnosis in Antialiasing and Regularization Constraint

  2023cites this paper
• Sparse and Flexible Convex-Hull Representation for Machine Degradation Modeling

  2023cites this paper
• New Shapeness Property and Its Convex Optimization Model for Interpretable Machine Degradation Modeling

  2023cites this paper
• The Msegram: A useful multichannel feature synchronous extraction tool for detecting rolling bearing faults

  2023cites this paper
• Instantaneous Angular Speed-Based Fault Diagnosis of Multicylinder Marine Diesel Engine Using Intrinsic Multiscale Dispersion Entropy

  2023cites this paper
• Reinforcement learning for predictive maintenance: a systematic technical review

  2023cites this paper
• Oscillatory time–frequency concentration for adaptive bearing fault diagnosis under nonstationary time-varying speed

  2023cites this paper
• Match-reinforcement learning with time frequency selection for bearing fault diagnosis

  2023cites this paper
• Robust Fault Diagnosis for Gas Turbine Rotor via Transfer Reinforcement Learning

  2023cites this paper
• Investigation on optimal discriminant directions of linear discriminant analysis for locating informative frequency bands for machine health monitoring

  2022cites this paper
• Demodulated Multisynchrosqueezing S Transform for Fault Diagnosis of Rotating Machinery

  2022cites this paper
• A deep feature enhanced reinforcement learning method for rolling bearing fault diagnosis

  2022cites this paper
• Generalized Gini indices: Complementary sparsity measures to Box-Cox sparsity measures for machine condition monitoring

  2022cites this paper
• Digital Twin Inspired Intelligent Bearing Fault Diagnosis Method Based on Adaptive Correlation Filtering and Improved SAE Classification Model

  2022cites this paper
• Deep Q-network for the Condition Monitoring of Power Transformer with Acoustic Signals

  2022cites this paper
• A systematic review of rolling bearing fault diagnoses based on deep learning and transfer learning: Taxonomy, overview, application, open challenges, weaknesses and recommendations

  2022cites this paper
• Bearing Anomaly Recognition Using an Intelligent Digital Twin Integrated with Machine Learning

  2021cites this paper
• Adaptive Fault Diagnosis for Data Replication Systems

  2021cites this paper
• A Fault Diagnosis Method using Convolutional Neural Network with Visualized Samples

  2021cites this paper
• Degree of Cyclic Target Protrusion Defined on Squared Envelope Spectrum for Rotating Machinery Fault Diagnosis

  2021cites this paper
• Application of a whale optimized variational mode decomposition method based on envelope sample entropy in the fault diagnosis of rotating machinery

  2021cites this paper
• Deep reinforcement learning in production systems: a systematic literature review

  2021cites this paper
• Dynamic Characteristics of a Segmented Supercritical Driveline with Flexible Couplings and Dry Friction Dampers

  2021cites this paper
• Deep Learning Algorithms for Rotating Machinery Intelligent Diagnosis: An Open Source Benchmark Study

  2020cites this paper
• A Review of Artificial Intelligence Methods for Condition Monitoring and Fault Diagnosis of Rolling Element Bearings for Induction Motor

  2020cites this paper
• A Survey on Intelligent Predictive Maintenance (IPdM) in the Era of Fully Connected Intelligence

  2019cites this paper
• Robust optimized weights spectrum: Enhanced interpretable fault feature extraction method by solving frequency fluctuation problem

  year unknowncites this paper