Explainable Hierarchical Deep Learning Neural Networks (Ex-HiDeNN)

Data-driven science and computation have advanced immensely to construct complex functional relationships using trainable parameters. However, efficiently discovering interpretable and accurate closed-form expressions from complex dataset remains a challenge. The article presents a novel approach called Explainable Hierarchical Deep Learning Neural Networks or Ex-HiDeNN that uses an accurate, frugal, fast, separable, and scalable neural architecture with symbolic regression to discover closed-form expressions from limited observation. The article presents the two-step Ex-HiDeNN algorithm with a separability checker embedded in it. The accuracy and efficiency of Ex-HiDeNN are tested on several benchmark problems, including discerning a dynamical system from data, and the outcomes are reported. Ex-HiDeNN generally shows outstanding approximation capability in these benchmarks, producing orders of magnitude smaller errors compared to reference data and traditional symbolic regression. Later, Ex-HiDeNN is applied to three engineering applications: a) discovering a closed-form fatigue equation, b) identification of hardness from micro-indentation test data, and c) discovering the expression for the yield surface with data. In every case, Ex-HiDeNN outperformed the reference methods used in the literature. The proposed method is built upon the foundation and published works of the authors on Hierarchical Deep Learning Neural Network (HiDeNN) and Convolutional HiDeNN. The article also provides a clear idea about the current limitations and future extensions of Ex-HiDeNN.

• Publication year

  2025

• Venue

  arXiv.org

• Publication date

  2025-07-07

• Fields of study

  Computer Science

• Identifiers
  DOI 10.48550/arXiv.2507.05498arXiv 2507.05498
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Interactive Symbolic Regression - A Study on Noise Sensitivity and Extrapolation Accuracy

  2024cited by this paper
• Revival of Classical Algorithms: A Bibliometric Study on the Trends of Neural Networks and Genetic Algorithms

  2023cited by this paper
• Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence

  2023cited by this paper
• Discovering interpretable elastoplasticity models via the neural polynomial method enabled symbolic regressions

  2023influential reference
• Convolution hierarchical deep-learning neural network (C-HiDeNN) with graphics processing unit (GPU) acceleration

  2023cited by this paper
• Convolution Hierarchical Deep-learning Neural Networks (C-HiDeNN): finite elements, isogeometric analysis, tensor decomposition, and beyond

  2023cited by this paper
• Convolution Hierarchical Deep-Learning Neural Network Tensor Decomposition (C-HiDeNN-TD) for high-resolution topology optimization

  2023cited by this paper
• Material hardness descriptor derived by symbolic regression

  2023influential reference
• Interpretable and explainable machine learning: A methods‐centric overview with concrete examples

  2023cited by this paper
• Surrogate Aerodynamic Wing Modeling Based on a Multilayer Perceptron

  2023cited by this paper
• Assuring Safety-Critical Machine Learning Enabled Systems: Challenges and Promise

  2022cited by this paper
• Surrogate convolutional neural network models for steady computational fluid dynamics simulations

  2022cited by this paper
• Hierarchical Deep Learning Neural Network (HiDeNN): An artificial intelligence (AI) framework for computational science and engineering

  2021cited by this paper
• Learning Mesh-Based Simulation with Graph Networks

  2020cited by this paper
• Hierarchical deep-learning neural networks: finite elements and beyond

  2020cited by this paper
• Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradients

  2019cited by this paper
• AI Feynman: A physics-inspired method for symbolic regression

  2019cited by this paper
• Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead

  2018cited by this paper
• Explanation in Artificial Intelligence: Insights from the Social Sciences

  2017cited by this paper
• Explanation and Justification in Machine Learning : A Survey Or

  2017cited by this paper
• Discovering governing equations from data by sparse identification of nonlinear dynamical systems

  2015cited by this paper
• Exploration of data science techniques to predict fatigue strength of steel from composition and processing parameters

  2014influential reference
• Theoria Motus Corporum Coelestium in Sectionibus Conicis Solem Ambientium

  2014cited by this paper
• System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf]

  2012cited by this paper
• The Graph Neural Network Model

  2009cited by this paper
• Order of Nonlinearity as a Complexity Measure for Models Generated by Symbolic Regression via Pareto Genetic Programming

  2009influential reference
• System identification using genetic programming

  2003cited by this paper
• A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code

  2000cited by this paper
• Gradient-based learning applied to document recognition

  1998cited by this paper
• Genetic Programming: On the Programming of Computers by Means of Natural Selection

  1992cited by this paper
• Generalized Additive Models

  1986cited by this paper
• A framework toward knowledge transfer across heterogeneous and sparse datasets for fatigue life estimation of additively manufactured alloys

  year unknowncited by this paper

• No citing papers are available for this paper.