Recurrent Neural Networks Are Universal Approximators

No abstract is available for this paper.

• Publication year

  2006

• Venue

  International Conference on Artificial Neural Networks

• Publication date

  2006-09-10

• Fields of study

  Mathematics, Computer Science, Medicine

• Identifiers
  DOI 10.1007/11840817_66PMID 17696290
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Modelling and Forecasting Financial Data

  2002cited by this paper
• Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations

  2002cited by this paper
• Universal Approximation of Multiple Nonlinear Operators by Neural Networks

  2002cited by this paper
• Modeling Dynamical Systems by Error Correction Neural Networks

  2002cited by this paper
• Field Guide to Dynamical Recurrent Networks

  2001cited by this paper
• On the approximation capability of recurrent neural networks

  2000cited by this paper
• Neural Networks: A Comprehensive Foundation

  1998influential reference
• The Dynamic Universality of Sigmoidal Neural Networks

  1996cited by this paper
• Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems

  1995cited by this paper
• On the approximate realization of continuous mappings by neural networks

  1989influential reference
• Approximation by superpositions of a sigmoidal function

  1989influential reference
• Multilayer feedforward networks are universal approximators

  1989cited by this paper
• Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations

  1986cited by this paper
• Learning internal representations by error propagation

  1986cited by this paper
• New directions

  1937cited by this paper

• Multi-resolution learning with DeepONets and long short-term memory neural networks

  2025cites this paper
• Bidirectional Linear Recurrent Models for Sequence-Level Multisource Fusion

  2025cites this paper
• Infinity-norm-based Input-to-State-Stable Long Short-Term Memory networks: a thermal systems perspective

  2025cites this paper
• A Uniform Framework of Yau–Yau Algorithm Based on Deep Learning With the Capability of Overcoming the Curse of Dimensionality

  2025influential citation
• Feedforward Control for an Interventional X-Ray: A Parallel Physical Model and Neural Network Approach

  2025cites this paper
• State Estimation for Partially Unknown Nonlinear Systems via Observer-ML Fusion

  2025cites this paper
• Dynamical phases of short-term memory mechanisms in RNNs

  2025cites this paper
• Leveraging recurrence in neural network wavefunctions for large-scale simulations of Heisenberg antiferromagnets on the square lattice

  2025cites this paper
• Vehicle Side-Slip Angle (SSA) Model Based Observer Enhancement Via NN-based SSA Virtual Sensors

  2025cites this paper
• Data-driven control of echo state-based recurrent neural networks with robust stability guarantees

  2025cites this paper
• Universal Approximation Property of Fully Convolutional Neural Networks with Zero Padding

  2025cites this paper
• Bidirectional linear recurrent models for sequence-level multisource fusion

  2025cites this paper
• A Lifelong Learnable Hybrid Controller for Autonomous Driving

  2025cites this paper
• A Model-Data Dual-Driven Resource Allocation Scheme for IREE Oriented 6G Networks

  2025cites this paper
• Leveraging recurrence in neural network wavefunctions for large-scale simulations of Heisenberg antiferromagnets on the triangular lattice

  2025cites this paper
• Combining Sampling Methods with Attractor Dynamics in Spiking Models of Head-Direction Systems

  2025cites this paper
• Active filtering: a predictive function of recurrent circuits of sensory cortex

  2025cites this paper
• An Extensive Survey With Empirical Studies on Deep Temporal Point Process

  2025cites this paper
• IREE Oriented Resource Allocation for 6G networks: A Model-Data Dual-Driven Approach

  2025cites this paper
• Online Learning for Nonlinear Dynamical Systems without the I.I.D. Condition

  2025cites this paper
• Adaptive Neural Quantum States: A Recurrent Neural Network Perspective

  2025cites this paper
• Recurrent neural network spectral method and its application in stable filtering problems

  2025cites this paper
• A Mori-Zwanzig Formalism Based Estimation Approach for Dynamic Obstacle Avoidance

  2025cites this paper
• Machine learning real-time control of continuous granulation process.

  2025cites this paper
• Illuminating the Black Box of Reservoir Computing

  2025cites this paper
• Unravelling three-way interactions between Clostridioides difficile, microbiota and the host

  2025cites this paper
• Learning the climate of dynamical systems with state-space systems

  2025cites this paper
• State-space modeling in long sequence processing: a survey on recurrence in the transformer era

  2025cites this paper
• Active Filtering: A Predictive Function of Recurrent Circuits of Sensory Cortex.

  2025cites this paper
• Integrating Deep Model-Based Learning With Modular State-Based Stackelberg Games for Self-Optimizing Distributed Production Systems

  2025cites this paper
• Block-Biased Mamba for Long-Range Sequence Processing

  2025cites this paper
• Organizational regularities in recurrent neural networks

  2025cites this paper
• LSTM-Based Spectrum Occupancy Prediction Performance with Thin Plate Spline Model

  2025cites this paper
• Comparison between statistical models and machine learning for forecasting multivariate time series: An empirical approach

  2025cites this paper
• Provable wavelet-based neural approximation

  2025cites this paper
• Asymptotic evaluation of the information processing capacity in reservoir computing

  2025cites this paper
• MinGRU-Based Encoder for Turbo Autoencoder Frameworks

  2025cites this paper
• Provable Benefits of Complex Parameterizations for Structured State Space Models

  2024cites this paper
• Machine learning-based rapid visual screening for building damage assessment: study of Joshimath town of Garhwal Himalaya, India

  2024cites this paper
• Modeling nonlinear oscillator networks using physics-informed hybrid reservoir computing

  2024cites this paper
• Learnability of state spaces of physical systems is undecidable

  2024cites this paper
• Approximation Bounds for Recurrent Neural Networks with Application to Regression

  2024cites this paper
• GARCH-Informed Neural Networks for Volatility Prediction in Financial Markets

  2024cites this paper
• Nonlinear Neural Dynamics and Classification Accuracy in Reservoir Computing

  2024cites this paper
• Hierarchical Rule-Base Reduction-Based ANFIS With Online Optimization Through DDPG

  2024cites this paper
• A Nonlinear Modeling Framework for Force Estimation in Human-Robot Interaction

  2024cites this paper
• Temporally Correlated Compressed Sensing Using Generative Models for Channel Estimation in Unmanned Aerial Vehicles

  2024cites this paper
• Dissociative and prioritized modeling of behaviorally relevant neural dynamics using recurrent neural networks

  2024cites this paper
• Single-unit activations confer inductive biases for emergent circuit solutions to cognitive tasks

  2024cites this paper
• Recurrence resonance - noise-enhanced dynamics in recurrent neural networks

  2024cites this paper
• Code Rate Optimization via Neural Polar Decoders

  2024cites this paper
• Predicting heave and pitch motions of an FPSO using meta-learning

  2024cites this paper
• Cross-Lingual Transfert Learning for Speech Emotion Recognition

  2024cites this paper
• Novel Resilient Model Risk Forecasts Based on Neuro Volatility Models

  2024cites this paper
• GLAudio Listens to the Sound of the Graph

  2024cites this paper
• Convergence of Gradient Descent for Recurrent Neural Networks: A Nonasymptotic Analysis

  2024cites this paper
• A Bidirectional Feedforward Neural Network Architecture Using the Discretized Neural Memory Ordinary Differential Equation

  2024cites this paper
• Using GRU models in the LPV-LFT framework

  2024cites this paper
• Unexplainability of Artificial Intelligence Judgments in Kant's Perspective

  2024cites this paper
• On the Resurgence of Recurrent Models for Long Sequences - Survey and Research Opportunities in the Transformer Era

  2024cites this paper
• Universality conditions of unified classical and quantum reservoir computing

  2024cites this paper
• Data-Driven Neural Polar Decoders for Unknown Channels With and Without Memory

  2024cites this paper
• Walking through Hilbert Space with Quantum Computers.

  2024cites this paper
• Echo State Networks for Accurate and Efficient Modeling of Dynamic Circuits

  2024cites this paper
• A Comparison of Univariate Methods for Day-Ahead Short-Term Load Forecasting

  2024cites this paper
• Expressivity of Neural Networks with Random Weights and Learned Biases

  2024influential citation
• Non-convolutional Graph Neural Networks

  2024cites this paper
• KHNNs: hypercomplex neural networks computations via Keras using TensorFlow and PyTorch

  2024cites this paper
• Motion Planning Using Physics-Informed LSTMs for Autonomous Driving

  2024cites this paper
• Mori-zwanzig approach for belief abstraction with application to belief space planning

  2024cites this paper
• Chaotic recurrent neural networks for brain modelling: A review

  2024cites this paper
• Data-driven model identification and control of the quasi-zero-stiffness system

  2024cites this paper
• On Limitation of Transformer for Learning HMMs

  2024cites this paper
• Structured Learning of Compositional Sequential Interventions

  2024cites this paper
• Universal In-Context Approximation By Prompting Fully Recurrent Models

  2024influential citation
• Recurrent Natural Policy Gradient for POMDPs

  2024cites this paper
• On Non-asymptotic Theory of Recurrent Neural Networks in Temporal Point Processes

  2024cites this paper
• Wind speed short-term prediction using recurrent neural network GRU model and stationary wavelet transform GRU hybrid model

  2024cites this paper
• Non-trivial relationship between behavioral avalanches and internal neuronal dynamics in a recurrent neural network.

  2024cites this paper
• Convolutional Vision Transformer as a Path Following Controller for Omnidirectional Robots

  2024cites this paper
• Utilizing a CNN-RNN machine learning approach for forecasting time-series outlet fluid temperature monitoring by long-term operation of BHEs system

  2024cites this paper
• Function Extrapolation with Neural Networks and Its Application for Manifolds

  2024cites this paper
• Nonlinear Circuit Macromodeling Using New Heterogeneous-Layered Deep Clockwork Recurrent Neural Network

  2024cites this paper
• An Incremental Input-to-State Stability Condition for a Class of Recurrent Neural Networks

  2024cites this paper
• Wind Power Prediction with HCNNs for Turbines

  2023cites this paper
• Quadratic Neural Networks for Solving Inverse Problems

  2023cites this paper
• Validation set sampling strategies for predictive process monitoring

  2023cites this paper
• Memory augmented echo state network for time series prediction

  2023cites this paper
• A Novel Statistical and Neural Network Combined Approach for the Cloud Spot Market

  2023cites this paper
• Prediction of hourly PM_10 concentration through a hybrid deep learning-based method

  2023cites this paper
• Shaping dynamical neural computations using spatiotemporal constraints

  2023cites this paper
• MINDTwin AI: Multiphysics Informed Digital-Twin for Fault Localization in Induction Motor Using AI

  2023influential citation
• Model-based learning on state-based potential games for distributed self-optimization of manufacturing systems

  2023cites this paper
• Robust Load Forecasting Towards Adversarial Attacks via Bayesian Learning

  2023cites this paper
• A Deep Survey on Human Activity Recognition Using Mobile and Wearable Sensors

  2023cites this paper
• Offline RL with Discrete Proxy Representations for Generalizability in POMDPs

  2023cites this paper
• Predicting the Long-Term Dependencies in Time Series Using Recurrent Artificial Neural Networks

  2023cites this paper
• Data-Driven Neural Polar Codes for Unknown Channels With and Without Memory

  2023cites this paper
• Enhancing Prediction of Forelimb Movement Trajectory through a Calibrating-Feedback Paradigm Incorporating RAT Primary Motor and Agranular Cortical Ensemble Activity in the Goal-Directed Reaching Task

  2023cites this paper
• Embedding Capabilities of Neural ODEs

  2023cites this paper