An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories

No abstract is available for this paper.

• Publication year

  1990

• Venue

  Neural Computation

• Publication date

  1990-12-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1162/neco.1990.2.4.490
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Comparison of four neural net learning methods for dynamic system identification

  1992cited by this paper
• Gradient-based learning algorithms for recurrent connectionist networks

  1990cited by this paper
• A learning rule for asynchronous perceptrons with feedback in a combinatorial environment

  1990cited by this paper
• A Subgrouping Strategy that Reduces Complexity and Speeds Up Learning in Recurrent Networks

  1989influential reference
• A learning algorithm for analog, fully recurrent neural networks

  1989cited by this paper
• Finite State Automata and Simple Recurrent Networks

  1989cited by this paper
• A Learning Algorithm for Continually Running Fully Recurrent Neural Networks

  1989influential reference
• Learning State Space Trajectories in Recurrent Neural Networks

  1989cited by this paper
• Experimental Analysis of the Real-time Recurrent Learning Algorithm

  1989influential reference
• Generalization of back-propagation to recurrent neural networks.

  1987cited by this paper
• Learning internal representations by error propagation

  1986cited by this paper

• Tuning the burn-in phase in training recurrent neural networks improves their performance

  2026cites this paper
• Look Forward to Walk Backward: Efficient Terrain Memory for Backward Locomotion with Forward Vision

  2026cites this paper
• STAR-SNN: A spatio-temporal adaptive recurrent spiking neural network with separated propagation surrogate gradient for hardware efficient real-time learning

  2026cites this paper
• Recurrence mimicking learning: Eliminating sequential rollouts in offline recurrent reinforcement learning

  2026cites this paper
• PF-DTN: Predictive Routing for Intelligent Delay Tolerant Networks Using RNN-LSTM Deep Learning With Monte Carlo Dropout Uncertainty Estimation and Hybrid Deterministic, Probabilistic, and Uncertain Routing Strategies

  2026cites this paper
• Predictive E-prop: A biologically inspired approach to train predictive coding-based recurrent spiking neural networks

  2026cites this paper
• Understanding and Improving Length Generalization in Recurrent Models

  2025cites this paper
• STSF: Spiking Time Sparse Feedback Learning for Spiking Neural Networks

  2025cites this paper
• Professional Forecasters vs. Shallow Neural Network Ensembles: Assessing Inflation Prediction Accuracy

  2025cites this paper
• RNN Beamforming Optimizer for Rate-Splitting Multiple Access and Cell-Free Massive MIMO

  2025cites this paper
• A Discrepancy-Based Perspective on Dataset Condensation

  2025cites this paper
• TD3: Tucker Decomposition Based Dataset Distillation Method for Sequential Recommendation

  2025cites this paper
• Towards Bio-Inspired Robotic Trajectory Planning via Self-Supervised RNN

  2025cites this paper
• Control of dynamical systems with neural networks

  2025cites this paper
• TTT3R: 3D Reconstruction as Test-Time Training

  2025cites this paper
• Localization of epileptic foci from intracranial EEG using the GRU-GC algorithm

  2025cites this paper
• Temporal recurrence as a general mechanism to explain neural responses in the auditory system

  2025cites this paper
• A data-driven model for steel bridge temperature behaviour based on deep learning technology and heat transfer analysis

  2025cites this paper
• Understanding and Improving Length Generalization in Hierarchical Sparse Attention Models

  2025cites this paper
• PolyRNN: A time-resolved model of polyphonic musical expectations aligned with human brain responses

  2025cites this paper
• Physics-inspired data-driven modeling of complex mechanical components in mecha(tro)nic systems

  2025cites this paper
• Dopamine-driven synaptic credit assignment in neural networks

  2025influential citation
• Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence

  2025cites this paper
• Intelligence Foundation Model: A New Perspective to Approach Artificial General Intelligence

  2025cites this paper
• IE2Video: Adapting Pretrained Diffusion Models for Event-Based Video Reconstruction

  2025cites this paper
• Online Cyber‐Physical Neural Network Model for Real‐Time Hybrid Simulation

  2025cites this paper
• State-space modeling in long sequence processing: a survey on recurrence in the transformer era

  2025cites this paper
• Neural Associative Skill Memories for safer robotics and modelling human sensorimotor repertoires

  2025influential citation
• Enhancing Time-Series Anomaly Detection by Integrating Spectral-Residual Bottom-Up Attention with Reservoir Computing

  2025cites this paper
• A scalable hybrid training approach for recurrent spiking neural networks

  2025cites this paper
• Ictal-onset localization through effective connectivity analysis based on RNN-GC with intracranial EEG signals in patients with epilepsy

  2024cites this paper
• Future frame prediction in chest and liver cine MRI using the PCA respiratory motion model: comparing transformers and dynamically trained recurrent neural networks

  2024cites this paper
• Rate-Splitting MIMO Multiple Access — An Amortized Optimization Approach

  2024cites this paper
• FinDKG: Dynamic Knowledge Graphs with Large Language Models for Detecting Global Trends in Financial Markets

  2024cites this paper
• Learning grid cells by predictive coding

  2024influential citation
• Neurocontrol for fixed-length trajectories in environments with soft barriers

  2024cites this paper
• Advancements in diffusion models for high-resolution image and short form video generation

  2024cites this paper
• A novel detection method for wheat aging based on the delayed luminescence

  2024cites this paper
• Practical Implementation of KalmanNet for Accurate Data Fusion in Integrated Navigation

  2024cites this paper
• DeepESN Neural Networks for Industrial Predictive Maintenance through Anomaly Detection from Production Energy Data

  2024cites this paper
• Real-Time Recurrent Learning using Trace Units in Reinforcement Learning

  2024cites this paper
• TheraGen: Therapy for Every Generation

  2024cites this paper
• Time-series Initialization and Conditioning for Video-agnostic Stabilization of Video Super-Resolution using Recurrent Networks

  2024cites this paper
• A Differentiable Approach to Multi-scale Brain Modeling

  2024cites this paper
• TwinStep Network (TwNet): a Neuron-Centric Architecture Achieving Rapid Training

  2024cites this paper
• Novel Amalgamation of Bat and Elephant Herd Optimization Algorithms for Generation Mix in Renewable Active Distribution Networks

  2024cites this paper
• A neural network-based algorithm for the reconstruction and filtering of single particle trajectory in magnetic particle tracking.

  2024cites this paper
• Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patches

  2024cites this paper
• UIO-LLMs: Unbiased Incremental Optimization for Long-Context LLMs

  2024cites this paper
• Reversible molecular simulation for training classical and machine-learning force fields

  2024cites this paper
• Deep-Graph-Sprints: Accelerated Representation Learning in Continuous-Time Dynamic Graphs

  2024cites this paper
• SOLSA: Neuromorphic Spatiotemporal Online Learning for Synaptic Adaptation

  2024cites this paper
• Real-time respiratory motion forecasting with online learning of recurrent neural networks for accurate targeting in externally guided radiotherapy

  2024cites this paper
• Functional Bilevel Optimization for Machine Learning

  2024cites this paper
• Optimal Control of Renewable Energy Communities subject to Network Peak Fees with Model Predictive Control and Reinforcement Learning Algorithms

  2024cites this paper
• On the Resurgence of Recurrent Models for Long Sequences - Survey and Research Opportunities in the Transformer Era

  2024cites this paper
• Temporal Lidar Depth Completion

  2024cites this paper
• A Dynamical Systems Approach to Optimal Foraging

  2024cites this paper
• Recurrent Reinforcement Learning with Memoroids

  2024cites this paper
• Recurrent Inertial Graph-Based Estimator (RING): A Single Pluripotent Inertial Motion Tracking Solution

  2024cites this paper
• Language Modeling Using Tensor Trains

  2024cites this paper
• Revisiting Topic-Guided Language Models

  2023cites this paper
• Scalable Real-Time Recurrent Learning Using Sparse Connections and Selective Learning

  2023cites this paper
• AngoraPy: A Python toolkit for modeling anthropomorphic goal-driven sensorimotor systems

  2023cites this paper
• Automatic Data Augmentation Learning using Bilevel Optimization for Histopathological Images

  2023cites this paper
• AngoraPy: A Python Toolkit for Modelling Anthropomorphic Goal-Driven Sensorimotor Systems

  2023influential citation
• Combating Spurious Correlations in Loose‐fitting Garment Animation Through Joint‐Specific Feature Learning

  2023cites this paper
• End-to-End Prediction of Sodium Concentration from Uncalibrated Sodium ISFETs

  2023cites this paper
• Neuromorphic Online Learning for Spatiotemporal Patterns with a Forward-only Timeline

  2023influential citation
• Exploring the Promise and Limits of Real-Time Recurrent Learning

  2023cites this paper
• Learning Fixed Points of Recurrent Neural Networks by Reparameterizing the Network Model

  2023cites this paper
• An improved dynamic programming tracking-before-detection algorithm based on LSTM network

  2023cites this paper
• Gradient-free training of neural ODEs for system identification and control using ensemble Kalman inversion

  2023influential citation
• HyperE2VID: Improving Event-Based Video Reconstruction via Hypernetworks

  2023cites this paper
• Embarassingly Simple Dataset Distillation

  2023cites this paper
• Modeling nonlinear flutter behavior of long‐span bridges using knowledge‐enhanced long short‐term memory network

  2023cites this paper
• Quantum Machine Learning hyperparameter search

  2023cites this paper
• End-to-End Speech Recognition: A Survey

  2023cites this paper
• Embedding Propagation over Heterogeneous Information Networks

  2023cites this paper
• Online Real-Time Recurrent Learning Using Sparse Connections and Selective Learning

  2023cites this paper
• Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single

  2023cites this paper
• Optimal Knowledge Component Extracting Model for Knowledge-Concept Graph Completion in Education

  2023cites this paper
• Meta-DSP: A Meta-Learning Approach for Data-Driven Nonlinear Compensation in High-Speed Optical Fiber Systems

  2023cites this paper
• Scalable Real-Time Recurrent Learning Using Columnar-Constructive Networks

  2023cites this paper
• Machine learning for closure models

  2022cites this paper
• Controlling a solar receiver with multiple thermochemical reactors for hydrogen production by an LSTM neural network based cascade controller

  2022cites this paper
• Prospects and Challenges of AI and Neural Network Algorithms in MEMS Microcantilever Biosensors

  2022cites this paper
• Fixed-Point Automatic Differentiation of Forward-Backward Splitting Algorithms for Partly Smooth Functions

  2022cites this paper
• ROLAND: Graph Learning Framework for Dynamic Graphs

  2022cites this paper
• Cardinality Estimation of Approximate Substring Queries using Deep Learning

  2022cites this paper
• Research and Application of Deformation Prediction Model for Deep Foundation Pit Based on LSTM

  2022influential citation
• China’s GDP forecasting using Long Short Term Memory Recurrent Neural Network and Hidden Markov Model

  2022cites this paper
• A strategy of improving indoor air temperature prediction in HVAC system based on multivariate transfer entropy

  2022cites this paper
• Near-optimal control of dynamical systems with neural ordinary differential equations

  2022cites this paper
• Beyond backpropagation: implicit gradients for bilevel optimization

  2022cites this paper
• Digital prediction model of temperature-induced deflection for cable-stayed bridges based on learning of response-only data

  2022cites this paper
• Memorizing Transformers

  2022cites this paper
• Block-Recurrent Transformers

  2022cites this paper
• Learning Thermal Properties and Temperature Models of Electric Motors with Neural Ordinary Differential Equations

  2022cites this paper
• Implicit n-grams Induced by Recurrence

  2022cites this paper