New Millennium AI and the Convergence of History

Artificial Intelligence (AI) has recently become a real formal science: the new millennium brought the first mathematically sound, asymptotically optimal, universal problem solvers, providing a new, rigorous foundation for the previously largely heuristic field of General AI and embedded agents. At the same time there has been rapid progress in practical methods for learning true sequence-processing programs, as opposed to traditional methods limited to stationary pattern association. Here we will briefly review some of the new results, and speculate about future developments, pointing out that the time intervals between the most notable events in over 40,000 years or 29 lifetimes of human history have sped up exponentially, apparently converging to zero within the next few decades. Or is this impression just a by-product of the way humans allocate memory space to past events?

• Publication year

  2006

• Venue

  Challenges for Computational Intelligence

• Publication date

  2006-06-19

• Fields of study

  Computer Science, History

• Identifiers
  DOI 10.1007/978-3-540-71984-7_2arXiv cs/0606081
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Developmental Robotics

  2009cited by this paper
• Sequential Decisions based on Algorithmic Probability

  2008influential reference
• Training Recurrent Networks by Evolino

  2007cited by this paper
• Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks

  2006cited by this paper
• Co-evolving recurrent neurons learn deep memory POMDPs

  2005cited by this paper
• Evolino: Hybrid Neuroevolution / Optimal Linear Search for Sequence Prediction

  2005influential reference
• Gödel Machines: Towards a Technical Justification of Consciousness

  2005cited by this paper
• Rapid Retraining on Speech Data with LSTM Recurrent Networks.

  2005cited by this paper
• Sequence classificatio n for protein analysis

  2005cited by this paper
• Modeling systems with internal state using evolino

  2005cited by this paper
• Evolving Modular Fast-Weight Networks for Control

  2005cited by this paper
• Completely Self-referential Optimal Reinforcement Learners

  2005cited by this paper
• Classifying Unprompted Speech by Retraining LSTM Nets

  2005cited by this paper
• Framewise phoneme classification with bidirectional LSTM networks

  2005cited by this paper
• 2005 Special Issue: Framewise phoneme classification with bidirectional LSTM and other neural network architectures

  2005cited by this paper
• Evolino for recurrent support vector machines

  2005cited by this paper
• Introduction to real-time ray tracing

  2005cited by this paper
• Optimal Artificial Curiosity, Creativity, Music, and the Fine Arts

  2005cited by this paper
• Universal Artificial Intelligence

  2004influential reference
• Efficient reinforcement learning through symbiotic evolution

  2004cited by this paper
• Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication

  2004cited by this paper
• Learning Precise Timing with LSTM Recurrent Networks

  2003cited by this paper
• Kalman filters improve LSTM network performance in problems unsolvable by traditional recurrent nets

  2003cited by this paper
• Robust non-linear control through neuroevolution

  2003cited by this paper
• Active Guidance for a Finless Rocket Using Neuroevolution

  2003cited by this paper
• Goedel Machines: Self-Referential Universal Problem Solvers Making Provably Optimal Self-Improvements

  2003influential reference
• The New AI: General & Sound & Relevant for Physics

  2003cited by this paper
• Learning Nonregular Languages: A Comparison of Simple Recurrent Networks and LSTM

  2002cited by this paper
• The Speed Prior: A New Simplicity Measure Yielding Near-Optimal Computable Predictions

  2002influential reference
• Hierarchies of Generalized Kolmogorov Complexities and Nonenumerable Universal Measures Computable in the Limit

  2002cited by this paper
• Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies

  2001cited by this paper
• LSTM recurrent networks learn simple context-free and context-sensitive languages

  2001cited by this paper
• Recurrent nets that time and count

  2000cited by this paper
• The Fastest and Shortest Algorithm for all Well-Defined Problems

  2000cited by this paper
• Context-free and context-sensitive dynamics in recurrent neural networks

  2000cited by this paper
• Learning to Forget: Continual Prediction with LSTM

  2000cited by this paper
• Neural processing of complex continual input streams

  2000cited by this paper
• The Nature of Statistical Learning Theory

  2000influential reference
• Reinforcement Learning Soccer Teams with Incomplete World Models

  1999cited by this paper
• A Recurrent Neural Network that Learns to Count

  1999cited by this paper
• Learning a context-free task with a recurrent neural network: An analysis of stability

  1999cited by this paper
• Solving Non-Markovian Control Tasks with Neuro-Evolution

  1999cited by this paper
• Detonator of the population explosion

  1999cited by this paper
• Reinforcement Learning with Self-Modifying Policies

  1998cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Computation in Recurrent Neural Networks: From Counters to Iterated Function Systems

  1998cited by this paper
• Learning Team Strategies: Soccer Case Studies

  1998cited by this paper
• Recurrent Neural Networks Can Learn to Implement Symbol-Sensitive Counting

  1997cited by this paper
• Long Short-Term Memory

  1997influential reference
• Probabilistic Incremental Program Evolution

  1997cited by this paper
• Analysis of Dynamical Recognizers

  1997cited by this paper
• Incremental Evolution of Complex General Behavior

  1997cited by this paper
• Book Review: An introduction to Kolmogorov Complexity and its Applications Second Edition, 1997 by Ming Li and Paul Vitanyi (Springer (Graduate Text Series))

  1997cited by this paper
• An Introduction to Kolmogorov Complexity and Its Applications, Third Edition

  1997cited by this paper
• A Recurrent Network that performs a Context-Sensitive Prediction Task

  1996cited by this paper
• Reinforcement Learning: A Survey

  1996cited by this paper
• The Dynamics of Discrete-Time Computation, with Application to Recurrent Neural Networks and Finite State Machine Extraction

  1996cited by this paper
• Learning long-term dependencies in NARX recurrent neural networks

  1996cited by this paper
• Gradient calculations for dynamic recurrent neural networks: a survey

  1995cited by this paper
• Learning to count without a counter: A case study of dynamics and activation landscapes in recurrent networks

  1995cited by this paper
• Inductive Functional Programming Using Incremental Program Transformation

  1995cited by this paper
• Evolving Mobile Robots in Simulated and Real Environments

  1995cited by this paper
• Neural networks

  1995cited by this paper
• GPS, a program that simulates human thought

  1995cited by this paper
• Removing the Genetics from the Standard Genetic Algorithm

  1995cited by this paper
• How to Evolve Autonomous Robots: Different Approaches in Evolutionary Robotics

  1994cited by this paper
• Discrete recurrent neural networks for grammatical inference

  1994cited by this paper
• Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks

  1994cited by this paper
• Sequential Behavior and Learning in Evolved Dynamical Neural Networks

  1994cited by this paper
• Evolving virtual creatures

  1994cited by this paper
• An application of recurrent nets to phone probability estimation

  1994cited by this paper
• Netzwerkarchitekturen, Zielfunktionen und Kettenregel (Network architectures, objective functions, and chain rule)

  1993cited by this paper
• An Introduction to Kolmogorov Complexity and Its Applications

  1993influential reference
• Neural Networks for Pattern Recognition

  1993cited by this paper
• A review of evolutionary artificial neural networks

  1993cited by this paper
• Connectionist Speech Recognition: A Hybrid Approach

  1993cited by this paper
• Experimental Comparison of the Effect of Order in Recurrent Neural Networks

  1993cited by this paper
• A Fixed Size Storage O(n3) Time Complexity Learning Algorithm for Fully Recurrent Continually Running Networks

  1992cited by this paper
• Learning Sequential Tasks by Incrementally Adding Higher Orders

  1992cited by this paper
• Time Warping Invariant Neural Networks

  1992cited by this paper
• Learning to Control Fast-Weight Memories: An Alternative to Dynamic Recurrent Networks

  1992cited by this paper
• Induction of Finite-State Languages Using Second-Order Recurrent Networks

  1992cited by this paper
• Holographic Recurrent Networks

  1992cited by this paper
• Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence

  1992cited by this paper
• Reinforcement Learning in Markovian and Non-markovian Environments

  1991cited by this paper
• Turing computability with neural nets

  1991cited by this paper
• Induction of Multiscale Temporal Structure

  1991cited by this paper
• Untersuchungen zu dynamischen neuronalen Netzen

  1991cited by this paper
• A Theory for Neural Networks with Time Delays

  1990cited by this paper
• Dynamische neuronale Netze und das fundamentale raumzeitliche Lernproblem

  1990cited by this paper
• A learning rule for asynchronous perceptrons with feedback in a combinatorial environment

  1990cited by this paper
• An on-line algorithm for dynamic reinforcement learning and planning in reactive environments

  1990cited by this paper
• Finding Structure in Time

  1990cited by this paper
• An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories

  1990cited by this paper
• Designing Neural Networks using Genetic Algorithms

  1989cited by this paper
• Learning State Space Trajectories in Recurrent Neural Networks

  1989cited by this paper
• Recurrent Backpropagation and the Dynamical Approach to Adaptive Neural Computation

  1989cited by this paper
• Generalization of backpropagation with application to a recurrent gas market model

  1988cited by this paper
• Evolutionary principles in self-referential learning, or on learning how to learn: The meta-meta-. hook

  1987cited by this paper
• Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations

  1986cited by this paper

• Accident Detection in Autonomous Vehicles Using Modified Restricted Boltzmann Machine

  2022cites this paper
• A philosophical view on singularity and strong AI

  2022cites this paper
• Are we ready for a new paradigm shift? A survey on visual deep MLP

  2021cites this paper
• 6. Life at the Femtosecond

  2021cites this paper
• Near-Term Indications and Models of a Singularity

  2020cites this paper
• A survey of the recent architectures of deep convolutional neural networks

  2019cites this paper
• Were "Super-Turing" Diagrammatic Reasoning Mechanisms Ancient Products of Biological Evolution?

  2018cites this paper
• The Trifurcation of the Labor Markets in the Networked, Knowledge-Driven, Global Economy

  2017cites this paper
• The Trifurcation of the Labor Markets in the Networked, Knowledge-Driven, Global Economy

  2016cites this paper
• Creative Zombie Apocalypse: A Critique of Computer Creativity Evaluation

  2016cites this paper
• Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review

  2016cites this paper
• The probable foundations of sustainabilism: Information, energy and entropy based definition of capital, Homo Sustainabiliticus and the need for a “new gold”

  2016cites this paper
• Effective connectivity at synaptic level in humans: a review and future prospects

  2014cites this paper
• TECHNOLOGICAL SINGULARITY IN THE AGE OF SURPRISE FACING COMPLEXITY

  2014cites this paper
• Why person models are important for human factors science

  2014cites this paper
• The errors, insights and lessons of famous AI predictions – and what they mean for the future

  2014cites this paper
• Introduction—What Kind of an Asset Is Human Capital, How Should It Be Measured, and in What Markets?

  2014cites this paper
• Why person models are important for human factors science

  2014cites this paper
• Maximizing Fun by Creating Data with Easily Reducible Subjective Complexity

  2013cites this paper
• Intrinsically Motivated Learning in Natural and Artificial Systems

  2013cites this paper
• An Overview of Models of Technological Singularity

  2013cites this paper
• New Millennium AI and the Convergence of History: Update of 2012

  2012cites this paper
• Can Intelligence Explode?

  2012cites this paper
• Self-Delimiting Neural Networks

  2012cites this paper
• The Fastest Way of Computing All Universes

  2012cites this paper
• How many singularities are near and how will they disrupt human history

  2011cites this paper
• On Fast Deep Nets for AGI Vision

  2011cites this paper
• The new AI is general and mathematically rigorous

  2010cites this paper
• Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010)

  2010cites this paper
• The New AI is General & Mathematically Rigorous

  2010cites this paper
• Ultimate Cognition à la Gödel

  2009cites this paper
• Simple algorithmic theory of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes (特集 高次機能の学習と創発--脳・ロボット・人間研究における新たな展開)

  2009cites this paper
• Five Answers on Randomness

  2009cites this paper
• Global Catastrophic Risks

  2008cites this paper
• Highlights of Ai History—from Gödel to 2006

  2008cites this paper
• Hughes " Millennial Tendencies " 1 Unproofed Preprint Millennial Tendencies in Responses to Apocalyptic Threats

  2008cites this paper
• Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

  2008cites this paper
• Simple Algorithmic Principles of Discovery, Subjective Beauty, Selective Attention, Curiosity and Creativity

  2007cites this paper
• 2006: Celebrating 75 Years of AI - History and Outlook: The Next 25 Years

  2007influential citation
• Simple Algorithmic Principles of Discovery, Subjective Beauty, Selective Attention, Curiosity & Creativity

  2007cites this paper