Sequential decision theory formally solves the problem of rational agents in uncertain worlds if the true environmental prior probability distribution is known. Solomonoff’s theory of universal induction formally solves the problem of sequence prediction for unknown prior distribution. We combine both ideas and get a parameter-free theory of universal Artificial Intelligence. We give strong arguments that the resulting AIXI model is the most intelligent unbiased agent possible. We outline how the AIXI model can formally solve a number of problem classes, including sequence prediction, strategic games, function minimization, reinforcement and supervised learning. The major drawback of the AIXI model is that it is un-computable. To overcome this problem, we construct a modified algorithm AIXItl that is still effectively more intelligent than any other time t and length l bounded agent. The computation time of AIXItl is of the order t·2l. The discussion includes formal definitions of intelligence order relations, the horizon problem and relations of the AIXI theory to other AI approaches.
Universal Algorithmic Intelligence: A Mathematical Top→Down Approach
Published 2007 in Artificial General Intelligence
ABSTRACT
PUBLICATION RECORD
- Publication year
2007
- Venue
Artificial General Intelligence
- Publication date
2007-01-19
- Fields of study
Mathematics, Computer Science
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
CLAIMS
- AIXI is presented as an unbiased agent that can formally solve several problem classes, including sequence prediction, strategic games, function minimization, reinforcement learning, and supervised learning.박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review
CONCEPTS
- aixi
An idealized universal agent defined by combining sequential decision theory with Solomonoff induction.
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - aixitl
A time- and length-bounded modification of AIXI introduced as a computable approximation.
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - function minimization
An optimization problem class in which the goal is to find inputs that minimize a function value.
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - intelligence order relations
Formal relations used to compare agents by relative intelligence in the AIXI framework.
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - reinforcement learning
A learning setting in which an agent acts to maximize cumulative reward from environmental feedback.
Aliases: RL
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - sequence prediction
The task of predicting future symbols or observations from past data.
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - sequential decision theory
A formal framework for choosing actions in uncertain environments when the true environmental prior is known.
Aliases: SDT
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - solomonoff induction
A universal sequence prediction framework for inference when the prior distribution is unknown.
Aliases: universal induction
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - strategic games
Multi-agent decision problems in which outcomes depend on the actions of competing agents.
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - supervised learning
A learning setting based on labeled input-output examples.
Aliases: SL
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - time and length bounds
Constraints that limit the computation time and description length available to an agent.
Aliases: t and l bounds
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - uncomputable
A property of a model or algorithm that cannot be implemented as a general effective computation.
Aliases: non-computable
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review - universal artificial intelligence
A parameter-free AI framework formed by combining sequential decision theory with Solomonoff induction.
Aliases: universal AI, UAI
박진우 (dztg5apj7m) extractionB (s683577b42) reviewAnonymous (12632b8b5f) reviewjihoonc (k5vuy3tzcm) review
REFERENCES
Showing 1-65 of 65 references · Page 1 of 1