A Survey of Monte Carlo Tree Search Methods

No abstract is available for this paper.

• Publication year

  2012

• Venue

  IEEE Transactions on Computational Intelligence and AI in Games

• Publication date

  2012-02-03

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/TCIAIG.2012.2186810
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Monte-Carlo Expression Discovery

  2013cited by this paper
• MOHEX Wins Hex Tournament

  2012cited by this paper
• Guiding Combinatorial Optimization with UCT

  2012cited by this paper
• CASTRO Wins Havannah Tournament

  2012cited by this paper
• Understanding Sampling Style Adversarial Search Methods

  2012cited by this paper
• Monte-Carlo Tree Search for the Simultaneous Move Game Tron

  2012cited by this paper
• A Parallel General Game Player

  2011influential reference
• Ensemble Monte-Carlo Planning: An Empirical Study

  2011cited by this paper
• Repeated-task Canadian Traveler Problem

  2011cited by this paper
• Monte-Carlo tree search and rapid action value estimation in computer Go

  2011influential reference
• A Monte-Carlo approach for the endgame of Ms. Pac-Man

  2011cited by this paper
• Trade-Offs in Sampling-Based Adversarial Planning

  2011influential reference
• Lemmas on partial observation, with application to phantom games

  2011cited by this paper
• Tree Parallelization of Ary on a Cluster

  2011influential reference
• Modelling and evaluation of complex scenarios with the Strategy Game Description Language

  2011influential reference
• αβ-based play-outs in Monte-Carlo Tree Search

  2011cited by this paper
• Computer poker: A review

  2011influential reference
• Approaching Bayes-optimalilty using Monte-Carlo tree search

  2011cited by this paper
• Parallel Monte-Carlo Tree Search for HPC Systems

  2011cited by this paper
• Multiple Tree for Partially Observable Monte-Carlo Tree Search

  2011influential reference
• Computational and human intelligence in blind Go

  2011cited by this paper
• Random positions in Go

  2011cited by this paper
• UCD : Upper Con dence bound for rooted Directed acyclic graphs

  2011influential reference
• Upper Confidence Trees with Short Term Partial Information

  2011cited by this paper
• Multi-agent Monte Carlo Go

  2011influential reference
• Monte-Carlo Style UCT Search for Boolean Satisfiability

  2011influential reference
• CadiaPlayer: Search-Control Techniques

  2011influential reference
• The Dangers of Random Playouts

  2011cited by this paper
• Continuous Upper Confidence Trees

  2011influential reference
• Double Updating Online Learning

  2011cited by this paper
• GIB: Imperfect Information in a Computationally Challenging Game

  2011cited by this paper
• Monte-Carlo tree search in Ms. Pac-Man

  2011cited by this paper
• Optimization of the Nested Monte-Carlo Algorithm on the Traveling Salesman Problem with Time Windows

  2011influential reference
• Monte-Carlo Tree Search for the game of Scotland Yard

  2011influential reference
• Learning non-random moves for playing Othello: Improving Monte Carlo Tree Search

  2011cited by this paper
• Sample-Based Planning for Continuous Action Markov Decision Processes

  2011cited by this paper
• Towards Procedural Strategy Game Generation: Evolving Complementary Unit Types

  2011influential reference
• Towards MCTS for Creative Domains

  2011influential reference
• Fast Approximate Max-n Monte Carlo Tree Search for Ms Pac-Man

  2011cited by this paper
• On the Behavior of UCT in Synthetic Search Spaces

  2011cited by this paper
• Determinization and information set Monte Carlo Tree Search for the card game Dou Di Zhu

  2011cited by this paper
• Revisiting Monte-Carlo Tree Search on a Normal Form Game: NoGo

  2011cited by this paper
• A Linear Classifier Outperforms UCT in 9 x 9 Go

  2011influential reference
• A new benchmark for artificial intelligence

  2011cited by this paper
• Selective search in games of different complexity

  2011cited by this paper
• Real-Time Solving of Quantified CSPs Based on Monte-Carlo Game Tree Search

  2011influential reference
• Learning is planning: near Bayes-optimal reinforcement learning via Monte-Carlo tree search

  2011cited by this paper
• A Local Monte Carlo Tree Search Approach in Deterministic Planning

  2011cited by this paper
• Multi-Armed Bandit Bayesian Decision Making

  2010cited by this paper
• Some Improvements for Monte-Carlo Tree Search, Game Description Language Compilati

  2010cited by this paper
• Monte-Carlo Tree Search

  2010cited by this paper
• Improving Monte-Carlo Tree Search in Havannah

  2010cited by this paper
• A UCT agent for Tron: Initial investigations

  2010cited by this paper
• A Shogi Program Based on Monte-Carlo Tree Search

  2010influential reference
• Investigating UCT and RAVE: steps towards a more robust method

  2010cited by this paper
• Optimizing player's satisfaction through DDA of game AI by UCT for the Game Dead-End

  2010cited by this paper
• The Power of Forgetting: Improving the Last-Good-Reply Policy in Monte Carlo Go

  2010influential reference
• Monte Carlo tree search in Kriegspiel

  2010cited by this paper
• Monte-Carlo Approximation of Temperature

  2010cited by this paper
• Time Management for Monte-Carlo Tree Search Applied to the Game of Go

  2010cited by this paper
• Bandit-Based Genetic Programming

  2010cited by this paper
• Feature Selection as a One-Player Game

  2010influential reference
• Monte-Carlo Simulation Balancing Applied to 9x9 Go

  2010cited by this paper
• Centurio, a General Game Player: Parallel, Java- and ASP-based

  2010influential reference
• Computational Experiments with the RAVE Heuristic

  2010cited by this paper
• Evaluation of Game Tree Search Methods by Game Records

  2010influential reference
• The Drosophila revisited

  2010cited by this paper
• Scalability and Parallelization of Monte-Carlo Tree Search

  2010cited by this paper
• Integrating Sample-Based Planning and Model-Based Reinforcement Learning

  2010influential reference
• On the Scalability of Parallel UCT

  2010cited by this paper
• Evaluation of Simulation Strategy on Single-Player Monte-Carlo Tree Search and its Discussion for a Practical Scheduling Problem

  2010influential reference
• Nested Monte-Carlo Search with AMAF Heuristic

  2010cited by this paper
• Continuous Lunches Are Free Plus the Design of Optimal Optimization Algorithms

  2010cited by this paper
• Monte Carlo Tree Search in Hex

  2010cited by this paper
• Consistency Modifications for Automatically Tuned Monte-Carlo Tree Search

  2010influential reference
• Understanding the Success of Perfect Information Monte Carlo Sampling in Game Tree Search

  2010cited by this paper
• Parallel Monte-Carlo Tree Search with Simulation Servers

  2010cited by this paper
• Enhancements for Multi-Player Monte-Carlo Tree Search

  2010cited by this paper
• Monte-Carlo Hex

  2010cited by this paper
• Monte-Carlo Opening Books for Amazons

  2010influential reference
• Author manuscript, published in "IEEE Conference on Computational Intelligence and Games (2010)" On the Huge Benefit of Decisive Moves in Monte-Carlo Tree Search Algorithms

  2010influential reference
• A Monte-Carlo approach for ghost avoidance in the Ms. Pac-Man game

  2010cited by this paper
• Nested Monte-Carlo Expression Discovery

  2010influential reference
• Current Frontiers in Computer Go

  2010cited by this paper
• Monte Carlo Tree Search in Lines of Action

  2010influential reference
• Monte-Carlo Simulation Balancing in Practice

  2010cited by this paper
• Monte-Carlo Planning for Pathfinding in Real-Time Strategy Games

  2010cited by this paper
• Biasing Monte-Carlo Simulations through RAVE Values

  2010cited by this paper
• On Adversarial Search Spaces and Sampling-Based Planning

  2010cited by this paper
• Determining Game Quality Through UCT Tree Shape Analysis

  2010cited by this paper
• Evaluating Root Parallelization in Go

  2010cited by this paper
• Bayesian Inference in Monte-Carlo Tree Search

  2010cited by this paper
• Pruning in UCT Algorithm

  2010influential reference
• An UCT Approach for Anytime Agent-Based Planning

  2010influential reference
• Intelligent Agents for the Game of Go

  2010cited by this paper
• Fuego—An Open-Source Framework for Board Games and Go Engine Based on Monte Carlo Tree Search

  2010cited by this paper
• Parameter Tuning by Simple Regret Algorithms and Multiple Simultaneous Hypothesis Testing

  2010cited by this paper
• Finding the Needle in the Haystack with Heuristically Guided Swarm Tree Search

  2010influential reference
• UCD: Upper Confidence Bound for Rooted Directed Acyclic Graphs

  2010cited by this paper
• Learning Simulation Control in General Game-Playing Agents

  2010influential reference

• PhotoAgent: Agentic Photo Editing with Exploratory Visual Aesthetic Planning

  2026cites this paper
• DiffCoT: Diffusion-styled Chain-of-Thought Reasoning in LLMs

  2026cites this paper
• COLT: Lightweight Multi-LLM Collaboration through Shared MCTS Reasoning for Model Compilation

  2026cites this paper
• Cognitive Models and AI Algorithms Provide Templates for Designing Language Agents

  2026cites this paper
• Gaze dynamics prior to navigation support hierarchical planning

  2026cites this paper
• Shapley Meets DCOP: A Unified Structural Credit Assignment for Multiagent Planning and Multiagent Reinforcement Learning

  2026cites this paper
• When KV Cache Reuse Fails in Multi-Agent Systems: Cross-Candidate Interaction is Crucial for LLM Judges

  2026cites this paper
• TopoLS: Lattice Surgery Compilation via Topological Program Transformations

  2026cites this paper
• Online Navigation Planning for Long-term Autonomous Operation of Underwater Gliders

  2026cites this paper
• HarmonyCell: Automating Single-Cell Perturbation Modeling under Semantic and Distribution Shifts

  2026cites this paper
• Macro placement optimization via dynamic tree search guided reinforcement learning

  2026cites this paper
• Deadline-Aware, Energy-Efficient Control of Domestic Immersion Hot Water Heaters

  2026cites this paper
• Autonomous and efficient large-scale snow avalanche monitoring with an Unmanned Aerial System (UAS)

  2026cites this paper
• LLM-as-a-Judge for Software Engineering: Literature Review, Vision, and the Road Ahead

  2026cites this paper
• ACDZero: MCTS Agent for Mastering Automated Cyber Defense

  2026cites this paper
• Inference-Time Scaling for Visual AutoRegressive Modeling by Searching Representative Samples

  2026cites this paper
• REprompt: Prompt Generation for Intelligent Software Development Guided by Requirements Engineering

  2026cites this paper
• TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimization

  2026cites this paper
• Large Language Model-based power dispatch agent: Framework, application and challenges

  2026cites this paper
• Training-Free Adaptation of Diffusion Models via Doob's $h$-Transform

  2026cites this paper
• RF-Agent: Automated Reward Function Design via Language Agent Tree Search

  2026cites this paper
• Odin: Multi-Signal Graph Intelligence for Autonomous Discovery in Knowledge Graphs

  2026cites this paper
• BFS-PO: Best-First Search for Large Reasoning Models

  2026cites this paper
• AlphaPROBE: Alpha Mining via Principled Retrieval and On-graph biased evolution

  2026cites this paper
• Multi-Agent Monte Carlo Tree Search for Makespan-Efficient Object Rearrangement in Cluttered Spaces

  2026cites this paper
• Advancement and challenges of reinforcement learning in lung cancer imaging

  2026cites this paper
• Monte-Carlo Tree Search with Neural Network Guidance for Lane-Free Autonomous Driving

  2026cites this paper
• Post-Earthquake Restoration of Electricity-Gas Distribution Systems with Damage Information Collection and Repair Vehicle Routing

  2026cites this paper
• Convergence of MEC and DRL in Non-Terrestrial Wireless Networks: Key Innovations, Challenges, and Future Pathways

  2026cites this paper
• From Nodes to Roads: Surveying DRL Applications in MEC-Enhanced Terrestrial Wireless Networks

  2026cites this paper
• Reinforcement Learning Decision and Planning Algorithm Using Posterior Return Heuristic

  2026cites this paper
• Distributed Learning for Multi-Stage Bandits: No-Regret Algorithm and Lower Bound

  2026cites this paper
• Q-Regularized Generative Auto-Bidding: From Suboptimal Trajectories to Optimal Policies

  2026cites this paper
• Physics-Informed Tree Search for High-Dimensional Computational Design

  2026cites this paper
• EmboTeam: Grounding LLM Reasoning into Reactive Behavior Trees via PDDL for Embodied Multi-Robot Collaboration

  2026cites this paper
• Adaptive hierarchical learning for uncertainty-aware distributed energy resource planning

  2026cites this paper
• HEATACO: Heatmap-Guided Ant Colony Decoding for Large-Scale Travelling Salesman Problems

  2026cites this paper
• Edge General Intelligence Through World Models, Large Language Models, and Agentic AI: Fundamentals, Solutions, and Challenges

  2026cites this paper
• AgentXRay: White-Boxing Agentic Systems via Workflow Reconstruction

  2026cites this paper
• Smaller is Better: Generative Models Can Power Short Video Preloading

  2026cites this paper
• Policy4OOD: A Knowledge-Guided World Model for Policy Intervention Simulation against the Opioid Overdose Crisis

  2026cites this paper
• TabTracer: Monte Carlo Tree Search for Complex Table Reasoning with Large Language Models

  2026cites this paper
• Recent advancements in human-centric entertainment AI: challenges and benefits

  2026cites this paper
• CACTUSDB: Unlock Co-Optimization Opportunities for SQL and AI/ML Inferences

  2026cites this paper
• AI4S-SDS: A Neuro-Symbolic Solvent Design System via Sparse MCTS and Differentiable Physics Alignment

  2026cites this paper
• SEA-TS: Self-Evolving Agent for Autonomous Code Generation of Time Series Forecasting Algorithms

  2026cites this paper
• Can an AI agent lead human teams?

  2026cites this paper
• Regret-Guided Search Control for Efficient Learning in AlphaZero

  2026influential citation
• Can I Have Your Order? Monte-Carlo Tree Search for Slot Filling Ordering in Diffusion Language Models

  2026cites this paper
• Lightweight MCTS-PPO with lookahead guidance and gated distillation for on-orbit refueling mission planning

  2026cites this paper
• Optimal Multi-Debris Mission Planning in LEO: A Deep Reinforcement Learning Approach with Co-Elliptic Transfers and Refueling

  2026influential citation
• LLM-Powered Security Test Generation: Oracles, Vulnerability Probes, and Adversarial Inputs

  2026cites this paper
• A safe horizon path planning algorithm for multi-robot vehicles with unknown human motions

  2026cites this paper
• Design and Research of a Dual-Target Drug Molecular Generation Model Based on Reinforcement Learning

  2026cites this paper
• Case-Guided Sequential Assay Planning in Drug Discovery

  2026cites this paper
• Optimizing k-Removal AUC for Urban Infrastructure Networks

  2026cites this paper
• MARVEL: A Multi Agent-based Research Validator and Enabler using Large Language Models

  2026cites this paper
• Trans-Zero: Self-Play Incentivizes Large Language Models for Multilingual Translation Without Parallel Data

  2025cites this paper
• Adaptive Orchestration of Modular Generative Information Access Systems

  2025cites this paper
• Leveraging Grammarware for Active Video Game Development

  2025cites this paper
• PriM: Principle-Inspired Material Discovery through Multi-Agent Collaboration

  2025influential citation
• Monte Carlo Planning with Large Language Model for Text-Based Game Agents

  2025cites this paper
• QM-ToT: A Medical Tree of Thoughts Reasoning Framework for Quantized Model

  2025cites this paper
• Enhancing Fine-Grained Smart Contract Vulnerability Detection Through Domain Features and Transparent Interpretation

  2025cites this paper
• Trust-Region Twisted Policy Improvement

  2025cites this paper
• Adaptive Elicitation of Latent Information Using Natural Language

  2025cites this paper
• Efficient Incremental Verification of Neural Networks Guided by Counterexample Potentiality

  2025cites this paper
• Automated Refutation with Monte Carlo Search of Graph Theory Conjectures on the Maximum Laplacian Eigenvalue

  2025cites this paper
• MCTS-NC: A thorough GPU parallelization of Monte Carlo Tree Search implemented in Python via numba.cuda

  2025cites this paper
• Human-Level Competitive Pokémon via Scalable Offline Reinforcement Learning with Transformers

  2025cites this paper
• Cybersecurity Multi-Dimensional Few-Shot Data Generation on Malicious Enhancement

  2025cites this paper
• Efficient Tree Generation for Globally Optimal Decisions under Probabilistic Outcomes

  2025cites this paper
• Exploring Explainable Multi-agent MCTS-minimax Hybrids in Board Game Using Process Mining

  2025cites this paper
• Large Language Model Agent: A Survey on Methodology, Applications and Challenges

  2025cites this paper
• A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Models

  2025cites this paper
• Enhancing AI Strategy in Checkers through Minimax and Alpha-Beta Pruning Techniques

  2025cites this paper
• Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees

  2025cites this paper
• MCTS-RAG: Enhancing Retrieval-Augmented Generation with Monte Carlo Tree Search

  2025cites this paper
• Edge Intelligence Enhanced Monte Carlo Tree Search for Virtually Coupled Train Set Optimal Control

  2025cites this paper
• Preference Construction: A Bayesian Interactive Preference Elicitation Framework Based on Monte Carlo Tree Search

  2025cites this paper
• Action-Gradient Monte Carlo Tree Search for Non-Parametric Continuous (PO)MDPs

  2025cites this paper
• Curriculum RL meets Monte Carlo Planning: Optimization of a Real World Container Management Problem

  2025cites this paper
• AI Dermatology: Reviewing the Frontiers of Skin Cancer Detection Technologies

  2025cites this paper
• Reward-Centered ReST-MCTS: A Robust Decision-Making Framework for Robotic Manipulation in High Uncertainty Environments

  2025cites this paper
• Q-MARL: A quantum-inspired algorithm using neural message passing for large-scale multi-agent reinforcement learning

  2025cites this paper
• TreeSynth: Synthesizing Diverse Data from Scratch via Tree-Guided Subspace Partitioning

  2025cites this paper
• Core structure-guided multi-modal classification via Monte Carlo Tree Search

  2025cites this paper
• Integrating Human Feedback into a Reinforcement Learning-Based Framework for Adaptive User Interfaces

  2025cites this paper
• Belief Re-Use in Partially Observable Monte Carlo Tree Search

  2025cites this paper
• PepGo: a deep learning and tree search-based model for de novo peptide sequencing

  2025influential citation
• Variational Quantum Algorithms for Particle Track Reconstruction

  2025cites this paper
• OptionZero: Planning with Learned Options

  2025cites this paper
• Implicit Search via Discrete Diffusion: A Study on Chess

  2025cites this paper
• LLM Post-Training: A Deep Dive into Reasoning Large Language Models

  2025cites this paper
• Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving

  2025cites this paper
• The Adaptive Sampling of Marine Robots in Ocean Observation: An Overview

  2025cites this paper
• The value of real-time automated explanations in stochastic planning

  2025cites this paper
• Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learning

  2025cites this paper
• Broaden your SCOPE! Efficient Multi-turn Conversation Planning for LLMs using Semantic Space

  2025cites this paper
• Marco-o1 v2: Towards Widening The Distillation Bottleneck for Reasoning Models

  2025cites this paper