RoboCup 2D Soccer Simulation League: Evaluation Challenges

We summarise the results of RoboCup 2D Soccer Simulation League in 2016 (Leipzig), including the main competition and the evaluation round. The evaluation round held in Leipzig confirmed the strength of RoboCup-2015 champion (WrightEagle, i.e. WE2015) in the League, with only eventual finalists of 2016 competition capable of defeating WE2015. An extended, post-Leipzig, round-robin tournament which included the top 8 teams of 2016, as well as WE2015, with over 1000 games played for each pair, placed WE2015 third behind the champion team (Gliders2016) and the runner-up (HELIOS2016). This establishes WE2015 as a stable benchmark for the 2D Simulation League. We then contrast two ranking methods and suggest two options for future evaluation challenges. The first one, “The Champions Simulation League”, is proposed to include 6 previous champions, directly competing against each other in a round-robin tournament, with the view to systematically trace the advancements in the League. The second proposal, “The Global Challenge”, is aimed to increase the realism of the environmental conditions during the simulated games, by simulating specific features of different participating countries.

• Publication year

  2017

• Venue

  Robot Soccer World Cup

• Publication date

  2017-06-14

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1007/978-3-030-00308-1_27arXiv 1706.04315
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Quantifying Long-Range Interactions and Coherent Structure in Multi-Agent Dynamics

  2017cited by this paper
• Disruptive Innovations in RoboCup 2D Soccer Simulation League: From Cyberoos'98 to Gliders2016

  2016cited by this paper
• FURY 2 D Simulation Team Description Paper 2016

  2016cited by this paper
• Shiraz Soccer 2 D Simulation Team Description Paper 2016

  2016cited by this paper
• Gliders 2016 : Integrating multi-agent approaches to tactical diversity

  2016cited by this paper
• An Information Criterion for Inferring Coupling of Distributed Dynamical Systems

  2016cited by this paper
• Hybrid Societies: Challenges and Perspectives in the Design of Collective Behavior in Self-organizing Systems

  2016cited by this paper
• Progress in RoboCup Revisited: The State of Soccer Simulation 2D

  2016cited by this paper
• Appendix to : Online Planning for Large Markov Decision Processes with Hierarchical Decomposition

  2015influential reference
• Evaluating Morphological Computation in Muscle and DC-Motor Driven Models of Hopping Movements

  2015cited by this paper
• Analyzing the Effects of Instance Features and Algorithm Parameters for Max–Min Ant System and the Traveling Salesperson Problem

  2015cited by this paper
• On the Progress of Soccer Simulation Leagues

  2014cited by this paper
• The RoboCup 2013 drop-in player challenges: Experiments in ad hoc teamwork

  2014cited by this paper
• Guided Self-Organization: Inception

  2014cited by this paper
• The RoboCup 2013 drop-in player challenges: a testbed for ad hoc teamwork

  2014cited by this paper
• Deep learning in neural networks: An overview

  2014cited by this paper
• Simulation leagues: Enabling replicable and robust investigation of complex robotic systems

  2014cited by this paper
• On the Role of Embodiment for Self-Organizing Robots: Behavior As Broken Symmetry

  2014cited by this paper
• Simulation leagues: Analysis of competition formats

  2014influential reference
• Towards Quantifying Interaction Networks in a Football Match

  2013cited by this paper
• Guiding Designs of Self-Organizing Swarms: Interactive and Automated Approaches

  2013cited by this paper
• RoboCup 2D Soccer Simulation League

  2013cited by this paper
• The Decision-Making Framework of WrightEagle, the RoboCup 2013 Soccer Simulation 2D League Champion Team

  2013cited by this paper
• HELIOS 2016 : Team Description Paper

  2012cited by this paper
• WrightEagle and UT Austin Villa: RoboCup 2011 Simulation League Champions

  2012influential reference
• Representation Learning: A Review and New Perspectives

  2012cited by this paper
• The local information dynamics of distributed computation in complex systems

  2012cited by this paper
• Information Theory of Decisions and Actions

  2011cited by this paper
• T UTORIAL Playful Machines Theoretical Foundation and Practical Realization of Self-Organizing Robots

  2010cited by this paper
• Guided self‐organization

  2009cited by this paper
• Predictive information and explorative behavior of autonomous robots

  2008cited by this paper
• How the body shapes the way we think - a new view on intelligence

  2006cited by this paper
• How Information and Embodiment Shape Intelligent Information Processing

  2006cited by this paper
• Keepaway Soccer: From Machine Learning Testbed to Benchmark

  2005cited by this paper
• The RoboCup Soccer Server and CMUnited Clients: Implemented Infrastructure for MAS Research

  2003cited by this paper
• Using Model-Based Diagnosis to Build Hypotheses about Spatial Environments: A Response to a Technical Challenge

  2003cited by this paper
• The road to RoboCup 2050

  2002cited by this paper
• Simulation League - League Summary

  2002cited by this paper
• Future Directions for Machine Learning

  2000cited by this paper
• The RoboCup Synthetic Agent Challenge 97

  1997influential reference

• Cross Language Soccer Framework: An Open Source Framework for the RoboCup 2D Soccer Simulation

  2024cites this paper
• Pyrus Base: An Open Source Python Framework for the RoboCup 2D Soccer Simulation

  2023cites this paper
• Team Sports for Game AI Benchmarking Revisited

  2021cites this paper
• Metodologia Extensionista para o Ensino de Futebol de Robôs

  2020cites this paper
• Fractals2019: Combinatorial Optimisation with Dynamic Constraint Annealing

  2019cites this paper
• Opponent Modeling in RoboCup Soccer Simulation

  2018cites this paper
• Gliders2d: Source Code Base for RoboCup 2D Soccer Simulation League

  2018cites this paper