Free Lunch or no Free Lunch: that is not Just a Question?

The increasing popularity of metaheuristic algorithms has attracted a great deal of attention in algorithm analysis and performance evaluations. No-free-lunch theorems are of both theoretical and practical importance, while many important studies on convergence analysis of various metaheuristic algorithms have proven to be fruitful. This paper discusses the recent results on no-free-lunch theorems and algorithm convergence, as well as their important implications for algorithm development in practice. Free lunches may exist for certain types of problem. In addition, we will highlight some open problems for further research.

• Publication year

  2012

• Venue

  Int. J. Artif. Intell. Tools

• Publication date

  2012-08-02

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1142/S0218213012400106arXiv 1208.0527
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A New Stopping Criterion for Genetic Algorithms

  2016cited by this paper
• Theory of Randomized Search Heuristics: Foundations and Recent Developments

  2011cited by this paper
• Particle Swarm Optimisation

  2011cited by this paper
• New inspirations in swarm intelligence: a survey

  2011cited by this paper
• Firefly algorithm, stochastic test functions and design optimisation

  2010cited by this paper
• Engineering optimisation by cuckoo search

  2010cited by this paper
• Bioinspired computation in combinatorial optimization: algorithms and their computational complexity

  2010cited by this paper
• Continuous Lunches Are Free Plus the Design of Optimal Optimization Algorithms

  2010influential reference
• Bioinspired Computation in Combinatorial Optimization

  2010influential reference
• Engineering Optimization: An Introduction with Metaheuristic Applications

  2010cited by this paper
• Convergence Analysis of Metaheuristics

  2010influential reference
• Firefly Algorithms for Multimodal Optimization

  2009cited by this paper
• Beyond No Free Lunch: Realistic algorithms for arbitrary problem classes

  2009cited by this paper
• Integral Particle Swarm Optimization with Dispersed Accelerator Information

  2009cited by this paper
• Chemometric Space: Sensitivity and specificity

  2009cited by this paper
• Encyclopedia of optimization (2nd edition)

  2009cited by this paper
• Nature-Inspired Metaheuristic Algorithms

  2008influential reference
• On the convergence rate of the Markov homogeneous monotone optimization method

  2007cited by this paper
• A general framework for statistical performance comparison of evolutionary computation algorithms

  2006cited by this paper
• Encyclopedia of Optimization

  2006cited by this paper
• Markov Chain Monte Carlo

  2006cited by this paper
• Chapter 21 Metaheuristics

  2006cited by this paper
• Coevolutionary free lunches

  2005cited by this paper
• On the Convergence of the Cross-Entropy Method

  2005cited by this paper
• Complexity Theory and the No Free Lunch Theorem

  2005cited by this paper
• An Extended Ant Colony Algorithm and Its Convergence Analysis

  2005cited by this paper
• The Particle Swarm : Explosion , Stability , and Convergence in a Multi-Dimensional Complex Space

  2003influential reference
• The Theory and Practice of Simulated Annealing

  2003cited by this paper
• Metaheuristics in combinatorial optimization: Overview and conceptual comparison

  2003cited by this paper
• The particle swarm optimization algorithm: convergence analysis and parameter selection

  2003cited by this paper
• Use of Multiobjective Optimization Concepts to Handle Constraints in Single-Objective Optimization

  2003cited by this paper
• Some multiobjective optimizers are better than others

  2003cited by this paper
• ACO algorithms with guaranteed convergence to the optimal solution

  2002influential reference
• Theoretical framework for comparing several popular stochastic optimization approaches

  2002cited by this paper
• On Classes of Functions for which No Free Lunch Results Hold

  2001cited by this paper
• Conditions for the convergence of evolutionary algorithms

  2001cited by this paper
• The No Free Lunch and problem description length

  2001cited by this paper
• Convergence of a Simulated Annealing Algorithm for Continuous Global Optimization

  2000cited by this paper
• New stopping criterion for genetic algorithms

  2000cited by this paper
• Convergence Criteria for Genetic Algorithms

  2000cited by this paper
• Convergence Analysis of Simulated Annealing-Based Algorithms Solving Flow Shop Scheduling Problems

  2000cited by this paper
• DISCRETE MANUFACTURING PROCESS DESIGN OPTIMIZATION USING COMPUTER SIMULATION AND GENERALIZED HILL CLIMBING ALGORITHMS

  1998cited by this paper
• No free lunch theorems for optimization

  1997cited by this paper
• Tabu Search

  1997cited by this paper
• A Markov chain analysis of genetic algorithms with power of 2 cardinality alphabets

  1997cited by this paper
• Simulated Annealing: A Proof of Convergence

  1994cited by this paper
• Convergence analysis of canonical genetic algorithms

  1994cited by this paper
• Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence

  1992cited by this paper
• A Global Convergence Proof for a Class of Genetic Algorithms

  1990cited by this paper
• Convergence and finite-time behavior of simulated annealing

  1985cited by this paper
• Optimization by Simulated Annealing

  1983cited by this paper

• Non-Hybrid Machine Learning Techniques for Classifying and Detecting Skin Disease Variants

  2025cites this paper
• Improved snake optimizer based on forced switching mechanism and variable spiral search for practical applications problems

  2025cites this paper
• Data driven strategy on structural optimization using beetle-genetic hybrid algorithm

  2025cites this paper
• A General Theory for Compositional Generalization

  2024cites this paper
• Eagle Strategy in Nature-Inspired Optimization: Theory, Analysis, Applications, and Comparative Study

  2023cites this paper
• A Comprehensive Survey on Aquila Optimizer

  2023cites this paper
• Population Management Approaches in the OPn Algorithm

  2021cites this paper
• Cascade PID Controller Optimization Using Bison Algorithm

  2020cites this paper
• Benchmarking for Metaheuristic Black-Box Optimization: Perspectives and Open Challenges

  2020cites this paper
• Performance Analysis of Metaheuristic Optimizers on the Estimation of the Interfacial Heat Transfer Coefficient in Aluminum–Silicon Permanent Mold Casting

  2020cites this paper
• Similarity-based data mining for online domain adaptation of a sonar ATR system

  2020cites this paper
• An Effective Integrated Metaheuristic Algorithm For Solving Engineering Problems

  2020cites this paper
• An evolutionary algorithm recommendation method with a case study in flow shop scheduling

  2020cites this paper
• Controlled showering optimization algorithm: an intelligent tool for decision making in global optimization

  2019cites this paper
• Selective sensing of a heterogeneous population of units with dynamic health conditions

  2018cites this paper
• A Review of No Free Lunch Theorems, and Their Implications for Metaheuristic Optimisation

  2018cites this paper
• TUNING OF THE BISON ALGORITHM CONTROL PARAMETERS

  2018cites this paper
• Prise de décision dans des environnements complexes

  2017cites this paper
• Meta-zoo-heuristic algorithms

  2017influential citation
• Conservation of Information in Coevolutionary Searches

  2017cites this paper
• A Novel Hybrid Firefly Algorithm for Global Optimization

  2016cites this paper
• Multilevel Thresholding with Membrane Computing Inspired TLBO

  2016cites this paper
• Optimisation and Bayesian optimality

  2016cites this paper
• Firefly Algorithm in Telecommunications

  2015cites this paper
• Novel performance metrics for robust multi-objective optimization algorithms

  2015cites this paper
• Cuckoo Search and Firefly Algorithm

  2014cites this paper
• Large-Scale Global Optimization via Swarm Intelligence

  2014cites this paper
• Cuckoo Search and Firefly Algorithm Applied to Multilevel Image Thresholding

  2014cites this paper
• Improved Bat Algorithm Applied to Multilevel Image Thresholding

  2014cites this paper
• The Development of a Hybrid Optimization Algorithm for the Evaluation and Optimization of the Asynchronous Pulse Unit

  2014cites this paper
• On Pareto-Koopmans efficiency for performance-driven optimisation in Self-Organising Networks

  2013influential citation
• Multilevel image thresholding selection based on grey wolf optimizer

  year unknowncites this paper