The effort devoted to hand-crafting neural network image classifiers has motivated the use of architecture search to discover them automatically. Although evolutionary algorithms have been repeatedly applied to neural network topologies, the image classifiers thus discovered have remained inferior to human-crafted ones. Here, we evolve an image classifier— AmoebaNet-A—that surpasses hand-designs for the first time. To do this, we modify the tournament selection evolutionary algorithm by introducing an age property to favor the younger genotypes. Matching size, AmoebaNet-A has comparable accuracy to current state-of-the-art ImageNet models discovered with more complex architecture-search methods. Scaled to larger size, AmoebaNet-A sets a new state-of-theart 83.9% top-1 / 96.6% top-5 ImageNet accuracy. In a controlled comparison against a well known reinforcement learning algorithm, we give evidence that evolution can obtain results faster with the same hardware, especially at the earlier stages of the search. This is relevant when fewer compute resources are available. Evolution is, thus, a simple method to effectively discover high-quality architectures.
Regularized Evolution for Image Classifier Architecture Search
Esteban Real,A. Aggarwal,Yanping Huang,Quoc V. Le
Published 2018 in AAAI Conference on Artificial Intelligence
ABSTRACT
PUBLICATION RECORD
- Publication year
2018
- Venue
AAAI Conference on Artificial Intelligence
- Publication date
2018-02-05
- Fields of study
Computer Science
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
LINKED PAPERS
- EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
- neural architecture search related to · Neural architecture search and architecture search both describe automated search procedures for discovering or designing neural network architectures.
CLAIMS
CONCEPTS
- age property
A genotype attribute that records how long an architecture has existed in the population.
Aliases: age
- amoebanet-a
An evolved image-classifier architecture discovered by the reported evolutionary search procedure.
Aliases: AmoebaNet A
- architecture search
The process of automatically discovering neural network architectures rather than hand-designing them.
Aliases: neural architecture search, NAS
- imagenet
The large-scale image-classification benchmark used to evaluate the discovered architectures.
- regularized evolution
A modified evolutionary architecture-search procedure that combines tournament selection with an age-based preference for younger genotypes.
Aliases: evolution, regularized evolutionary algorithm
- reinforcement learning algorithm
A neural architecture search approach based on reinforcement learning used here as the comparison baseline.
Aliases: RL algorithm, RL baseline
- same hardware
The matched compute setting used to compare search speed between evolution and the reinforcement-learning baseline.
Aliases: matched hardware
- tournament selection
A selection scheme that chooses candidate genotypes by comparing members of a sampled tournament.
REFERENCES
Showing 1-88 of 88 references · Page 1 of 1