Information-theoretic approaches to model selection, such as Akaike's Information Criterion (AIC) and cross validation, provide a rigorous framework to select amongst candidate hypotheses in ecology, yet the persistent concern of overfitting undermines the interpretation of inferred processes. A common misconception is that overfitting is due to the choice of criterion or model score, despite research demonstrating that selection uncertainty associated with score estimation is the predominant influence. Here we introduce a novel selection rule which identifies a parsimonious model by directly accounting for estimation uncertainty, while still retaining an information-theoretic interpretation. The new rule, which is a modification of the existing one-standard-error rule, mitigates overfitting and reduces the likelihood that spurious effects will be included in the selected model, thereby improving its inferential prop erties. We present the rule and illustrative examples in the context of maximum-likelihood estimation and Kullback-Leibler discrepancy, although the rule is applicable in a more general setting, including Bayesian model selection and other types of discrepancy.
Parsimonious model selection using information theory: a modified selection rule.
Luke A. Yates,Shane A. Richards,B. Brook
Published 2021 in Ecology
ABSTRACT
PUBLICATION RECORD
- Publication year
2021
- Venue
Ecology
- Publication date
2021-07-17
- Fields of study
Medicine, Environmental Science
- Identifiers
- External record
- Source metadata
Semantic Scholar, PubMed
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-2 of 2 references · Page 1 of 1
CITED BY
Showing 1-27 of 27 citing papers · Page 1 of 1