SCIENCE@home

Feature-based learning improves adaptability without compromising precision

Shiva Farashahi,Katherine Rowe,Zohra Aslami,Daeyeol Lee,A. Soltani

Published 2017 in Nature Communications

ABSTRACT

Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environments. We hypothesize that this feature-based learning occurs not just because it can reduce dimensionality, but more importantly because it can increase adaptability without compromising precision of learning. We experimentally test this hypothesis and find that in dynamic environments, human subjects adopt feature-based learning even when this approach does not reduce dimensionality. Even in static, low-dimensional environments, subjects initially adopt feature-based learning and gradually switch to learning reward values of individual options, depending on how accurately objects’ values can be predicted by combining feature values. Our computational models reproduce these results and highlight the importance of neurons coding feature values for parallel learning of values for features and objects. Learning about a rewarded outcome is complicated by the fact that a choice often incorporates multiple features with differing association with the reward. Here the authors demonstrate that feature-based learning is an efficient and adaptive strategy in dynamically changing environments.

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-54 of 54 references · Page 1 of 1

CITED BY

Showing 1-70 of 70 citing papers · Page 1 of 1