SCIENCE@home

A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence

Emily J. Allen,Ghislain St-Yves,Yihan Wu,Jesse Breedlove,Jacob S. Prince,Logan T Dowdle,Matthias Nau,B. Caron,F. Pestilli,I. Charest,J. B. Hutchinson,Thomas Naselaris,Kendrick Norris Kay

Published 2021 in Nature Neuroscience

ABSTRACT

Extensive sampling of neural activity during rich cognitive phenomena is critical for robust understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in which high-resolution functional magnetic resonance imaging responses to tens of thousands of richly annotated natural scenes were measured while participants performed a continuous recognition task. To optimize data quality, we developed and applied novel estimation and denoising techniques. Simple visual inspections of the NSD data reveal clear representational transformations along the ventral visual pathway. Further exemplifying the inferential power of the dataset, we used NSD to build and train deep neural network models that predict brain activity more accurately than state-of-the-art models from computer vision. NSD also includes substantial resting-state and diffusion data, enabling network neuroscience perspectives to constrain and enhance models of perception and memory. Given its unprecedented scale, quality and breadth, NSD opens new avenues of inquiry in cognitive neuroscience and artificial intelligence. The authors measured high-resolution fMRI activity from eight individuals who saw and memorized thousands of annotated natural images over 1 year. This massive dataset enables new paths of inquiry in cognitive neuroscience and artificial intelligence.

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-90 of 90 references · Page 1 of 1

CITED BY

Showing 1-100 of 615 citing papers · Page 1 of 7

12347
Next