The Richness of Vision in the Mammalian Brain: Neural Codes for Visual Perception and Behavior in Three Dimensions

Successful navigation and interactions with objects in a complex, three-dimensional (3D) world are essential to survival, yet studies of the neural basis of visual perception and action often treat the world as a flat, two-dimensional (2D) canvas. Here, we review recent discoveries about how the visual systems of different mammals have adapted under the constraint of a 3D world. Many neurons in primate visual cortex are sensitive to 3D depth cues constructed from input differences to the two eyes (binocular disparities). Similar neuronal selectivity has recently been characterized in tree shrews and mice, though constrained anatomically and functionally. Disparity-sensitive receptive field structures can now be assessed noninvasively across human visual cortex and functionally linked to depth perception. At later stages in the nonhuman primate (NHP) ventral (“what”) pathway, supporting object recognition, complex 3D objects are represented as spatial configurations of geometric parts. In studies of the dorsal (“where”/“how”) pathway of NHPs, underlying visuospatial processing, the inclusion of 3D structure in visual tasks has established tighter links between neuronal mechanisms and perception. This has also revealed neuronal representations of 3D object position and orientation that are tolerant to 3D gaze location, providing a basis for robust perception and action. The cross-species analysis presented here provides new perspectives on neural coding mechanisms underpinning the richness of 3D visual experience. Elucidation of these mechanisms will be essential for understanding the neural basis of cognition and behavior, which in turn will enable the development of therapies and neuroprosthetics for those suffering from visual impairments.

• Publication year

  2025

• Venue

  Journal of Neuroscience

• Publication date

  2025-11-12

• Fields of study

  Biology, Medicine

• Identifiers
  DOI 10.1523/JNEUROSCI.1316-25.2025PMID 41224660PMCID PMC12614053
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Single-Trial fMRI Decoding of 3D Motion with Stereoscopic and Perspective Cues

  2025cited by this paper
• Characterizing Human Disparity Tuning Properties Using Population Receptive Field Mapping

  2025cited by this paper
• Functional localization of visual motion area FST in humans

  2025cited by this paper
• Degraded mapping of disparity tuning in visual cortex explains deficits in binocular depth perception

  2025cited by this paper
• Functional localization of visual motion area FST in humans

  2024cited by this paper
• Correlated and Anticorrelated Binocular Disparity Modulate GABA+ and Glutamate/Glutamine Concentrations in the Human Visual Cortex

  2024cited by this paper
• Coding of egocentric distance in the macaque ventral intraparietal area

  2024cited by this paper
• Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates.

  2023cited by this paper
• Hierarchical computation of 3D motion across macaque areas MT and FST

  2023cited by this paper
• Editorial of non-human primate research

  2023cited by this paper
• MRI Stereoscope: A Miniature Stereoscope for Human Neuroimaging

  2022cited by this paper
• The Development of Receptive Field Tuning Properties in Mouse Binocular Primary Visual Cortex

  2022cited by this paper
• Applications of chemogenetics in non-human primates.

  2022cited by this paper
• Parallel processing, hierarchical transformations, and sensorimotor associations along the ‘where’ pathway

  2022influential reference
• Monocular deprivation during the critical period alters neuronal tuning and the composition of visual circuitry

  2022cited by this paper
• Strong tuning for stereoscopic depth indicates orientation-specific recurrent circuitry in tree shrew V1.

  2022influential reference
• Cell-type-specific binocular vision guides predation in mice.

  2021cited by this paper
• Perspective Cues Make Eye-specific Contributions to 3-D Motion Perception

  2021cited by this paper
• Specialized contributions of mid-tier stages of dorsal and ventral pathways to stereoscopic processing in macaque

  2021cited by this paper
• Natural binocular depth discrimination behavior In mice explained by visual cortical activity.

  2021influential reference
• Human primary visual cortex shows larger population receptive fields for binocular disparity-defined stimuli

  2021cited by this paper
• Lytic transglycosylases mitigate periplasmic crowding by degrading soluble cell wall turnover products

  2021cited by this paper
• Mapping the visual world to the human brain

  2021influential reference
• Distance estimation from monocular cues in an ethological visuomotor task

  2021cited by this paper
• Population receptive fields in nonhuman primates from whole-brain fMRI and large-scale neurophysiology in visual cortex

  2021cited by this paper
• Mouse visual cortex contains a region of enhanced spatial resolution

  2020cited by this paper
• Early Emergence of Solid Shape Coding in Natural and Deep Network Vision.

  2020cited by this paper
• Disparity Sensitivity and Binocular Integration in Mouse Visual Cortex Areas

  2020cited by this paper
• Two Distinct Types of Eye-Head Coupling in Freely Moving Mice

  2020cited by this paper
• An Open Resource for Non-human Primate Optogenetics.

  2020cited by this paper
• Functional links between sensory representations, choice activity, and sensorimotor associations in parietal cortex

  2020cited by this paper
• The inner junction complex of the cilia is an interaction hub that involves tubulin post-translational modifications

  2019cited by this paper
• Optimized but Not Maximized Cue Integration for 3D Visual Perception

  2019cited by this paper
• Neuromodulatory control of localized dendritic spiking in critical period cortex

  2019cited by this paper
• Interneuronal correlations at longer time scales predict decision signals for bistable structure-from-motion perception

  2019cited by this paper
• Area-specific mapping of binocular disparity across mouse visual cortex

  2019cited by this paper
• Mice Discriminate Stereoscopic Surfaces Without Fixating in Depth

  2019influential reference
• Global prevalence of amblyopia and disease burden projections through 2040: a systematic review and meta-analysis

  2019influential reference
• The Human Connectome Project 7 Tesla retinotopy dataset: Description and population receptive field analysis

  2018cited by this paper
• The need for calcium imaging in nonhuman primates: New motor neuroscience and brain-machine interfaces.

  2017cited by this paper
• Impairing the useful field of view in natural scenes: Tunnel vision versus general interference.

  2016cited by this paper
• The impact of top-down spatial attention on laterality and hemispheric asymmetry in the human parietal cortex

  2016cited by this paper
• Neuregulin-Dependent Regulation of Fast-Spiking Interneuron Excitability Controls the Timing of the Critical Period

  2016cited by this paper
• Corollary Discharge and Oculomotor Proprioception: Cortical Mechanisms for Spatially Accurate Vision.

  2016cited by this paper
• The natural statistics of blur

  2016cited by this paper
• Estimating 3D tilt from local image cues in natural scenes

  2016cited by this paper
• Opportunities and challenges in modeling human brain disorders in transgenic primates

  2016cited by this paper
• Tupai A Field Study Of Bornean Treeshrews

  2016cited by this paper
• Binocular depth processing in the ventral visual pathway

  2016cited by this paper
• Defining the V5/MT neuronal pool for perceptual decisions in a visual stereo-motion task

  2016cited by this paper
• Chemogenetic disconnection of monkey orbitofrontal and rhinal cortex reversibly disrupts reward value

  2015cited by this paper
• Stereopsis is adaptive for the natural environment

  2015cited by this paper
• Transformation from a retinal to a cyclopean representation in human visual cortex.

  2015influential reference
• N-doped carbon nanomaterials are durable catalysts for oxygen reduction reaction in acidic fuel cells

  2015cited by this paper
• Disruption of relative reward value by reversible disconnection of orbitofrontal and rhinal cortex using DREADDs in rhesus monkeys

  2015cited by this paper
• Computational neuroimaging and population receptive fields.

  2015cited by this paper
• Stereopsis and amblyopia: A mini-review.

  2015cited by this paper
• Reliability-dependent contributions of visual orientation cues in parietal cortex

  2014cited by this paper
• Mouse vision as a gateway for understanding how experience shapes neural circuits

  2014cited by this paper
• Gravity Influences the Visual Representation of Object Tilt in Parietal Cortex

  2014cited by this paper
• Models and processes of multisensory cue combination.

  2014cited by this paper
• A disinhibitory microcircuit initiates critical period plasticity in visual cortex

  2013cited by this paper
• The Visual Representation of 3D Object Orientation in Parietal Cortex

  2013cited by this paper
• Binocular integration and disparity selectivity in mouse primary visual cortex.

  2013cited by this paper
• The ventral visual pathway: an expanded neural framework for the processing of object quality.

  2013cited by this paper
• A Causal Role for V5/MT Neurons Coding Motion-Disparity Conjunctions in Resolving Perceptual Ambiguity

  2013influential reference
• Medial axis shape coding in macaque inferotemporal cortex.

  2012cited by this paper
• Possible Principles Underlying the Transformations of Sensory Messages

  2012cited by this paper
• Neurons in Dorsal Visual Area V5/MT Signal Relative Disparity

  2011cited by this paper
• Coding of Stereoscopic Depth Information in Visual Areas V3 and V3A

  2011cited by this paper
• What can mice tell us about how vision works?

  2011cited by this paper
• A simple empirical law for a class of visually timed interceptive actions

  2010cited by this paper
• Rotterdam AMblyopia screening effectiveness study: detection and causes of amblyopia in a large birth cohort.

  2010influential reference
• Critical period plasticity matches binocular orientation preference in the visual cortex.

  2010cited by this paper
• Parietal reach region encodes reach depth using retinal disparity and vergence angle signals.

  2009cited by this paper
• A neural code for three-dimensional object shape in macaque inferotemporal cortex

  2008cited by this paper
• Eye, retina, and visual system of the mouse

  2008cited by this paper
• Neuronal selectivity and local map structure in visual cortex.

  2008cited by this paper
• Population receptive field estimates in human visual cortex

  2008cited by this paper
• Responses to direction and transparent motion stimuli in area FST of the macaque

  2008influential reference
• The neural basis of decision making.

  2007cited by this paper
• Disparity Channels in Early Vision

  2007influential reference
• Representation of stereoscopic depth based on relative disparity in macaque area V4.

  2007cited by this paper
• Binocular depth perception and the cerebral cortex

  2007cited by this paper
• Risk of bilateral visual impairment in individuals with amblyopia: the Rotterdam study

  2007cited by this paper
• A statistical model of binocular disparity

  2007cited by this paper
• Linking Neural Representation to Function in Stereoscopic Depth Perception: Roles of the Middle Temporal Area in Coarse versus Fine Disparity Discrimination

  2006cited by this paper
• BINOCULAR VISION IN THEROPOD DINOSAURS

  2006cited by this paper
• Experience-Driven Plasticity of Visual Cortex Limited by Myelin and Nogo Receptor

  2005cited by this paper
• Role of primate visual area V4 in the processing of 3-D shape characteristics defined by disparity.

  2005cited by this paper
• Contribution of area MT to stereoscopic depth perception: choice-related response modulations reflect task strategy.

  2004influential reference
• Integration of retinal disparity and fixation-distance related signals toward an egocentric coding of distance in the posterior parietal cortex of primates.

  2004influential reference
• ‘Real-motion’ cells in area V3A of macaque visual cortex

  2004cited by this paper
• Receptive Field Size in V1 Neurons Limits Acuity for Perceiving Disparity Modulation

  2004cited by this paper
• Analysis of retinal correspondence by studying receptive fields of rinocular single units in cat striate cortex

  2004cited by this paper
• Comparing perceptual signals of single V5/MT neurons in two binocular depth tasks.

  2004cited by this paper
• Do humans optimally integrate stereo and texture information for judgments of surface slant?

  2003cited by this paper
• At least at the level of inferior temporal cortex, the stereo correspondence problem is solved.

  2003cited by this paper
• Neuronal mechanisms for the perception of ambiguous stimuli.

  2003cited by this paper
• A specialization for relative disparity in V2

  2002cited by this paper

• No citing papers are available for this paper.