A physiological model for motion-stereo integration and a unified explanation of Pulfrich-like phenomena.

Many psychophysical and physiological experiments indicate that visual motion analysis and stereoscopic depth perception are processed together in the brain. However, little computational effort has been devoted to combining these two visual modalities into a common framework based on physiological mechanisms. We present such an integrated model in this paper. We have previously developed a physiologically realistic model for binocular disparity computation (Qian, 1994). Here we demonstrate that under some general and physiological assumptions, our stereo vision model can be combined naturally with motion energy models to achieve motion-stereo integration. The integrated model may be used to explain a wide range of experimental observations regarding motion-stereo interaction. As an example, we show that the model can provide a unified account of the classical Pulfrich effect (Morgan & Thompson, 1975) and the generalized Pulfrich phenomena to dynamic noise patterns (Tyler, 1974; Falk, 1980) and stroboscopic stimuli (Burr & Ross, 1979).

• Publication year

  1997

• Venue

  Vision Research

• Publication date

  1997-06-01

• Fields of study

  Medicine, Computer Science, Psychology

• Identifiers
  DOI 10.1016/S0042-6989(96)00164-2PMID 9231233
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Cepstral Filtering on a Columnar Image Architecture: A Fast Algorithm for Binocular Stereo Segmentation

  2011cited by this paper
• Detection of binocular disparities

  2004cited by this paper
• Magnification factor and receptive field size in foveal striate cortex of the monkey

  2004cited by this paper
• Physiological computation of binocular disparity.

  1997cited by this paper
• Binocular Receptive Field Models, Disparity Tuning, and Characteristic Disparity

  1996influential reference
• Integration of motion and stereopsis in middle temporal cortical area of macaques

  1995cited by this paper
• Neuronal Mechanisms Underlying Stereopsis: How Do Simple Cells in the Visual Cortex Encode Binocular Disparity?

  1995cited by this paper
• Transparent motion perception as detection of unbalanced motion signals. II. Physiology

  1994influential reference
• Transparent motion perception as detection of unbalanced motion signals. III. Modeling

  1994influential reference
• Transparent motion perception as detection of unbalanced motion signals. I. Psychophysics

  1994cited by this paper
• Computing Stereo Disparity and Motion with Known Binocular Cell Properties

  1994influential reference
• Disparity-sensitive cells in the owl have a characteristic disparity

  1993cited by this paper
• Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development.

  1993influential reference
• Directionally selective complex cells and the computation of motion energy in cat visual cortex.

  1992cited by this paper
• Depth is encoded in the visual cortex by a specialized receptive field structure

  1991influential reference
• The response of area MT and V1 neurons to transparent motion

  1991cited by this paper
• A model for the estimate of local image velocity by cells in the visual cortex

  1990influential reference
• On the neurophysiological organization of binocular vision.

  1990influential reference
• Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors.

  1990influential reference
• Learning to Solve Random-Dot Stereograms of Dense and Transparent Surfaces with Recurrent Backpropagation

  1989cited by this paper
• Neural integration of information specifying structure from stereopsis and motion.

  1989cited by this paper
• Proceedings of the 1988 Connectionist Models Summer School

  1989cited by this paper
• A physiological correlate of the Pulfrich effect in cortical neurons of the cat.

  1989cited by this paper
• Visual cortical receptive fields in monkey and cat: spatial and temporal phase transfer function.

  1989cited by this paper
• The two-dimensional spatial structure of simple receptive fields in cat striate cortex.

  1987cited by this paper
• Linear mechanisms of directional selectivity in simple cells of cat striate cortex.

  1987cited by this paper
• Model for the extraction of image flow.

  1987influential reference
• Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters.

  1985cited by this paper
• PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit

  1985cited by this paper
• Spatiotemporal energy models for the perception of motion.

  1985influential reference
• Elaborated Reichardt detectors.

  1985influential reference
• Model of human visual-motion sensing.

  1985cited by this paper
• A time-based stereoscopic depth mechanism in the visual cortex.

  1985cited by this paper
• Binocular simple cells for local stereopsis: comparison of receptive field organizations for the two eyes.

  1984cited by this paper
• The analysis of stereopsis.

  1984influential reference
• Direction and orientation selectivity of neurons in visual area MT of the macaque.

  1984cited by this paper
• Computations Underlying the Measurement of Visual Motion

  1984cited by this paper
• Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity.

  1983cited by this paper
• A look at motion in the frequency domain

  1983cited by this paper
• Vision: A Computational Investigation into the Human Representation and Processing of Visual Information

  1983cited by this paper
• Phenomenal coherence of moving visual patterns

  1982cited by this paper
• The physiological basis of variations in visual latency.

  1981cited by this paper
• Dynamic visual noise and the stereophenomenon: Interocular time delays, depth, and coherent velocities

  1981cited by this paper
• Erratum to: “Dynamic visual noise and the stereophenomenon: Interocular time delays, depth, and coherent velocities”

  1980cited by this paper
• Mathematical description of the responses of simple cortical cells.

  1980cited by this paper
• Acuity for apparent vernier offset.

  1979cited by this paper
• A computational theory of human stereo vision.

  1979cited by this paper
• How does binocular delay give information about depth?

  1979influential reference
• A computational theory of human stereo vision

  1979influential reference
• Neural Mechanisms Underlying Stereoscopic Depth Perception in Cat Visual Cortex

  1978cited by this paper
• Retinal mechanisms of visual latency.

  1978cited by this paper
• Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey.

  1977cited by this paper
• Cooperative computation of stereo disparity.

  1976cited by this paper
• The pulfrich effect and short-term memory in stereopsis

  1975cited by this paper
• Letter: The Pulfrich effect and short-term memory in stereopsis.

  1975cited by this paper
• Stereoillusion based on visual persistence

  1975cited by this paper
• Apparent Motion and the Pulfrich Effect

  1975cited by this paper
• Stereopsis in dynamic visual noise

  1974cited by this paper
• Stereopsis by binocular delay

  1974cited by this paper
• Movement Aftereffects Contingent on Binocular Disparity

  1974cited by this paper
• Disparity Detectors in Human Depth Perception: Evidence for Directional Selectivity

  1973cited by this paper
• Binocular interaction fields of single units in the cat striate cortex

  1971cited by this paper
• Short Term Visual Memory and the Pulfrich Phenomenon

  1969cited by this paper
• Receptive fields and functional architecture of monkey striate cortex

  1968cited by this paper
• Autocorrelation, a principle for the evaluation of sensory information by the central nervous system

  1961cited by this paper
• Autocorrelation, a principle for evaluation of sensory information by the central nervous system

  1961cited by this paper
• Processing of Foods with Ionizing Radiations

  1958cited by this paper

• A circuit model for transsaccadic space updating and mislocalization

  2025cites this paper
• Optimal Estimation of Local Motion-in-Depth with Naturalistic Stimuli

  2024cites this paper
• A circuit model for transsaccadic space updating and mislocalization

  2024cites this paper
• Optimal motion-in-depth estimation with natural stimuli

  2024cites this paper
• Interaction between spatial perception and temporal perception enables preservation of cause-effect relationship: Visual psychophysics and neuronal dynamics.

  2023cites this paper
• What's special about horizontal disparity

  2023cites this paper
• Short-term monocular deprivation induces an interocular delay.

  2021cites this paper
• Full-Reference Stereoscopic Video Quality Assessment Using a Motion Sensitive HVS Model

  2020cites this paper
• Monovision and the Misperception of Motion

  2019cites this paper
• On the Aperture Problem of Binocular 3D Motion Perception

  2019cites this paper
• An Unexpected Spontaneous Motion-In-Depth Pulfrich Phenomenon in Amblyopia

  2019cites this paper
• Perception inspired stereoscopic image and video quality assessment.

  2018cites this paper
• A Single, Continuously Applied Control Policy for Modeling Reaching Movements with and without Perturbation

  2018cites this paper
• Frequency-Domain Joint Motion and Disparity Estimation Using Steerable Filters

  2018cites this paper
• Interocular contrast difference drives illusory 3D percept

  2017cites this paper
• Towards synergistic models of motion information processing in biological and artificial vision. (Vers des modèles synergiques de l'estimation du mouvement en vision biologique et artificielle)

  2016cites this paper
• Bio-inspired computer vision: Towards a synergistic approach of artificial and biological vision

  2016cites this paper
• A Sinc Wavelet Describes the Receptive Fields of Neurons in the Motion Cortex

  2015cites this paper
• Visual Motion Processing in Primates Evidence for a Parallel-Hierarchical Structure of Eye Movements in Response to Dichoptic Motion:

  2015cites this paper
• Bio-Inspired Computer Vision: Setting the Basis for a New Departure

  2015cites this paper
• Stereo Vision, Models of

  2014cites this paper
• From local constraints to global binocular motion perception

  2014cites this paper
• Testing probabilistic models of binocular 3D motion perception

  2014cites this paper
• Neural population models for perception of motion in depth.

  2014cites this paper
• The Limits of Human Stereopsis in Space and Time

  2014cites this paper
• Visual aspects of advanced sensors and helmet-mounted displays

  2014cites this paper
• The Gabor-Einstein Wavelet: A Model for the Receptive Fields of V1 to MT Neurons

  2014cites this paper
• Modeling Binocular and Motion Transparency Processing by Local Center-Surround Interactions

  2013cites this paper
• Joint tuning for direction of motion and binocular disparity in macaque MT is largely separable.

  2013cites this paper
• Local Constraints for the Perception of Binocular 3D Motion

  2013cites this paper
• Neuronal Tuning and Its Role in Attention

  2012cites this paper
• Joint encoding of binocular disparity and direction of motion

  2012cites this paper
• Conjunctions between Motion and Disparity Are Encoded with the Same Spatial Resolution As Disparity Alone

  2012cites this paper
• The spatial resolutions of stereo and motion perception and their neural basis

  2012influential citation
• Decoding of depth and motion in ambiguous binocular perception.

  2011cites this paper
• Perception-motivated interpolation of image sequences

  2011cites this paper
• Independent mechanisms for bright and dark image features in a stereo correspondence task.

  2011cites this paper
• Advancement of motion psychophysics: review 2001-2010.

  2011cites this paper
• The Pulfrich effect in the clinic

  2011cites this paper
• Advancement of motion psychophysics : Review 2001

  2011cites this paper
• Vision in 3D Environments: Physiologically based models of binocular depth perception

  2011influential citation
• Dimensional analysis of visual signals.

  2010cites this paper
• Is depth perception of stereo plaids predicted by intersection of constraints, vector average or second-order feature?

  2010cites this paper
• Towards Plenoptic Raumzeit Reconstruction

  2010cites this paper
• On the Inverse Problem of Binocular 3D Motion Perception

  2010cites this paper
• The changing disparity energy model.

  2010cites this paper
• A neural network model for object recognition in cluttered scenes using motion and binocular disparity

  2010cites this paper
• 3-D Cinematography with Approximate or No Geometry

  2010cites this paper
• Space-time interpolation techniques

  2009cites this paper
• Integration of monocular motion signals and the analysis of interocular velocity differences for the perception of motion-in-depth.

  2009cites this paper
• Asymmetric interaction between motion and stereopsis revealed by concurrent adaptation.

  2009cites this paper
• Pulfrich phenomena are coded effectively by a joint motion-disparity process.

  2009cites this paper
• Spatial Distortions Produced by Purely Dichoptic-Based Visual Motion

  2009cites this paper
• Integrating motion and depth via parallel pathways

  2008cites this paper
• Transition from monocular motion perception to dichoptic motion perception as a function of the stimulus duration

  2008cites this paper
• Perception-based Image Interpolation

  2008cites this paper
• Eye movements in response to dichoptic motion: evidence for a parallel-hierarchical structure of visual motion processing in primates.

  2008cites this paper
• Perception-motivated interpolation of image sequences

  2008cites this paper
• Cortical correlates of stereoscopic depth produced by temporal delay.

  2008cites this paper
• A Two Stage Energy Model Exhibiting Selectivity to Changing Disparity

  2008cites this paper
• DRAFT : PLEAS DO NOT CIRCULATE Integrating Motion and Depth via Parallel Pathways

  2007cites this paper
• A method for generating a "purely first-order" dichoptic motion stimulus.

  2007cites this paper
• Dichoptic motion perception limited to depth of fixation?

  2007cites this paper
• Motion Compensation in Models of Cortical Cell Processing

  2007cites this paper
• Oscillatory depth as a function of temporal frequency.

  2007cites this paper
• Segmentation of the optic nerve head combining pixel classification and graph search

  2007cites this paper
• Simultaneous determination of depth and motion in early vision

  2007cites this paper
• Temporal integration of monocular images separated in time: Stereopsis, stereoacuity, and binocular luster

  2007cites this paper
• Disparity and Shading Cues Cooperate for Surface Interpolation

  2006cites this paper
• Bayesian models of binocular 3-D motion perception.

  2006cites this paper
• Evidence for elongated receptive field structure for mechanisms subserving stereopsis.

  2006cites this paper
• Dependence of Illusory Motion on Directional Consistency in Oblique Components

  2006cites this paper
• Orientation-Specific Computation in Stereoscopic Vision

  2006cites this paper
• The stroboscopic Pulfrich effect is not evidence for the joint encoding of motion and depth.

  2005influential citation
• All Pulfrich-like illusions can be explained without joint encoding of motion and disparity.

  2005influential citation
• Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence

  2005cites this paper
• Effect of interocular delay on disparity-selective v1 neurons: relationship to stereoacuity and the pulfrich effect.

  2005influential citation
• Early computational processing in binocular vision and depth perception.

  2005cites this paper
• A computational analysis of separating motion signals in transparent random dot kinematograms.

  2005cites this paper
• Perception of depth and motion from ambiguous binocular information.

  2005cites this paper
• Binocular correlation does not improve coherence detection for fronto-parallel motion.

  2004cites this paper
• The Integration of Multiple Stimulus Features by V1 Neurons

  2004cites this paper
• The Aperture Problems in the Pulfrich Effect

  2003cites this paper
• Spatial and temporal tuning of motion in depth.

  2003influential citation
• Reading a population code: a multi-scale neural model for representing binocular disparity.

  2003cites this paper
• Receptive fields of disparity-tuned simple cells in macaque V1.

  2003cites this paper
• A physiological theory of depth perception from vertical disparity.

  2003influential citation
• Two-dimensional substructure of stereo and motion interactions in macaque visual cortex.

  2003influential citation
• Representation of depth in neural population responses

  2002cites this paper
• Computing relief structure from motion with a distributed velocity and disparity representation.

  2002cites this paper
• A Bayesian Approach to the Stereo Correspondence Problem

  2002cites this paper
• Temporal dynamics of binocular disparity processing with corticogeniculate interactions

  2002cites this paper
• Isotropic integration of binocular disparity and relative motion in the perception of three-dimensional shape.

  2002cites this paper
• Modeling V1 disparity tuning to time-varying stimuli.

  2001cites this paper
• Joint-encoding of motion and depth by visual cortical neurons: neural basis of the Pulfrich effect

  2001cites this paper
• Relationship Between Phase and Energy Methods for Disparity Computation

  2000cites this paper
• Motion-stereo mechanisms sensitive to inter-ocular phase.

  2000cites this paper
• A physiologically-based explanation of disparity attraction and repulsion.

  2000cites this paper
• Global motion processing is not tuned for binocular disparity.

  1999cites this paper
• Comparison of motion and stereopsis: linear and nonlinear performance.

  1999cites this paper