Visual Feedback Control of Hand Movements

We investigated what visual information contributes to on-line control of hand movements. It has been suggested that motion information predominates early in movements but that position information predominates for endpoint control. We used a perturbation method to determine the relative contributions of motion and position information to feedback control. Subjects reached to touch targets in a dynamic virtual environment in which subjects viewed a moving virtual fingertip in place of their own finger. On some trials, we perturbed the virtual fingertip while it moved behind an occluder. Subjects responded to perturbations that selectively altered either motion or position information, indicating that both contribute to feedback control. Responses to perturbations that changed both motion and position information were consistent with superimposed motion-based and position-based control. Results were well fit by a control model that optimally integrates noisy, delayed sensory feedback about both motion and position to estimate hand state.

• Publication year

  2004

• Venue

  Journal of Neuroscience

• Publication date

  2004-03-31

• Fields of study

  Medicine, Computer Science, Psychology

• Identifiers
  DOI 10.1523/JNEUROSCI.4319-03.2004PMID 15056701PMCID PMC6730029
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Multisensory Integration during Motor Planning

  2003cited by this paper
• Humans use continuous visual feedback from the hand to control fast reaching movements

  2003cited by this paper
• Humans integrate visual and haptic information in a statistically optimal fashion

  2002cited by this paper
• Role of uncertainty in sensorimotor control.

  2002cited by this paper
• Optimal feedback control as a theory of motor coordination

  2002cited by this paper
• The discrimination of abrupt changes in speed and direction of visual motion.

  2000influential reference
• Computational nature of human adaptive control during learning of reaching movements in force fields

  1999cited by this paper
• The role of visual feedback of hand position in the control of manual prehension

  1999cited by this paper
• Disentangling the role of spatial scale, separation and eccentricity in Weber's law for position.

  1997cited by this paper
• Fast Responses of the Human Hand to Changes in Target Position.

  1997cited by this paper
• Computation and psychophysics of sensorimotor integration

  1996cited by this paper
• Fast and slow feedback loops for the visual correction of spatial errors in a pointing task: a reappraisal.

  1996cited by this paper
• An internal model for sensorimotor integration.

  1995cited by this paper
• Are arm trajectories planned in kinematic or dynamic coordinates? An adaptation study

  1995cited by this paper
• Adaptive representation of dynamics during learning of a motor task

  1994cited by this paper
• Is the cerebellum a smith predictor?

  1993cited by this paper
• Models of Trajectory Formation and Temporal Interaction of Reach and Grasp.

  1993influential reference
• Directional control of rapid arm movements: the role of the kinetic visual feedback system.

  1993cited by this paper
• Automatic control during hand reaching at undetected two-dimensional target displacements.

  1992cited by this paper
• Visual processing of optic acceleration.

  1992cited by this paper
• Two mechanisms for localization? Evidence for separation-dependent and separation-independent processing of position information.

  1990cited by this paper
• Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation.

  1988cited by this paper
• "Weber's law" for position: unconfounding the role of separation and eccentricity.

  1988cited by this paper
• Human velocity and direction discrimination measured with random dot patterns.

  1988cited by this paper
• Differential spatial displacement discrimination thresholds for Gabor patches.

  1988cited by this paper
• Position and spatial frequency in large-scale localization judgments.

  1987cited by this paper
• Large adjustments in visually guided reaching do not depend on vision of the hand or perception of target displacement

  1986cited by this paper
• Velocity discrimination in central and peripheral visual field.

  1985cited by this paper
• Processing visual feedback information for movement control.

  1981cited by this paper
• Processing of visual feedback in rapid movements.

  1968cited by this paper

• Vision Fine‐Tunes Predictions of Bimanual Self‐Touch

  2026cites this paper
• Independence of Visuomotor Functions Engaged in Visual Pursuit and Rapid Responses to Reach Errors

  2026cites this paper
• Anticipatory gaze in a reaching-and-grasping task when target movement direction is uncertain: evidence of statistical learning.

  2026cites this paper
• Visual Disturbances to Avatar Foot Position Increase Step-Width Variability in Immersive VR Treadmill Walking

  2025cites this paper
• Intuitive Hand Positional Guidance Using McKibben-Based Surface Tactile Sensations to Shoulder and Elbow

  2025cites this paper
• Reflex regulation of model-based biomimetic control for a tendon-driven prosthetic hand

  2025cites this paper
• Can you learn not to respond to irrelevant motion while making fast arm movements?

  2025cites this paper
• Construction and evaluation of a finger motor feedback system to improve finger dexterity

  2025cites this paper
• Guiding Movements by Constantly Reconsidering One's Actions: A Kinematic Approach.

  2025cites this paper
• A Comparative Evaluation of Pointing and Crossing in Moving Target Selection

  2025cites this paper
• Gaze-related functions driving gaze anchoring in reaching

  2025cites this paper
• Visual target and task-critical feedback uncertainty impair different stages of reach planning in motor cortex

  2025cites this paper
• Speed and accuracy tradeoff in whole body movement during vertical jumps under varying landing constraints

  2025cites this paper
• Computational account for the naturalness perception of others’ jumping motion based on a vertical projectile motion model

  2024cites this paper
• Exploring motor skill acquisition in bimanual coordination: insights from navigating a novel maze task

  2024cites this paper
• Editorial: The role of perceptual manipulations of XR in neurological rehabilitation

  2024cites this paper
• Modulations of stretch reflex by altering visuomotor contexts

  2024cites this paper
• Arm Cooling Selectively Impacts Sensorimotor Control.

  2024cites this paper
• Visual guidance fine-tunes probing movements of an insect appendage

  2024cites this paper
• Fish couple forecasting with feedback control to chase and capture moving prey

  2024cites this paper
• Adaptation of the gain of the corrective lifting response in object manipulation transfers across the hand

  2024cites this paper
• Engagnition: A multi-dimensional dataset for engagement recognition of children with autism spectrum disorder

  2024cites this paper
• Perceptual-Cognitive Integration for Goal-Directed Action in Naturalistic Environments

  2023cites this paper
• How Cerebellar Architecture and Dense Activation Patterns Facilitate Online Learning in Dynamic Tasks

  2023cites this paper
• Eye movements during motor imagery and execution reveal different visuomotor control strategies in manual interception.

  2023cites this paper
• The effect of impaired velocity signals on goal-directed eye and hand movements

  2023cites this paper
• Visuomotor tracking strategies in children: associations with neurodevelopmental symptoms

  2023cites this paper
• Online reach correction in 6- and 11-month-old infants.

  2023cites this paper
• Error-independent effect of sensory uncertainty on motor learning when both feedforward and feedback control processes are engaged

  2023cites this paper
• Age-related decline of online visuomotor adaptation: a combined effect of deteriorations of motor anticipation and execution

  2023cites this paper
• Continuous use of visual information about the position of the moving hand

  2023influential citation
• Fast feedback responses to categorical sensorimotor errors that do not indicate error magnitude are optimized based on short and long term memory.

  2023cites this paper
• Reach corrections toward moving objects are faster than reach corrections toward jumping targets

  2023cites this paper
• Virtual stick balancing: skill development in Newtonian and Aristotelian dynamics

  2022cites this paper
• Stable visually guided reaching does not require an internal feedforward model to compensate for internal delay: Data and model.

  2022cites this paper
• A Model Predictive Control Approach for Reach Redirection in Virtual Reality

  2022cites this paper
• Dissecting the effects of adaptive encoding and predictive inference on a single perceptual estimation

  2022cites this paper
• H OW CEREBELLAR ARCHITECTURE FACILITATES RAPID ONLINE LEARNING

  2022cites this paper
• Grounding Context in Embodied Cognitive Robotics

  2022cites this paper
• Learning to see in depth.

  2022cites this paper
• Normalized compression distance to measure cortico-muscular synchronization

  2022cites this paper
• A bicycle can be balanced by stochastic optimal feedback control but only with accurate speed estimates

  2022cites this paper
• Factors governing the assignment of visual consequence to the corresponding action.

  2022cites this paper
• When intercepting moving targets, mid-movement error corrections reflect distinct responses to visual and haptic perturbations

  2022cites this paper
• Delay of gaze fixation during reaching movement with the non-dominant hand to a distant target

  2022cites this paper
• Attractive and repulsive effects of sensory history concurrently shape visual perception

  2022cites this paper
• Muscle-Effort-Minimization-Inspired Kinematic Redundancy Resolution for Replicating Natural Posture of Human Arm

  2022cites this paper
• The impact of handedness on user performance in touchless input

  2021cites this paper
• Time for Space and the Stability of Prospective Control: Reaching-to-Grasp Gibson

  2021influential citation
• Can ongoing movements be guided by allocentric visual information when the target is visible?

  2021cites this paper
• Associative anticipatory learning and control of the cerebellar cortex based on the spike-timing-dependent plasticity of the parallel fiber-Purkinje cell synapses

  2021cites this paper
• The role of eye movements in manual interception: A mini-review.

  2021cites this paper
• Stereoacuity and its determinants in 7-year-old children: the Lhasa Childhood Eye Study

  2021cites this paper
• Biorealistic Control of Hand Prosthesis Augments Functional Performance of Individuals With Amputation

  2021cites this paper
• Editorial: Spatial and Temporal Perception in Sensory Deprivation

  2021cites this paper
• Visually and Tactually Guided Grasps Lead to Different Neuronal Activity in Non-human Primates

  2021cites this paper
• Gaze control during reaching is flexibly modulated to optimize task outcome.

  2021cites this paper
• Integration of proprioceptive and visual feedback during online control of reaching

  2021cites this paper
• Multi-Sensory Guidance and Feedback for Simulation-Based Training in Robot Assisted Surgery: A Preliminary Comparison of Visual, Haptic, and Visuo-Haptic

  2021cites this paper
• Influence of visual feedback, hand dominance and sex on individuated finger movements

  2021cites this paper
• Pseudo-Haptic Button for Improving User Experience of Mid-Air Interaction in VR

  2021cites this paper
• Neuromorphic Model of Reflex for Realtime Human-Like Compliant Control of Prosthetic Hand

  2020cites this paper
• Short-Term Sensorimotor Deprivation Impacts Feedforward and Feedback Processes of Motor Control

  2020cites this paper
• Motor control drives visual bodily judgements

  2020cites this paper
• Temporal Invariance in SCA6 Is Related to Smaller Cerebellar Lobule VI and Greater Disease Severity

  2020cites this paper
• Looking away from a moving target does not disrupt the way in which the movement toward the target is guided

  2020cites this paper
• Online modification of goal-directed control in human reaching movements

  2020cites this paper
• A scalable system for the monitoring of video transmission components in delay-sensitive networked applications

  2020cites this paper
• Visuomotor Integration for Coupled Hand Movements in Healthy Subjects and Patients With Stroke

  2020cites this paper
• Effects of model inaccuracies on reaching movements with intermittent control

  2019cites this paper
• Rapid online corrections for upper limb reaches to perturbed somatosensory targets: evidence for non-visual sensorimotor transformation processes

  2019cites this paper
• Examining associations between action game play and motor control.

  2019cites this paper
• Latency of 30 ms Benefits First Person Targeting Tasks More Than Refresh Rate Above 60 Hz

  2019cites this paper
• A Technique for Measuring Visuomotor Feedback Contributions to the Control of an Inverted Pendulum

  2019cites this paper
• Vestibular modulation of visuomotor feedback gains in reaching.

  2019cites this paper
• Time-to-target explains task-dependent modulation of temporal feedback gain evolution

  2019cites this paper
• Time-to-Target Simplifies Optimal Control of Visuomotor Feedback Responses

  2019cites this paper
• Reaching around obstacles accounts for uncertainty in coordinate transformations

  2019cites this paper
• Visual Feedback Processing of the Limb Involves Two Distinct Phases

  2019cites this paper
• Highs and Lows in Motor Control Development

  2019cites this paper
• An Information-Theoretic Approach to the Cost-benefit Analysis of Visualization in Virtual Environments

  2019cites this paper
• Effect of fatigue and the absence of visual feedback on shoulder motor control in an healthy population during a reaching task.

  2019cites this paper
• Guide Me: Recognition and Servoing on Mobiles

  2018influential citation
• Human Response Delay Estimation and Monitoring Using Gamma Distribution Analysis

  2018cites this paper
• Reliability-Weighted Integration of Audiovisual Signals Can Be Modulated by Top-down Control

  2018cites this paper
• A moving observer in a 3 D world

  2018cites this paper
• Effects of auditory feedback on movements with two-segment sequence and eye–hand coordination

  2018cites this paper
• Representational fluidity in embodied (artificial) cognition

  2018cites this paper
• Investigating the Effects of Anthropomorphic Fidelity of Self-Avatars on Near Field Depth Perception in Immersive Virtual Environments

  2018cites this paper
• Decision-making in sensorimotor control

  2018cites this paper
• Visuomotor feedback gains are modulated by gaze position.

  2018cites this paper
• Reliability-Weighted Integration of Audiovisual Signals Can Be Modulated by Top-down Attention

  2018cites this paper
• Visual Feedback of Target Position Affects Accuracy of Sequential Movements at Even Spaces

  2018cites this paper
• Optimal use of limb mechanics distributes control during bimanual tasks.

  2018cites this paper
• Volitional and Automatic Control of the Hand When Reaching to Grasp Objects

  2018cites this paper
• Neural correlates of performance monitoring during discrete and continuous tasks

  2018influential citation
• Modeling of decision-making process for moving straight using inverse Bayesian inference

  2018cites this paper
• Active Haptic Exploration of Softness: Indentation Force Is Systematically Related to Prediction, Sensation and Motivation

  2018cites this paper
• The smallest target size for a comfortable pointing in freehand space: human pointing precision of freehand interaction

  2017cites this paper
• Reshaping Movements Through Avoidance of Negative Events: A General Adaptive Controller

  2017cites this paper