Robotic Arm Based Automatic Ultrasound Scanning for Three-Dimensional Imaging

This paper presents a human skin inspired automatic robotic ultrasound (US) system for three-dimensional (3-D) imaging. A depth camera was adopted to capture the point cloud of the skin surface. According to the 3-D contour of the skin surface, the scan range and scan path for the US probe could be automatically determined. Then, we used a normal-vector-based method to determine the pose of the robotic arm corresponding to each scan point in the scan path. In addition, two force sensors could feedback the contact force between the scanned tissue and the emission plane of the probe for fine-tuning the pose of the robotic arm. After the scanning, the system could realize 3-D US reconstruction. Experimental results validate the feasibility of the proposed system. It is expected that the proposed system will be useful in clinical practices.

• Publication year

  2019

• Venue

  IEEE Transactions on Industrial Informatics

• Publication date

  2019-02-01

• Fields of study

  Medicine, Computer Science, Engineering

• Identifiers
  DOI 10.1109/TII.2018.2871864
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Fully Automatic Three-Dimensional Ultrasound Imaging Based on Conventional B-Scan

  2018influential reference
• Robot-Assisted Decompressive Laminectomy Planning Based on 3D Medical Image

  2018cited by this paper
• Real-time freehand 3D ultrasound imaging

  2018cited by this paper
• Comparison of medical image 3D reconstruction rendering methods for robot-assisted surgery

  2017cited by this paper
• Co-robotic ultrasound imaging: a cooperative force control approach

  2017cited by this paper
• A Study on Speech Recognition Control for a Surgical Robot

  2017cited by this paper
• Adaptive Impedance Control for an Upper Limb Robotic Exoskeleton Using Biological Signals

  2017cited by this paper
• Study of a 6DOF robot assisted ultrasound scanning system and its simulated control handle

  2017cited by this paper
• Human–Robot Coordination Control of Robotic Exoskeletons by Skill Transfers

  2017cited by this paper
• Robotic 4D ultrasound solution for real-time visualization and teleoperation

  2017cited by this paper
• A Review on Real-Time 3D Ultrasound Imaging Technology

  2017cited by this paper
• System Integration and In Vivo Testing of a Robot for Ultrasound Guidance and Monitoring During Radiotherapy

  2017cited by this paper
• Development of a Wireless and Near Real-Time 3D Ultrasound Strain Imaging System

  2016cited by this paper
• RGB-D sensor-based visual SLAM for localization and navigation of indoor mobile robot

  2016cited by this paper
• Development of a exoskeleton robot for lower limb rehabilitation

  2016cited by this paper
• A Robotic Ultrasound Scanner for Automatic Vessel Tracking and Three-Dimensional Reconstruction of B-Mode Images

  2016cited by this paper
• A Flexible Surgical Robotic System for Removal of Early-Stage Gastrointestinal Cancers by Endoscopic Submucosal Dissection

  2016cited by this paper
• Robotic System for MRI-Guided Stereotactic Neurosurgery

  2015cited by this paper
• Force and Position Control System for Freehand Ultrasound

  2015cited by this paper
• Correspondence - 3-D ultrasonic strain imaging based on a linear scanning system

  2015cited by this paper
• Graph-based learning for segmentation of 3D ultrasound images

  2015cited by this paper
• Enhanced Extended-Field-of-View Ultrasound for Musculoskeletal Tissues Using Parallel Computing

  2015cited by this paper
• Industrial production surety factor increasing by a system of fingerprint verification

  2014cited by this paper
• ATD: A Multiplatform for Semiautomatic 3-D Detection of Kidneys and Their Pathology in Real Time

  2014cited by this paper
• Robotic ultrasound systems in medicine

  2013cited by this paper
• Registration of holographic images based on the integral transformation

  2013cited by this paper
• Comparison of different reconstruction algorithms for three‐dimensional ultrasound imaging in a neurosurgical setting

  2012cited by this paper
• Development of support system to handle ultrasound probe by coordinated motion with medical robot

  2011cited by this paper
• Interface Design and Control Strategies for a Robot Assisted Ultrasonic Examination System

  2010cited by this paper
• A new adaptive interpolation algorithm for 3D ultrasound imaging with speckle reduction and edge preservation

  2009cited by this paper
• Construction Methodology for a Remote Ultrasound Diagnostic System

  2009cited by this paper
• Speckle suppression and contrast enhancement in reconstruction of freehand 3D ultrasound images using an adaptive distance-weighted method

  2009cited by this paper
• MIRA V: An integrated system for minimally invasive robot-assisted lung brachytherapy

  2008cited by this paper
• Volume reconstruction of freehand three-dimensional ultrasound using median filters.

  2008cited by this paper
• Freehand 3D ultrasound reconstruction algorithms--a review.

  2007cited by this paper
• Computing and Rendering Point Set Surfaces

  2003cited by this paper
• Error analysis for a free-hand three-dimensional ultrasound system for neuronavigation

  1999cited by this paper
• Two-Dimensional Arrays for Medical Ultrasound

  1991cited by this paper
• Introduction to robotics: Mechanics and control

  1987cited by this paper
• The Levenberg-Marquardt algo-rithm: Implementation and theory

  1977cited by this paper

• From Recognition to Action: Integrating Deep Learning and Robotic Control in Transthoracic Echocardiography.

  2026cites this paper
• A Control Framework With Tactile Diffusion Policy and Variable Impedance for Unknown Surface Tracking

  2026cites this paper
• Towards Autonomous Robotic Kidney Ultrasound: Spatial-Efficient Volumetric Imaging via Template Guided Optimal Pivoting

  2026cites this paper
• Patient Acceptability of Automated Robotic Ultrasound by Patient Profile

  2026cites this paper
• Observer-based sliding mode admittance control for ultrasound robot force-tracking in complex interaction environments

  2026cites this paper
• Adaptive Fuzzy Motion Planning Control With Fixed-Time Convergence for Redundant Robots Under Constraints

  2026cites this paper
• Toward Clinical Applications of Intelligent Robotic Ultrasound Systems

  2025cites this paper
• Dual-Agent-Based Robotic Ultrasound Path Planning and Interaction Control in External-Vision-Independent Environments

  2025cites this paper
• Reinforcement Learning for Robot Assisted Live Ultrasound Examination

  2025cites this paper
• 机器人超声成像：技术进展与应用前景

  2025cites this paper
• Technological evolution and research frontiers of robot-assisted ultrasound examination: a bibliometric exploration

  2025influential citation
• Circular path planning and adaptive force control for breast ultrasound autonomous scanning

  2025cites this paper
• Fully automated robotic ultrasound gallbladder imaging with subcostal scanning

  2025cites this paper
• Ultrasonic Imaging for Internal Defects of Aerospace Irregular Surfaces Structures via CO-SAFT

  2025cites this paper
• Freehand 3D Ultrasound Imaging: Sim-in-the-Loop Probe Pose Optimization via Visual Servoing

  2025cites this paper
• Deep learning-based high precision 3D ultrasound imaging for large size organ

  2025cites this paper
• Radius-Adjustable Ring Ultrasound Transducer Array for Real-Time 3D Imaging of Large Volume Targets.

  2025cites this paper
• Smooth Path Planning and Dynamic Contact Force Regulation for Robotic Ultrasound Scanning

  2025cites this paper
• Improving Probe Localization for Freehand 3D Ultrasound Using Lightweight Cameras

  2025cites this paper
• Sensorless Force Imbalance Prediction Based on Visual Information for Robotic Ultrasound Scanning

  2025cites this paper
• The IoRT-in-Hand: Tele-Robotic Echography and Digital Twins on Mobile Devices

  2025cites this paper
• Tactile-Guided Robotic Ultrasound: Mapping Preplanned Scan Paths for Intercostal Imaging

  2025cites this paper
• Integrating Confidence Maps and Visual Servoing for Needle Tracking in Robotic US-Guided Percutaneous Nephrolithotomy

  2025cites this paper
• A Survey of Autonomous Robotic Ultrasound Scanning Systems

  2025cites this paper
• Point cloud-guided ultrasound robotic scanning path planning for the kidney based on anatomical positioning

  2025cites this paper
• Sensor-free contact force guidance for ultrasound imaging

  2025cites this paper
• Enhancing Ultrasound Scanning Skills in a Leader–Follower Robotic System through Expert Hand Impedance Regulation

  2025cites this paper
• Robotic Ultrasound Scanning End-Effector with Adjustable Constant Contact Force

  2025cites this paper
• Toward Lung Ultrasound Automation: Fully Autonomous Robotic Longitudinal and Transverse Scans Along Intercostal Spaces

  2025cites this paper
• A-SEE2.0: Active-Sensing End-Effector for Robotic Ultrasound Systems with Dense Contact Surface Perception Enabled Probe Orientation Adjustment

  2025cites this paper
• Contactless Surface Following via Teleoperated Manipulator Based on Point Cloud

  2025cites this paper
• Toward eFAST autonomous robotic ultrasound imaging: system integrations and experimental studies

  2025cites this paper
• Autonomous robotic ultrasound scanning system: a key to enhancing image analysis reproducibility and observer consistency in ultrasound imaging

  2025cites this paper
• Design of a Cost-Effective Ultrasound Force Sensor and Force Control System for Robotic Extra-Body Ultrasound Imaging

  2025influential citation
• In situ structural-functional synchronous dissection of dynamic neuromuscular system via an integrated multimodal wearable patch

  2025cites this paper
• Ultrasound-Guided Robotic Autonomous Operation Based on Real-Time Deformation Tracking and Prediction

  2025cites this paper
• Learning Freehand Ultrasound Through Multimodal Representation and Skill Adaptation

  2025influential citation
• Multi-Modal Autonomous Ultrasound Scanning for Efficient Human–Machine Fusion Interaction

  2025cites this paper
• Design and Quantitative Assessment of Teleoperation-Based Human–Robot Collaboration Method for Robot-Assisted Sonography

  2025cites this paper
• Robot-Assisted Deep Venous Thrombosis Ultrasound Examination Using Virtual Fixture

  2024cites this paper
• 3-D μXRF Imaging System for Curved Surface

  2024cites this paper
• Preliminary Evaluation of an Ultrasound-Guided Robotic System for Autonomous Percutaneous Intervention

  2024cites this paper
• Task Space Compliant Control and Six-Dimensional Force Regulation Toward Automated Robotic Ultrasound Imaging

  2024cites this paper
• A Dynamical System Approach to Robotic Ultrasound Imaging: Towards Intrinsically Stable Robotic Sonography

  2024cites this paper
• Evaluation of Communication and Human Response Latency for (Human) Teleoperation

  2024cites this paper
• Towards Soft-robotic Assistance of Ultrasonic Imaging

  2024cites this paper
• Non-Newtonian fluid coupling media for wearable ultrasound imaging systems using rigid linear sensor array

  2024cites this paper
• Class-Aware Cartilage Segmentation for Autonomous US-CT Registration in Robotic Intercostal Ultrasound Imaging

  2024cites this paper
• Low-Profile 6-Axis Differential Magnetic Force/Torque Sensing

  2024cites this paper
• Cognitive Electronic Unit for Assisted Ultrasound: Preliminary Results and Future Perspectives

  2024cites this paper
• Autonomous ultrasound scanning robotic system based on human posture recognition and image servo control: an application for cardiac imaging

  2024cites this paper
• Review of robotic systems for thoracoabdominal puncture interventional surgery

  2024cites this paper
• Toward automatic robotic massage based on interactive trajectory planning and control

  2024cites this paper
• Inverse-Reinforcement-Learning-Based Robotic Ultrasound Active Compliance Control in Uncertain Environments

  2024cites this paper
• A Simultaneous Ultrasound-Robot Calibration Approach for Dual-Robot Intervention by Solving the AXP = YCQ Problem

  2024cites this paper
• Wearable bioadhesive ultrasound shear wave elastography

  2024cites this paper
• Force Tracking Control Method for Robotic Ultrasound Scanning System under Soft Uncertain Environment

  2024cites this paper
• An Adaptive Control Method and Learning Strategy for Ultrasound-Guided Puncture Robot

  2024cites this paper
• A System for Reproducible 3D Ultrasound Measurements of Skeletal Muscles

  2024cites this paper
• Kinematic and Dynamic Manipulability Optimizations of Redundant Manipulators Based on RNN Model

  2024cites this paper
• Skin-Conformable Flexible and Stretchable Ultrasound Transducer for Wearable Imaging

  2024cites this paper
• Mixed reality human teleoperation with device-agnostic remote ultrasound: Communication and user interaction

  2024cites this paper
• Safe Contact Force Generation for Robotic Thyroid Ultrasound Imaging

  2024cites this paper
• A sensor fusion approach to autonomous ultrasound imaging of the lumbar region

  2024cites this paper
• Automatic Contact-Based 3D Scanning Using Articulated Robotic Arm

  2024cites this paper
• Fully automatic spinal scanning and measurement based on multi-source vision information

  2023cites this paper
• A Flexible and Fully Autonomous Breast Ultrasound Scanning System

  2023cites this paper
• Full-Coverage Path Planning and Stable Interaction Control for Automated Robotic Breast Ultrasound Scanning

  2023cites this paper
• SAPM: Self-Adaptive Parallel Manipulator with Pose and Force Adjustment for Robotic Ultrasonography

  2023cites this paper
• A Study on a Parameter Estimator for the Homodyned K Distribution Based on Table Search for Ultrasound Tissue Characterization.

  2023cites this paper
• An Artificial Intelligence-Aided Robotic Platform for Ultrasound-Guided Transcarotid Revascularization

  2023cites this paper
• Recent Advances in Artificial Intelligence-Assisted Ultrasound Scanning

  2023cites this paper
• A Freehand 3D Ultrasound Reconstruction Method Based on Deep Learning

  2023cites this paper
• Development of Single-Channel Dual-Element Custom-Made Ultrasound Scanner with Miniature Optical Position Tracker for Freehand Imaging

  2023cites this paper
• Visual Perception and Convolutional Neural Network-Based Robotic Autonomous Lung Ultrasound Scanning Localization System

  2023cites this paper
• Mixed Reality Human Teleoperation

  2023cites this paper
• Skeleton Graph-Based Ultrasound-CT Non-Rigid Registration

  2023cites this paper
• Design of an Efficient Bioinspired Model for Optimizing Robotic Arm Movements via Ensemble Learning Operations

  2023cites this paper
• Autonomous Robotic Ultrasound Vascular Imaging System With Decoupled Control Strategy for External-Vision-Free Environments

  2023cites this paper
• An Anti-saturation Phase Retrieval Algorithm based on Optimal Composite Fringe Patterns for 3D Measurement with Shiny Surface

  2023cites this paper
• A Curvature and Trajectory Optimization-based 3D Surface Reconstruction Pipeline for Ultrasound Trajectory Generation

  2023influential citation
• Three-dimensional ultrasound image reconstruction based on 3D-ResNet in the musculoskeletal system using a 1D probe: ex vivo and in vivo feasibility studies

  2023cites this paper
• Intelligent robotic sonographer: Mutual information-based disentangled reward learning from few demonstrations

  2023influential citation
• Thoracic Cartilage Ultrasound-CT Registration Using Dense Skeleton Graph

  2023cites this paper
• Robotic Ultrasound Imaging: State-of-the-Art and Future Perspectives

  2023cites this paper
• Adaptive and iterative learning control to simultaneously control end-effector force and direction by normal vectors learning

  2023cites this paper
• Compliant Joint Based Robotic Ultrasound Scanning System for Imaging Human Spine

  2023cites this paper
• On mimicking human’s manipulation for robot-assisted spine ultrasound imaging

  2023cites this paper
• A Force-Matched Approach to Large-Strain Nonlinearity in Elasticity Imaging for Breast Lesion Characterization

  2023cites this paper
• Towards Differential Magnetic Force Sensing for Ultrasound Teleoperation

  2023cites this paper
• Point Cloud Segmentation of Breast Ultrasound Regions to be Scanned by Fusing 2D Image Instance Segmentation and Keypoint Detection

  2023influential citation
• Review of robot-assisted medical ultrasound imaging systems: Technology and clinical applications

  2023cites this paper
• Channel and Spatial Attention Mechanism-based Yolo Network for Target Detection of the Lung Ultrasound Scanning Robot

  2023cites this paper
• RUSOpt: Robotic UltraSound Probe Normalization with Bayesian Optimization for In-Plane and Out-Plane Scanning

  2023cites this paper
• Rib region detection for scanning path planning for fully automated robotic abdominal ultrasonography

  2023cites this paper
• Towards Non-contact 3D Ultrasound for Wrist Imaging

  2023cites this paper
• Research on Path Planning of Breast Ultrasound Examination Robot *

  2023cites this paper
• A Comparative Study for Control of Semi-Automatic Robotic-Assisted Ultrasound System in Spine Surgery

  2023cites this paper
• Robotic Ultrasonography for Autonomous Non-Invasive Diagnosis—A Systematic Literature Review

  2022influential citation
• Autonomous Ultrasound Scanning using Bayesian Optimization and Hybrid Force Control

  2022cites this paper