Programming of Industrial Robots Using Virtual Reality and Digital Twins

The article presents a method of programming robots using virtual reality and digital twins. The virtual environment is a digital twin of a robotic station, built based on CAD models of existing station elements. The virtual reality system is used to record human movements in a virtual environment, which are then reproduced by a real robot. The method developed is dedicated mainly to such situations in which it is necessary for the robot to reproduce the movements of a human performing a process that is complicated from the point of view of robotization. An example of using the method for programming a robot implementing the process of cleaning ceramic casting moulds is presented.

• Publication year

  2020

• Venue

  Applied Sciences

• Publication date

  2020-01-09

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.3390/app10020486
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Digital Twin-driven smart manufacturing: Connotation, reference model, applications and research issues

  2020cited by this paper
• Augmented reality-assisted robot programming system for industrial applications

  2020cited by this paper
• Application of Virtual Reality in the Training of Operators and Servicing of Robotic Stations

  2019cited by this paper
• Digital twin driven human–robot collaborative assembly

  2019cited by this paper
• Intuitive Welding Robot Programming via Motion Capture and Augmented Reality

  2019cited by this paper
• Augmented Reality for Quick and Intuitive Robotic Packing Re-Programming

  2019cited by this paper
• Digital twin for adaptation of robots’ behavior in flexible robotic assembly lines

  2019cited by this paper
• Quantitative analysis of the Oculus Rift S in controlled movement

  2019cited by this paper
• The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans

  2019cited by this paper
• Development and operation of Digital Twins for technical systems and services

  2019cited by this paper
• Industrial robot control and operator training using virtual reality interfaces

  2019cited by this paper
• A digital twin-based approach for dynamic clamping and positioning of the flexible tooling system

  2019cited by this paper
• Digital Twins and Cyber–Physical Systems toward Smart Manufacturing and Industry 4.0: Correlation and Comparison

  2019cited by this paper
• A data- and knowledge-driven framework for digital twin manufacturing cell

  2019cited by this paper
• Digital Twin in Services and Industrial Product Service Systems:

  2019cited by this paper
• Methodology for enabling Digital Twin using advanced physics-based modelling in predictive maintenance

  2019cited by this paper
• Digital Human and Robot Simulation in Automotive Assembly using Siemens Process Simulate: A Feasibility Study

  2019cited by this paper
• Application of Virtual Reality in Designing and Programming of Robotic Stations

  2019cited by this paper
• Industry 4.0. Part I. Selected applications in processing of polymer materials

  2018cited by this paper
• Survey on Human-Robot Interaction for Robot Programming in Industrial Applications

  2018cited by this paper
• A Machine Learning-Enhanced Digital Twin Approach for Human-Robot-Collaboration

  2018cited by this paper
• Robot Programming Through Augmented Trajectories in Augmented Reality

  2018cited by this paper
• Digital twins of human robot collaboration in a production setting

  2018cited by this paper
• Virtual Training for Industrial Automation Processes Through Pneumatic Controls

  2018cited by this paper
• The digital twin of an industrial production line within the industry 4.0 concept

  2017cited by this paper
• Digital twin-driven product design, manufacturing and service with big data

  2017cited by this paper
• Design of a virtual reality training system for human–robot collaboration in manufacturing tasks

  2015cited by this paper
• Virtual Reality Application for Simulation and Off-line Programming of the Mitsubishi Movemaster RV-M1 Robot Integrated with the Oculus Rift to Improve Students Training

  2015cited by this paper
• Optimizing the Robot Arm Movement Time Using Virtual Reality Robotic Teaching System

  2015cited by this paper
• Virtual Reality Based Support System for Layout Planning and Programming of an Industrial Robotic Work Cell

  2014cited by this paper
• Direct off-line robot programming via a common CAD package

  2013cited by this paper
• The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles

  2012cited by this paper
• Recent Progress on Programming Methods for Industrial Robots

  2010cited by this paper
• [Intelligent Systems, Control and Automation: Science and Engineering] Advances in Unmanned Aerial Vehicles Volume 33 || Design and Control of a Miniature Quadrotor

  2007cited by this paper
• Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training

  2005cited by this paper
• Augmented reality for programming industrial robots

  2003cited by this paper
• Virtual Reality Technology

  2003cited by this paper

• From Interaction to Demonstration Quality in Virtual Reality: Effects of Interaction Modality and Visual Representation on Everyday Tasks

  2026cites this paper
• Combining simulation and virtual reality for enabling interoperable digital twins in collaborative human–robot workspaces

  2025cites this paper
• Cyber-physical-human systems for mobile robots in energy asset management: Current practices and future opportunities

  2025cites this paper
• Vision-based control of small educational parallel selective compliance assembly robot arm robot

  2025cites this paper
• PerVRML: ChatGPT-Driven Personalized VR Environments for Machine Learning Education

  2025cites this paper
• Experimental study of a novel contact-based pose detection approach for digital twin-driven high-precision micro assembly

  2025cites this paper
• Authoring framework for industrial XR digital twin and autonomous agent: a proof of concept

  2025cites this paper
• Using programming by demonstration tools for DEMO maintenance: A framework proposal with an experimental validation

  2025cites this paper
• Real-Time Analysis of Industrial Data Using the Unsupervised Hierarchical Density-Based Spatial Clustering of Applications with Noise Method in Monitoring the Welding Process in a Robotic Cell

  2025cites this paper
• Industrial Human-Machine Safety Interaction for Efficient Teaching: A Method Based on Mixed Reality and Path Optimization

  2025cites this paper
• Industrial Metaverse challenges, opportunities, and the impact on sustainability

  2025cites this paper
• How Robot Kinematics Influence Human Performance in Virtual Robot-to-Human Handover Tasks

  2025cites this paper
• Virtual Reality Task Guidance Through Relative 6DoF Pose Specification

  2025cites this paper
• Industrial robot system state simulation and risk utilization test environment design

  2025cites this paper
• Intuitive Real-Time Robot Teleoperation via VR, ROS, and Externally Guided Motion for Human Skill Transfer

  2025cites this paper
• Digital twin on concepts, enabling technologies, and applications

  2024cites this paper
• Virtual Reality System of Ceramic Design Integrating Multi-Modal Perception and Implementation Algorithm

  2024cites this paper
• Asynchronously Assigning, Monitoring, and Managing Assembly Goals in Virtual Reality for High-Level Robot Teleoperation

  2024cites this paper
• DMAIC-v2: A Novel Guide to the Improvement of Industrial Processes

  2024cites this paper
• Enabling Technologies to Support Supply Chain Logistics 5.0

  2024cites this paper
• A physical-virtual based digital twin robotic hand

  2024cites this paper
• Towards industry 5.0 through metaverse

  2024cites this paper
• Block-based Programming for Two-Armed Robots: A Comparative Study

  2024cites this paper
• An equipment-level digital twin method for industrial robots for machining

  2024cites this paper
• A new approach for creating and testing safety components integrated into a robotic cell simulation scenario in a virtual reality environment

  2024cites this paper
• Design a Coffee-Making Process Unit Using Virtual Twin and Virtual Commissioning

  2024cites this paper
• Application of Digital Twin of Robot Cell in Investment Casting Manufacturing

  2024cites this paper
• Visual search for hazardous items: using virtual reality (VR) in laypersons to test wearable displays for firefighters

  2024cites this paper
• Creating Digital Twins of Robotic Stations Using a Laser Tracker

  2024cites this paper
• A Hybrid Approach of No-Code Robot Programming for Agile Production: Integrating Finger-Gesture and Point Cloud

  2024cites this paper
• Application of Digital Twins in Designing Safety Systems for Robotic Stations

  2024cites this paper
• An Authoring Tool for Mixed Reality Interfaces for Digital Twins in Manufacturing

  2024cites this paper
• From 3D point‐cloud data to explainable geometric deep learning: State‐of‐the‐art and future challenges

  2024cites this paper
• A Framework for Enhanced Human-Robot Collaboration during Disassembly Using Digital Twin and Virtual Reality

  2024cites this paper
• CAD Ceramic Texture Synthesis Method Based on Convolutional Neural Networks

  2024cites this paper
• Industrial Robot Remote Control using Virtual Reality Interfaces

  2024cites this paper
• Digital Twin System for Home Service Robot Based on Motion Simulation

  2023cites this paper
• Toward Programming a Collaborative Robot by Interacting with Its Digital Twin in a Mixed Reality Environment

  2023cites this paper
• Digital twin of an industrial workstation: A novel method of an auto-labeled data generator using virtual reality for human action recognition in the context of human-robot collaboration

  2023cites this paper
• Study on the Applicability of Digital Twins for Home Remote Motor Rehabilitation

  2023cites this paper
• Towards next generation digital twin in robotics: Trends, scopes, challenges, and future

  2023cites this paper
• Educational Case Studies: Creating a Digital Twin of the Production Line in TIA Portal, Unity, and Game4Automation Framework

  2023cites this paper
• Digital Art Design and Media Practice Integrating CAD and Virtual Reality Technology

  2023cites this paper
• Virtual Reality-Based Interactive Visual Communication Media Design and User Experience

  2023cites this paper
• Analysis of trajectory and motion parameters of an industrial robot cooperating with a numerically controlled machine tools

  2023cites this paper
• The case study of new approach to robot programming and layout design by supporting virtual and augmented reality

  2023cites this paper
• Magic NeRF Lens: Interactive Fusion of Neural Radiance Fields for Virtual Facility Inspection

  2023cites this paper
• Analysis of the current status of the development of virtual reality environments for teaching industrial automation systems

  2023cites this paper
• Integration of an industrial control to a digital twin at the industrial level

  2023cites this paper
• Exploring human-machine collaboration in industry: a systematic literature review of digital twin and robotics interfaced with extended reality technologies

  2023cites this paper
• Use of virtual reality to facilitate engineer training in the aerospace industry

  2023cites this paper
• Enhanced No-Code Finger-Gesture-Based Robot Programming: Simultaneous Path and Contour Awareness for Orientation Estimation

  2023cites this paper
• 3D Modeling and Design Effect Optimization of Ceramics Using Virtual Reality

  2023cites this paper
• The resurrection of digital triplet: A cognitive pillar of human-machine integration at the dawn of industry 5.0

  2023cites this paper
• Transforming the Future of Furniture Woodworking Instruction Through VR-Enhanced Distance Teaching During the COVID-19 Pandemic

  2023cites this paper
• How to Integrate Digital Twin and Virtual Reality in Robotics Systems? Design and Implementation for Providing Robotics Maintenance Services in Data Centers

  2023cites this paper
• Leveraging Virtual Reality for Robot Manipulator Education

  2023cites this paper
• Understanding Stakeholder Requirements for Digital Twins In Manufacturing Maintenance

  2023cites this paper
• Pengendali Robot Pebisnis Menggunakan Teknologi Virtual Realty

  2023cites this paper
• Beyond Digital Twins: Phygital Twins for Neuroergonomics in Human-Robot Interaction

  2022cites this paper
• Customized Curriculum and Learning Approach Recommendation Techniques in Application of Virtual Reality in Medical Education

  2022cites this paper
• Programming of Industrial Robots Using a Laser Tracker

  2022cites this paper
• Digital twin key technology on rare earth process

  2022cites this paper
• Application of VR Virtual Reality in the Course of Later Stage and Special Effect Production

  2022cites this paper
• Implementation of UI Methods and UX in VR in Case of 3D Printer Tutorial

  2022cites this paper
• Digital Twin for Human–Robot Interactions by Means of Industry 4.0 Enabling Technologies

  2022influential citation
• Integrating Trajectory Planning with Kinematic Analysis and Joint Torques Estimation for an Industrial Robot Used in Incremental Forming Operations

  2022cites this paper
• Extended Reality Application Framework for a Digital-Twin-Based Smart Crane

  2022cites this paper
• Automatic Control System Design for Industrial Robots Based on Simulated Annealing and PID Algorithms

  2022cites this paper
• Digital Twin for Human–Robot Collaboration in Manufacturing: Review and Outlook

  2022cites this paper
• Application of 5G Internet System to Improve the Economy (Case Study of Bali Province)

  2022cites this paper
• Design and Build a Facial Recognition Based Motor Vehicle Security System

  2022cites this paper
• Digital twins in industry 4.0

  2022cites this paper
• Application of Digital Twins to Flexible Production Management: Taking a Shandong Factory as an Example

  2022cites this paper
• Learning from Demonstrations in Human-Robot Collaborative Scenarios: A Survey

  2022cites this paper
• Adaptive lead-through teaching control for spray-painting robot with closed control system

  2022cites this paper
• Haptic Rendering of Arbitrary Serial Manipulators for Robot Programming

  2022cites this paper
• Digital Twin as Industrial Robots Manipulation Validation Tool

  2022cites this paper
• Function Block-Based Multimodal Control for Symbiotic Human–Robot Collaborative Assembly

  2021cites this paper
• Digital Twin for FANUC Robots: Industrial Robot Programming and Simulation Using Virtual Reality

  2021cites this paper
• The application of virtual reality in programming of a manufacturing cell

  2021cites this paper
• User-centered design for Human-Robot Collaboration systems

  2021cites this paper
• It's your turn! - A collaborative human-robot pick-and-place scenario in a virtual industrial setting

  2021cites this paper
• Digital twin for smart manufacturing: a review of concepts towards a practical industrial implementation

  2021cites this paper
• A virtual commissioning based methodology to integrate digital twins into manufacturing systems

  2021cites this paper
• Enhancing Human-in-the-Loop Adaptive Systems through Digital Twins and VR Interfaces

  2021cites this paper
• Digital Twin for Industrial Robotics

  2021cites this paper
• Augmented Reality and the Digital Twin: State-of-the-Art and Perspectives for Cybersecurity

  2021cites this paper
• Planning and optimization of robotic pick-and-place operations in highly constrained industrial environments

  2021cites this paper
• A Digital Twin Demonstrator to enable flexible manufacturing with robotics: a process supervision case study

  2021cites this paper
• VR as a 3D Modelling Tool in Engineering Design Applications

  2021cites this paper
• A Survey on AI-Driven Digital Twins in Industry 4.0: Smart Manufacturing and Advanced Robotics

  2021cites this paper
• Digital twin: a concept in evolution

  2021cites this paper
• Methodology of Implementing Virtual Reality in Education for Industry 4.0

  2021cites this paper
• The State of Industrial Robotics: Emerging Technologies, Challenges, and Key Research Directions

  2020cites this paper
• Digital Twin in the IoT Context: A Survey on Technical Features, Scenarios, and Architectural Models

  2020cites this paper
• Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

  2020cites this paper
• Digital Twin and Virtual Reality Based Methodology for Multi-Robot Manufacturing Cell Commissioning

  2020cites this paper
• Energy and AI

  year unknowncites this paper
• Design and Construction of an IoT-Based Room Cleaning Robot

  year unknowncites this paper