Design of Hybrid Cells to Facilitate Safe and Efficient Human-Robot Collaboration During Assembly Operations

This paper presents a framework to build hybrid cells that support safe and efficient human–robot collaboration during assembly operations. Our approach allows asynchronous collaborations between human and robot. The human retrieves parts from a bin and places them in the robot's workspace, while the robot picks up the placed parts and assembles them into the product. We present the design details of the overall framework comprising three modules—plan generation, system state monitoring, and contingency handling. We describe system state monitoring and present a characterization of the part tracking algorithm. We report results from human–robot collaboration experiments using a KUKA robot and a three-dimensional (3D)-printed mockup of a simplified jet-engine assembly to illustrate our approach.

• Publication year

  2018

• Venue

  Journal of Computing and Information Science in Engineering

• Publication date

  2018-06-12

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1115/1.4039061
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Collaborative Assembly in Hybrid Manufacturing Cells: An Integrated Framework for Human–Robot Interaction

  2018cited by this paper
• System State Monitoring to Facilitate Safe and Efficient Human-Robot Collaboration in Hybrid Assembly Cells

  2017cited by this paper
• Addressing perception uncertainty induced failure modes in robotic bin-picking

  2016cited by this paper
• Collaborative manufacturing with physical human–robot interaction

  2016cited by this paper
• Resolving Occlusions Through Simple Extraction Motions in Robotic Bin-Picking

  2016cited by this paper
• An ontology to enable optimized task partitioning in human-robot collaboration for warehouse kitting operations

  2015cited by this paper
• A Framework for Hybrid Cells That Support Safe and Efficient Human-Robot Collaboration in Assembly Operations

  2014cited by this paper
• Toward Safe Human Robot Collaboration by Using Multiple Kinects Based Real-Time Human Tracking

  2014cited by this paper
• Safe Human Robot Interaction by Using Exteroceptive Sensing Based Human Modeling

  2013cited by this paper
• Improving assembly precedence constraint generation by utilizing motion planning and part interaction clusters

  2013cited by this paper
• Instruction Generation for Assembly Operations Performed by Humans

  2012cited by this paper
• Assembly Sequence Planning by Using Multiple Random Trees Based Motion Planning

  2012cited by this paper
• Levels of human and robot collaboration for automotive manufacturing

  2012cited by this paper
• Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair

  2011cited by this paper
• KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera

  2011cited by this paper
• KinectFusion: Real-time dense surface mapping and tracking

  2011cited by this paper
• DTAM: Dense tracking and mapping in real-time

  2011cited by this paper
• Evaluating the effectiveness of visualization techniques for schematic diagrams in maintenance tasks

  2010cited by this paper
• Live dense reconstruction with a single moving camera

  2010cited by this paper
• Global registration of multiple point clouds embedding the Generalized Procrustes Analysis into an ICP framework

  2010cited by this paper
• A Model for Human Readable Instruction Generation Using Level-Based Discourse Planning and Dynamic Inference of Attributes

  2009cited by this paper
• On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes

  2009cited by this paper
• Intrinsic shape signatures: A shape descriptor for 3D object recognition

  2009cited by this paper
• Explosion Diagrams in Augmented Reality

  2009cited by this paper
• Human-Robot Collaboration: a Survey

  2008cited by this paper
• Salient local visual features for shape-based 3D model retrieval

  2008cited by this paper
• Towards the development of a virtual environment-based training system for mechanical assembly operations

  2007cited by this paper
• Watching out for the workers [Safety Workstations]

  2007cited by this paper
• Similarity Assessment Based on Face Alignment Using Attributed Vectors

  2006cited by this paper
• Shape Topics: A Compact Representation and New Algorithms for 3D Partial Shape Retrieval

  2006cited by this paper
• A Novel Representation and Feature Matching Algorithm for Automatic Pairwise Registration of Range Images

  2005cited by this paper
• Global registration of multiple 3D point sets via optimization-on-a-manifold

  2005cited by this paper
• Recognizing Objects in Range Data Using Regional Point Descriptors

  2004cited by this paper
• 3D free-form object recognition in range images using local surface patches

  2004cited by this paper
• Identification and validation of cognitive design principles for automated generation of assembly instructions

  2004cited by this paper
• A survey of content based 3D shape retrieval methods

  2004cited by this paper
• A comparison of the usability and effectiveness of web-based delivery of instructions for inherently-3D construction tasks on handheld and desktop computers

  2003cited by this paper
• A Survey of Shape Similarity Assessment Algorithms for Product Design and Manufacturing Applications

  2003cited by this paper
• A survey of methods for recovering quadrics in triangle meshes

  2002cited by this paper
• Intelligent Assembly Modeling and Simulation

  2001cited by this paper
• Efficient variants of the ICP algorithm

  2001cited by this paper
• 3D object recognition from range images using local feature histograms

  2001cited by this paper
• Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes

  1999cited by this paper
• AN INTELLIGENT ENVIRONMENT FOR SIMULATING MECHANICAL ASSEMBLY OPERATIONS

  1998cited by this paper
• Negotiation for automated generation of temporal multimedia presentations

  1997cited by this paper
• Point Signatures: A New Representation for 3D Object Recognition

  1997cited by this paper
• Automated manufacturability analysis: A survey

  1995cited by this paper
• Structural Indexing: Efficient 3-D Object Recognition

  1992cited by this paper
• Procrustes methods in the statistical analysis of shape

  1991cited by this paper

• Benchmarking Teamwork of Humans and Cobots—An Overview of Metrics, Strategies, and Tasks

  2023influential citation
• Physics-Informed Learning to Enable Robotic Screw-Driving Under Hole Pose Uncertainties

  2023cites this paper
• Human-cobot interaction fluency and cobot operators' job performance. The mediating role of work engagement: A survey

  2022cites this paper
• A Benchmark Toolkit for Collaborative Human-Robot Interaction

  2022cites this paper
• Human-Robot Interaction Review: Challenges and Solutions for Modern Industrial Environments

  2021cites this paper
• Function Block-Based Multimodal Control for Symbiotic Human–Robot Collaborative Assembly

  2021cites this paper
• PRELIMINARY STUDY OF A IMAGE ANALYSIS SETUP APPROACH OF THERMAL TRACING JET ENGINE PARTS USING THERMAL PAINTS

  2020cites this paper
• Dynamic Task Sharing for Flexible Human-Robot Teaming under Partial Workspace Observability

  2020cites this paper
• Example of a problem-to-course life cycle in layout and process planning at the MTA SZTAKI learning factories

  2019cites this paper
• Costing models for capacity optimization in Industry 4.0: Trade-off between used capacity and operational efficiency

  2017cites this paper