Virtual Shadow Rendering for Maintaining Situation Awareness in Proximal Human-Robot Teaming

One focus of augmented reality (AR) in robotics has been on enriching the interface for human-robot interaction. While such an interface is often made intuitive to interact with, it invariably imposes novel objects into the environment. In situations where the human already has a focus, such as in a human-robot teaming task, these objects can potentially overload our senses and lead to degraded teaming performance. In this paper, we propose using AR objects to solely augment natural objects to avoid disrupting our natural senses while adding critical information about the current situation. In particular, our case study focuses on addressing the limited field of view of humans by incorporating persistent virtual shadows of robots for maintaining situation awareness in proximal human-robot teaming tasks.

• Publication year

  2021

• Venue

  IEEE/ACM International Conference on Human-Robot Interaction

• Publication date

  2021-03-08

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1145/3434074.3447221
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Augmented reality support for self-service automated systems

  2020cited by this paper
• Body Language in Affective Human-Robot Interaction

  2020cited by this paper
• Reinforcement learning for facilitating human-robot-interaction in manufacturing

  2020cited by this paper
• Birds vs. Fish: Visualizing Out-of-View Objects in Augmented Reality using 3D Minimaps

  2019cited by this paper
• Sound as Implicit Influence on Human-Robot Interactions

  2018cited by this paper
• Augmented Reality Applications

  2018cited by this paper
• Trends in Educational Augmented Reality Studies: A Systematic Review

  2018cited by this paper
• How Facial Expressions and Small Talk May Influence Trust in a Robot

  2016cited by this paper
• Projecting robot intentions into human environments

  2016cited by this paper
• Real-Time Holographic Tracking and Control of Microrobots

  2016cited by this paper
• Augmented Reality (AR) Applications for Supporting Human-robot Interactive Cooperation

  2016cited by this paper
• Augmented Reality : Applications , Challenges and Future Trends

  2014cited by this paper
• Augmented reality in medical education?

  2014cited by this paper
• Interactive Team Cognition

  2013cited by this paper
• Auditory display design for exploration in mobile audio-augmented reality

  2012cited by this paper
• Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret

  2009cited by this paper
• Fast Non-Rigid Surface Detection, Registration and Realistic Augmentation

  2008cited by this paper
• An Augmented Reality System for Military Operations in Urban Terrain

  2002cited by this paper
• Estimation of multiple directional light sources for synthesis of augmented reality images

  2002cited by this paper

• Promoting Human–Robot Team Effectiveness: Shared Mental Models and Communication Improve Team Situation Awareness and Performance

  2026cites this paper
• Active Shadowing (ASD): Manipulating Visual Perception of Robotics Behaviors via Implicit Communication

  2024cites this paper
• Active Shadowing (ASD): Manipulating Perception of Robotic Behaviors via Implicit Virtual Communication

  2024cites this paper
• Experience-based Learning and Adaptive Behavior for Improved Situation-Awareness of a Social Robot

  2024cites this paper
• Improving Responsiveness to Robots for Tacit Human-Robot Interaction via Implicit and Naturalistic Team Status Projection

  2023cites this paper
• Implicit Projection: Improving Team Situation Awareness for Tacit Human-Robot Interaction via Virtual Shadows

  2023cites this paper
• Augmented reality and brain-computer interfaces for human-robot collaboration in manufacturing contexts

  2022cites this paper
• When And Where Are You Going? A Mixed-Reality Framework for Human Robot Collaboration

  2022cites this paper
• Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces

  2022cites this paper
• A Tool for Organizing Key Characteristics of Virtual, Augmented, and Mixed Reality for Human–Robot Interaction Systems: Synthesizing VAM-HRI Trends and Takeaways

  2021cites this paper
• TOKCS: Tool for Organizing Key Characteristics of VAM-HRI Systems

  2021influential citation