Surveillance in Virtual Reality: System Design and Multi-Camera Control

This paper advocates a virtual vision paradigm and demonstrates its usefulness in camera sensor network research. Virtual vision prescribes the use of a visually and behaviorally realistic virtual environment simulator in the design and evaluation of surveillance systems. Impediments to deploying and experimenting with appropriately complex camera networks makes virtual vision an attractive alternative for many vision researchers who are motivated to investigate high level multi-camera control issues within such networks. In particular, we present two prototype surveillance systems comprising passive and active pan/tilt/zoom cameras. We deploy these systems in a virtual train station environment populated by autonomous, lifelike virtual pedestrians. The easily reconfigurable virtual cameras situated throughout this environment generate synthetic video feeds that emulate those acquired by real surveillance cameras monitoring extensive public spaces. Our novel multi-camera control strategies enable the cameras to collaborate in persistently observing pedestrians of interest that move across their fields of view and in capturing close-up videos of pedestrians as they travel through designated areas. The sensor networks support task-dependent camera node selection and aggregation through local decision-making and inter-node communication. Our approach to multi-camera control is robust to node failures and message loss.

• Publication year

  2007

• Venue

  2007 IEEE Conference on Computer Vision and Pattern Recognition

• Publication date

  2007-06-01

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/CVPR.2007.383071
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Autonomous pedestrians

  2005cited by this paper
• Towards intelligent camera networks: a virtual vision approach

  2005cited by this paper
• Calibration of a reconfigurable array of omnidirectional cameras using a moving person

  2004cited by this paper
• Scheduling an active camera to observe people

  2004cited by this paper
• A master-slave system to acquire biometric imagery of humans at distance

  2003cited by this paper
• Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View

  2003cited by this paper
• Multi-views tracking within and across uncalibrated camera streams

  2003cited by this paper
• Perceptive agents and systems in virtual reality

  2003cited by this paper
• Face cataloger: multi-scale imaging for relating identity to location

  2003cited by this paper
• Scheduling Multiclass Packet Streams to Minimize Weighted Loss

  2002cited by this paper
• An active camera system for acquiring multi-view video

  2002cited by this paper
• Approximating the Throughput of Multiple Machines in Real-Time Scheduling

  2002cited by this paper
• Algorithms for cooperative multisensor surveillance

  2001cited by this paper
• Accurate and simple geometric calibration of multi-camera systems

  1999cited by this paper
• A Survey of Tractable Constraint Satisfaction Problems

  1997cited by this paper
• Scheduling real-time traffic in ATM networks

  1996cited by this paper

• Digital Decision Support Tools in EdTech Testing and Evaluation for Developing Countries

  2024cites this paper
• Meta-simulation for the Automated Design of Synthetic Overhead Imagery

  2022cites this paper
• VR-Surv: a VR-Based Privacy Preserving Surveillance System

  2022cites this paper
• Take the Field from Your Smartphone: Leveraging UAVs for Event Filming

  2020cites this paper
• Dynamic Camera Reconfiguration with Reinforcement Learning and Stochastic Methods for Crowd Surveillance †

  2020cites this paper
• An Unmanned Aerial Vehicle Network for Sport Event Filming with Communication Constraints

  2020cites this paper
• Synthetic Data for Deep Learning

  2019cites this paper
• Tracking The Distributed Camera Networks Through Using Kalman

  2019cites this paper
• Active target tracking: A simplified view aligning method for binocular camera model

  2018cites this paper
• RFIDCam: a RFID-Aided Visual Tracking System

  2018cites this paper
• Virtual camera modeling for multi-view simulation of surveillance scenes

  2018cites this paper
• Dynamic Camera Network Reconfiguration for Crowd Surveillance

  2018cites this paper
• Multi-Camera Active-Vision for Markerless Shape Recovery of Unknown Deforming Objects

  2018cites this paper
• Towards automatic broadcast of team sports

  2018cites this paper
• Optical Flow Dataset and Benchmark for Visual Crowd Analysis

  2018cites this paper
• Training my car to see using virtual worlds

  2017cites this paper
• A biobjective formulation for filming sport events problem using drones

  2017cites this paper
• Camera Self-Calibration Based on Nonlinear Optimization and Applications in Surveillance Systems

  2017cites this paper
• Optimization of camera-laser measurement system

  2016cites this paper
• The Multi-strand Graph for a PTZ Tracker

  2015cites this paper
• 3D virtual modeling for crowd analysis

  2015cites this paper
• Cooperative Target Tracking in Dual-Camera System with Bidirectional Information Fusion

  2015cites this paper
• Execution Behavior Modeling Methodology for Large Scale Surveillance System Design and Evaluation

  2014cites this paper
• A Measure of Vision Distance for Optimization of Camera Networks

  2014cites this paper
• An Overview of Distributed Tracking and Control in Camera Networks

  2014cites this paper
• Using the Agoraset dataset: Assessing for the quality of crowd video analysis methods

  2014cites this paper
• Moving Target Detection and Active Tracking with a Multicamera Network

  2014cites this paper
• A practical approach for active camera coordination based on a fusion-driven multi-agent system

  2014cites this paper
• Distributed Constrained Bayesian Optimization: Autonomous Camera Control

  2013cites this paper
• Contributions aux schémas d'Analyse/Synthèse en Animation par ordinateur. (Contributions to Analysis/Synthesis Schemes in Computer Animation)

  2013cites this paper
• Looking at Faces: Detection, Tracking and Pose Estimation

  2013cites this paper
• Automated Camera Selection and Control for Better Training Support

  2013cites this paper
• Coordinated Sensing in Intelligent Camera Networks

  2013cites this paper
• Two Families of Algorithms to Film Sport Events with Flying Robots

  2013cites this paper
• AGORASET: a dataset for crowd video analysis

  2012cites this paper
• Collaborative Sensing in a Distributed PTZ Camera Network

  2012cites this paper
• EMOTE V IEW S YSTEM WITH AN O MNIDIRECTIONAL C AMERA

  2012cites this paper
• High-Resolution Performance Capture by Zoom-in Pan-Tilt Cameras

  2012cites this paper
• Camera Networks: The Acquisition and Analysis of Videos over Wide Areas

  2012cites this paper
• Modeling and Optimizing the Coverage of Multi-Camera Systems

  2012cites this paper
• A WALKTHROUGH REMOTE VIEW SYSTEM WITH AN OMNIDIRECTIONAL CAMERA

  2012cites this paper
• Video auto stitching in multicamera surveillance system

  2012influential citation
• Active multi-camera navigation in video surveillance systems

  2012cites this paper
• A Survey on Extrinsic Self-calibration Algorithms for Cameras without Overlapping Field of Views: A Survey on Extrinsic Self-calibration Algorithms for Cameras without Overlapping Field of Views

  2012cites this paper
• Filming Sport Events with Mobile Camera Drones: Mathematical Modeling and Algorithms

  2012cites this paper
• Optimized imaging and target tracking within a distributed camera network

  2011cites this paper
• Sector Based Scanning and Adaptive Active Tracking of Multiple Objects

  2011cites this paper
• A CSP solution to multi-camera surveillance and target tracking

  2011cites this paper
• Distributed Wide Area Scene Analysis in Reconfigurable Camera Networks

  2011cites this paper
• Handbook of Face Recognition, 2nd Edition

  2011cites this paper
• TelosCAM: Identifying Burglar through Networked Sensor-Camera Mates with Privacy Protection

  2011cites this paper
• Persistent Observation of Dynamic Scenes in an Active Camera Network

  2011cites this paper
• Wide Area Tracking in Single and Multiple Views

  2011cites this paper
• Distributed Consensus Algorithms for Image-Based Localization in Camera Sensor Networks

  2011cites this paper
• Feature seeding for action recognition

  2011cites this paper
• (Integrated sensing and analysis for wide-area scene understanding )

  2011cites this paper
• Gaze directed camera control for face image acquisition

  2011cites this paper
• Active visual scene exploration

  2011influential citation
• On-line control of active camera networks for computer vision tasks

  2011cites this paper
• Beyond the Static Camera: Issues and Trends in Active Vision

  2011cites this paper
• Face Recognition at a Distance

  2011cites this paper
• 2 Beyond the Static Camera : Issues and Trends in Active Vision 13 2 . 2 Active Camera Configurations

  2011cites this paper
• Distributed Camera Networks

  2011influential citation
• Chapter 14 Face Recognition at a Distance

  2011cites this paper
• Multi-camera Scheduling for Video Production

  2011influential citation
• Panoramic video stitching in multi-camera surveillance system

  2010cites this paper
• Probabilistic surveillance with multiple active cameras

  2010cites this paper
• Linear production game solution to a PTZ camera network

  2010cites this paper
• Tracking and Activity Recognition Through Consensus in Distributed Camera Networks

  2010cites this paper
• Adaptive online camera coordination for multi-camera multi-target surveillance

  2010cites this paper
• On-line control of active camera networks

  2010cites this paper
• A distributed camera system for multi-resolution surveillance

  2009cites this paper
• Virtual Vision: Simulating Camera Networks in Virtual Reality for Surveillance System Design and Evaluation

  2009cites this paper
• Multi-Camera Tracking Based on Information Fusion in Video Surveillance

  2009cites this paper
• Surprisal-aware scheduling of PTZ cameras

  2009cites this paper
• Content and task-based view selection from multiple video streams

  2009cites this paper
• Distributed multi-target tracking in a self-configuring camera network

  2009cites this paper
• Information-theoretic Decision Making for Exploration of Dynamic Scenes

  2008cites this paper
• Localization and mapping of surveillance cameras in city map

  2008cites this paper
• Information-theoretic active scene exploration

  2008cites this paper
• Robust Tracking in A Camera Network: A Multi-Objective Optimization Framework

  2008cites this paper
• Influence of zoom selection on a Kalman filter

  2008cites this paper
• ViHASi: Virtual human action silhouette data for the performance evaluation of silhouette-based action recognition methods

  2008cites this paper
• Multi-target tracking through opportunistic camera control in a resource constrained multimodal sensor network

  2008cites this paper
• Multi-camera Control through Constraint Satisfaction for Persistent Surveillance

  2008cites this paper
• Content-aware ranking of video segments

  2008cites this paper
• Cooperative surveillance of multiple targets using mutual information

  2008cites this paper
• Decentralized camera network control using game theory

  2008cites this paper
• Cooperative

  1950cites this paper