Smart Camera Networks in Virtual Reality

This paper presents our research towards smart camera networks capable of carrying out advanced surveillance tasks with little or no human supervision. A unique centerpiece of our work is the combination of computer graphics, artificial life, and computer vision simulation technologies to develop such networks and experiment with them. Specifically, we demonstrate a smart camera network comprising static and active simulated video surveillance cameras that provides extensive coverage of a large virtual public space, a train station populated by autonomously self-animating virtual pedestrians. The realistically simulated network of smart cameras performs persistent visual surveillance of individual pedestrians with minimal intervention. Our innovative camera control strategy naturally addresses camera aggregation and handoff, is robust against camera and communication failures, and requires no camera calibration, detailed world model, or central controller.

• Publication year

  2007

• Venue

  Proceedings of the IEEE

• Publication date

  2007-10-22

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/JPROC.2008.928932
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Smart Camera Networks in Virtual Reality Simulated smart cameras track the movement of simulated pedestrians in a simulated train station, allowing development of improved control strategies for smart camera networks.

  2008cited by this paper
• Smart Cameras and the Right to Privacy

  2008cited by this paper
• Distributed metric calibration of ad hoc camera networks

  2006cited by this paper
• Virtual Vision and Smart Camera Networks

  2006cited by this paper
• The role of groups in smart camera networks

  2006cited by this paper
• Influence of cultivation temperature on the ligninolytic activity of selected fungal strains

  2006cited by this paper
• A. and Q

  2006cited by this paper
• Learning Sensor Network Topology through Monte Carlo

  2005cited by this paper
• Adopt: asynchronous distributed constraint optimization with quality guarantees

  2005cited by this paper
• Autonomous pedestrians

  2005influential reference
• SensEye: a multi-tier camera sensor network

  2005cited by this paper
• Surveillance camera scheduling: a virtual vision approach

  2005cited by this paper
• Learning Sensor Network Topology through Monte Carlo Expectation Maximization

  2005cited by this paper
• IrisNet: an internet-scale architecture for multimedia sensors

  2005cited by this paper
• Nonparametric belief propagation for self-calibration in sensor networks

  2004cited by this paper
• A Formal Analysis and Taxonomy of Task Allocation in Multi-Robot Systems

  2004cited by this paper
• Scheduling an active camera to observe people

  2004cited by this paper
• Calibration of a reconfigurable array of omnidirectional cameras using a moving person

  2004cited by this paper
• Ad Hoc Wireless Networks: Architectures and Protocols

  2004cited by this paper
• Directed diffusion for wireless sensor networking

  2003cited by this paper
• Face cataloger: multi-scale imaging for relating identity to location

  2003cited by this paper
• A master-slave system to acquire biometric imagery of humans at distance

  2003cited by this paper
• Olympus: an ambient intelligence architecture on the verge of reality

  2003cited by this paper
• Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View

  2003cited by this paper
• Collaborative signal and information processing: an information-directed approach

  2003cited by this paper
• Perceptive agents and systems in virtual reality

  2003cited by this paper
• KNIGHT/spl trade/: a real time surveillance system for multiple and non-overlapping cameras

  2003cited by this paper
• Multi-views tracking within and across uncalibrated camera streams

  2003cited by this paper
• Synthetic Movies for Computer Vision Applications

  2003cited by this paper
• Mobile vision-based vehicle tracking and traffic control

  2002cited by this paper
• Information-Driven Dynamic Sensor Collaboration for Tracking Applications

  2002cited by this paper
• An active camera system for acquiring multi-view video

  2002cited by this paper
• Adaptive Resolution System for Distributed Surveillance

  2002cited by this paper
• Information-driven dynamic sensor collaboration

  2002cited by this paper
• Algorithms for cooperative multisensor surveillance

  2001cited by this paper
• I and i

  2001cited by this paper
• Upper bounds on the lifetime of sensor networks

  2001cited by this paper
• Distributed Constraint Satisfaction： Foundations of Cooperation in Multi - Agent Systems

  2001influential reference
• Distributed Constraint Satisfaction

  2000cited by this paper
• Real-time tracking of non-rigid objects using mean shift

  2000cited by this paper
• Intelligent environments and active camera networks

  2000cited by this paper
• Accurate and simple geometric calibration of multi-camera systems

  1999cited by this paper
• Animat Vision - Active Vision in Artificial Animals

  1999cited by this paper
• A System for Tracking and Recognizing Multiple People with Multiple Cameras

  1998cited by this paper
• Deinterlacing-an overview

  1998cited by this paper
• Computer graphics: Principles and practice

  1997cited by this paper
• A Survey of Tractable Constraint Satisfaction Problems

  1997cited by this paper
• A combined Lagrangian, linear programming, and implication heuristic for large-scale set partitioning problems

  1996cited by this paper
• Color indexing

  1991cited by this paper
• The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver

  1980cited by this paper
• `` Strong '' NP-Completeness Results: Motivation, Examples, and Implications

  1978cited by this paper
• The ALOHA system

  1974influential reference
• THE ALOHA SYSTEM: another alternative for computer communications

  1899cited by this paper
• AND T

  year unknowncited by this paper

• Cooperative Inference for Real-Time 3D Human Pose Estimation in Multi-Device Edge Networks

  2025cites this paper
• mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Framework

  2025cites this paper
• CAMAOT: Channel-Aware Multi-Camera Active Object Tracking System

  2024cites this paper
• ERMVP: Communication-Efficient and Collaboration-Robust Multi-Vehicle Perception in Challenging Environments

  2024cites this paper
• Recent advances in imaging devices: image sensors and neuromorphic vision sensors

  2024cites this paper
• Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning

  2024cites this paper
• DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptions

  2024cites this paper
• Effi-MAOT: A Communication-Efficient Multi-Camera Active Object Tracking

  2023cites this paper
• Proactive Multi-Camera Collaboration For 3D Human Pose Estimation

  2023cites this paper
• VR-Surv: a VR-Based Privacy Preserving Surveillance System

  2022cites this paper
• A Novel Vehicle Detection Framework Based on Parallel Vision

  2022cites this paper
• Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Maps

  2022cites this paper
• Meta-simulation for the Automated Design of Synthetic Overhead Imagery

  2022cites this paper
• SIMPL: Generating Synthetic Overhead Imagery to Address Zero-shot and Few-Shot Detection Problems

  2021cites this paper
• A parallel vision approach to scene-specific pedestrian detection

  2020cites this paper
• The Synthinel-1 dataset: a collection of high resolution synthetic overhead imagery for building segmentation

  2020cites this paper
• Novel Software Modeling Technique for Surveillance System

  2020cites this paper
• When2com: Multi-Agent Perception via Communication Graph Grouping

  2020cites this paper
• Door and Doorway Etiquette for Virtual Humans

  2020cites this paper
• Towards Resource-Aware Hybrid Camera Systems

  2018cites this paper
• Robust feature extraction algorithm suitable for real-time embedded applications

  2018cites this paper
• Optimizing the Detection Performance of Smart Camera Networks Through a Probabilistic Image-Based Model

  2018cites this paper
• Improvement of Railway Transportation System Using IoT Applications and Services

  2018cites this paper
• 5 Stereo Vision in Smart Camera Networks

  2018cites this paper
• Scene-Specific Pedestrian Detection Based on Parallel Vision

  2017cites this paper
• A Virtual Proctor with Biometric Authentication for Facilitating Distance Education

  2017cites this paper
• Parallel vision for perception and understanding of complex scenes: methods, framework, and perspectives

  2017influential citation
• Configurable 3D Scene Synthesis and 2D Image Rendering with Per-pixel Ground Truth Using Stochastic Grammars

  2017cites this paper
• Establishing symmetric connectivity in directional wireless sensor networks equipped with 2π/3\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-

  2017cites this paper
• Ant-Cams Network: a cooperative network model for silly cameras

  2016cites this paper
• Ant-Cam network: Demo

  2016cites this paper
• Large-scale surveillance system: detection and tracking of suspicious motion patterns in crowded traffic scenes

  2016cites this paper
• Distributed adaptive task allocation for energy conservation in camera sensor networks

  2015cites this paper
• Multi-Camera Coordination and Control in Surveillance Systems

  2015influential citation
• Resource-aware State Estimation in Visual Sensor Networks with Dynamic Clustering

  2015influential citation
• Resource-Aware Dynamic Clustering Utilizing State Estimation in Visual Sensor Networks

  2015cites this paper
• A camera uncertainty model for collaborative visual sensor network applications

  2015cites this paper
• Implementation of Image Segmentation Using RGB Color Detection on Virtual Reality Robot as Spy Tool

  2014cites this paper
• What Do I See? Modeling Human Visual Perception for Multi-person Tracking

  2014cites this paper
• Simulation for pre-visualizing and tuning lighting controller behavior

  2014cites this paper
• Demo: VSNsim - A Simulator for Control and Coordination in Visual Sensor Networks

  2014cites this paper
• Efficient Depth Map Estimation Method Based on Gradient Weight Cost Aggregation Strategy for Distributed Video Sensor Networks

  2014cites this paper
• VISTA: achieving cumulative VIsion through energy efficient Silhouette recognition of mobile Targets through collAboration of visual sensor nodes

  2014cites this paper
• Computer Vision – ECCV 2014

  2014influential citation
• Virtual Vision for Camera Networks Research

  2014cites this paper
• Attentive Monitoring of Multiple Video Streams Driven by a Bayesian Foraging Strategy

  2014cites this paper
• Software Laboratory for Camera Networks Research

  2013cites this paper
• Energy-aware and robust task (re)assignment in embedded smart camera networks

  2013cites this paper
• Altruistic Coalition Formation in Cooperative Wireless Networks

  2013cites this paper
• A Sparse Representation-Based Deployment Method for Optimizing the Observation Quality of Camera Networks

  2013cites this paper
• Intelligent Multimedia Surveillance

  2013influential citation
• Object Video Streams: A Framework for Preserving Privacy in Video Surveillance

  2013cites this paper
• A Novel Architecture of Smart Camera

  2013cites this paper
• Coverage algorithms for visual sensor networks

  2013cites this paper
• A Virtual Vision Simulator for Camera Networks Research

  2012influential citation
• Detection and Simulation of Dangerous Human Crowd Behavior

  2012cites this paper
• A Survey on Extrinsic Self-calibration Algorithms for Cameras without Overlapping Field of Views: A Survey on Extrinsic Self-calibration Algorithms for Cameras without Overlapping Field of Views

  2012cites this paper
• Modeling and Optimizing the Coverage of Multi-Camera Systems

  2012cites this paper
• Simulator for studying resource allocation in reconfigurable multi-sensor networks

  2012cites this paper
• Sector Based Scanning and Adaptive Active Tracking of Multiple Objects

  2011cites this paper
• Handbook of Face Recognition, 2nd Edition

  2011cites this paper
• Demo: A distributed virtual vision simulator

  2011cites this paper
• Multi-tasking smart cameras for intelligent video surveillance systems

  2011cites this paper
• Analysis of Vision systems and Taxonomy Formulation : An abstract model for generalization

  2011cites this paper
• Proactive PTZ Camera Control

  2011cites this paper
• Chapter 14 Face Recognition at a Distance

  2011cites this paper
• Visualization of Automated and Manual Trajectories in Wide-Area Motion Imagery

  2011cites this paper
• Resource-Aware Coverage and Task Assignment in Visual Sensor Networks

  2011cites this paper
• Face Recognition at a Distance

  2011cites this paper
• Systems and algorithms for autonomous and scalable crowd surveillance using robotic PTZ cameras assisted by a wide-angle camera

  2010cites this paper
• A Survey of Distributed Computer Vision Algorithms

  2010cites this paper
• Collaborative sensing via local negotiations in ad hoc networks of smart cameras

  2010cites this paper
• Linear production game solution to a PTZ camera network

  2010cites this paper
• Maximizing Lifetime of Sensor Surveillance Systems with Directional Sensors

  2010cites this paper
• PROACTIVE PTZ CAMERA CONTROL A Cognitive Sensor Network That Plans Ahead

  2010cites this paper
• On the role of negotiations in ad hoc networks of smart cameras

  2010cites this paper
• Virtual Vision: Simulating Camera Networks in Virtual Reality for Surveillance System Design and Evaluation

  2009cites this paper
• Template Matching Techniques in Computer Vision

  2009cites this paper
• A 3D object model for wireless camera networks with network constraints

  2009cites this paper
• Planning ahead for PTZ camera assignment and handoff

  2009cites this paper
• Object-Video Streams for Preserving Privacy in Video Surveillance

  2009cites this paper
• Template Matching Techniques in Computer Vision: Theory and Practice

  2009cites this paper
• Artificial Life and Biomechanical Simulation of Humans

  2009cites this paper
• Stereo Vision in Smart Camera Networks

  2008cites this paper
• Simulated smart cameras track the movement of simulated pedestrians in 4 a simulated train station , allowing development of improved 5 control strategies for smart camera networks

  2008cites this paper
• Towards an intelligent tele-surveillance system for public transport areas: Fuzzy logic based camera control

  2008cites this paper
• Deploying Directional Sensor Networks with Guaranteed Connectivity and Coverage

  2008cites this paper
• Ieee Transactions on Communications, Accepted for Publication 1 Altruistic Coalition Formation in Cooperative Wireless Networks

  year unknowncites this paper