Statistical modeling and performance characterization of a real-time dual camera surveillance system

The engineering of computer vision systems that meet application specific computational and accuracy requirements is crucial to the deployment of real-life computer vision systems. This paper illustrates how past work on a systematic engineering methodology for vision systems performance characterization can be used to develop a real-time people detection and zooming system to meet given application requirements. We illustrate that by judiciously choosing the system modules and performing a careful analysis of the influence of various tuning parameters on the system it is possible to: perform proper statistical inference, automatically set control parameters and quantify limits of a dual-camera real-time video surveillance system. The goal of the system is to continuously provide a high resolution zoomed-in image of a person's head at any location of the monitored area. An omni-directional camera video is processed to detect people and to precisely control a high resolution foveal camera, which has pan, tilt and zoom capabilities. The pan and tilt parameters of the foveal camera and its uncertainties are shown to be functions of the underlying geometry, lighting conditions, background color/contrast, relative position of the person with respect to both cameras as well as sensor noise and calibration errors. The uncertainty in the estimates is used to adaptively estimate the zoom parameter that guarantees with a user specified probability, /spl alpha/, that the detected person's face is contained and zoomed within the image.

• Publication year

  2000

• Venue

  Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662)

• Publication date

  2000-06-12

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/CVPR.2000.854840
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Real-time tracking of non-rigid objects using mean shift

  2000cited by this paper
• Adaptive background mixture models for real-time tracking

  1999cited by this paper
• Advances in Cooperative Multi-Sensor Video Surveillance

  1999cited by this paper
• A Computational Model for Visual Selection

  1999cited by this paper
• Indoor monitoring via the collaboration between a peripheral sensor and a foveal sensor

  1998cited by this paper
• Omnidirectional Vision Systems: 1998 PI Report

  1998cited by this paper
• Performance Assessment Through Bootstrap

  1997cited by this paper
• LAFTER: lips and face real time tracker

  1997cited by this paper
• Omnidirectional Video Camera

  1997cited by this paper
• Stochastic Geometry and Its Applications

  1996cited by this paper
• Face locating and tracking for human-computer interaction

  1994cited by this paper
• Machine vision applications

  1991cited by this paper

• Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attack

  2023cites this paper
• Risk-Driven Design of Perception Systems

  2022cites this paper
• Auto-Colorization of Images: Fuzzy c-Means and SLIC Approaches

  2021cites this paper
• Multimodal background subtraction for high-performance embedded systems

  2019cites this paper
• Particle Filtering for Tracking in 360 Degrees Videos Using Virtual PTZ Cameras

  2019cites this paper
• Superpixel Segmentation Based Synthetic Classifications with Clear Boundary Information for a Legged Robot

  2018cites this paper
• Face tracking using a combination of colour and pattern matching based on particle filter

  2016cites this paper
• Face modeling for face recognition in the wild.

  2015cites this paper
• Comparative Analysis of Traditional Methods for Moving Object Detection in Video Sequence

  2015cites this paper
• Feature Points Based Video Object Tracking for Dynamic Scenes and Its FPGA System Prototyping

  2014cites this paper
• Improvement of Tracking Performance of Particle Filter in Low Frame Rate Video

  2014cites this paper
• Detect foreground objects via adaptive fusing model in a hybrid feature space

  2014cites this paper
• Moving object tracking using particle filter and observational model based on multi-feature composition

  2014cites this paper
• A novel background subtraction method based on color invariants and grayscale levels

  2014influential citation
• Motion detection for video surveillance

  2014cites this paper
• A 3D-Based Pose Invariant Face Recognition at a Distance Framework

  2014cites this paper
• A novel background subtraction method based on color invariants

  2013cites this paper
• Static hand gesture segmentation for images with complex background; detection and tracking of dynamic hand gesture

  2013cites this paper
• A Block Matching Technique for Object Tracking Based on Peripheral Increment Sign Correlation Image

  2012cites this paper
• Passive single image-based approach for camera steering in face recognition at-a-distance applications

  2012cites this paper
• Target Detection Algorithm Based on the Movement of Codebook Model

  2012cites this paper
• Adaptive Background Modeling Integrated With Luminosity Sensors and Occlusion Processing for Reliable Vehicle Detection

  2011cites this paper
• Labeling hypergraph-structured data using markov network

  2011cites this paper
• Active visual scene exploration

  2011cites this paper
• Face Recognition at a Distance

  2011cites this paper
• Robust Vehicle Tracking Multi-feature Particle Filter

  2011cites this paper
• Chapter 14 Face Recognition at a Distance

  2011cites this paper
• Gaze directed camera control for face image acquisition

  2011cites this paper
• Face detection and tracking in real time sequence of images independent of environment illumination

  2011cites this paper
• Handbook of Face Recognition, 2nd Edition

  2011cites this paper
• Face recognition at a distance system for surveillance applications

  2010cites this paper
• Scene modeling and change detection in dynamic scenes: A subspace approach

  2009cites this paper
• Real Time Multiple Object Tracking Using Tracking Matrix

  2009cites this paper
• A compactmodular active vision system formulti-target surveillance

  2009cites this paper
• Omnidirectional Surveillance System for Digital Home Security

  2009cites this paper
• Occlusion-handling for improved particle filtering-based tracking

  2009cites this paper
• Content and task-based view selection from multiple video streams

  2009cites this paper
• Tracking in sparse multi-camera setups using stereo vision

  2009cites this paper
• Robust Color Appearance-Guided Particle Filter for Object Tracking

  2009cites this paper
• Notice of RetractionObject Tracking by Mean Shift Based on Color Distribution and Simulated Annealing

  2009cites this paper
• Notice of RetractionParticle Filter Tracking Algorithm Based on Multi-Information Fusion

  2009influential citation
• Performance and energy consumption optimization by tuning level-2 cache attributes for real-time signal processing systems

  2009cites this paper
• Notice of Retraction Object Tracking by Mean Shift Based on Color Distribution and Simulated Annealing

  2009cites this paper
• A COMPACT MODULAR ACTIVE VISION SYSTEM FOR MULTI-TARGET SURVEILLANCE

  2009cites this paper
• Efficient mean shift tracking via particle swarm optimization for multi-articulated human body features

  2008cites this paper
• A practical algorithm for learning scene information from monocular video.

  2008cites this paper
• Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art

  2008cites this paper
• Adaptive Visual Tracking Using Particle Filter

  2008cites this paper
• A New Face Tracking Algorithm Based on Local Binary Pattern and Skin Color Information

  2008cites this paper
• Influence of zoom selection on a Kalman filter

  2008cites this paper
• Coopetitive multi-camera surveillance using model predictive control

  2008cites this paper
• A block matching technique for object tracking employing peripheral increment sign correlation image

  2008cites this paper
• A New Face Tracking Algorithm Based on Local Binary Pattern and Skin Color Information

  2008cites this paper
• Smart head restraint system

  2007cites this paper
• Pre-Attentive and Attentive Detection of Humans in Wide-Field Scenes

  2007cites this paper
• A Centralized Omnidirectional Multi-Camera System with Peripherally-Guided Active Vision and Depth Perception

  2007cites this paper
• Scene understanding with tri-training

  2007cites this paper
• A General Method for Sensor Planning in Multi-Sensor Systems: Extension to Random Occlusion

  2007cites this paper
• UPF Tracking Algorithm Based on Color Distribution and Simulated Annealing

  2007cites this paper
• Dual Camera Zoom Control: A Study of Zoom Tracking Stability

  2007cites this paper
• Seeing the world behind the image: Spatial layout for 3D scene understanding

  2007cites this paper
• Zoom techniques for achieving scale invariant object tracking in real-time active vision systems

  2007cites this paper
• An Adaptive Unscented Particle Filter Tracking Algorithm Based on Color Distribution and Wavelet Moment

  2007cites this paper
• Computer vision and pattern recognition

  2007cites this paper
• An Intensity-augmented Ordinal Measure for Visual Correspondence

  2006cites this paper
• Putting Objects in Perspective

  2006cites this paper
• Towards Face Recognition at a Distance

  2006cites this paper
• Saccade planning with an active zooming camera

  2006cites this paper
• Kalman-mean shift tracking algorithm based on wavelet moment

  2006cites this paper
• Towards on-line saccade planning for high-resolution image sensing

  2006cites this paper
• A Framework for Feature Selection for Background Subtraction

  2006cites this paper
• Real-time foreground-background segmentation using codebook model

  2005cites this paper
• Developing a Modular Active Spherical Vision System

  2005cites this paper
• Distant targets identification as an on-line dynamic vehicle routing problem using an active-zooming camera

  2005cites this paper
• Real-time vision at Siemens Corporate Research

  2005cites this paper
• Coopetitive visual surveillance using model predictive control

  2005cites this paper
• Pre-Attentive Face Detection for Foveated Wide-Field Surveillance

  2005influential citation
• Closeup-Imaging of a Moving Object by Cooperative Multiple Pan-Tilt Cameras

  2005cites this paper
• Acquisition of high-resolution images through on-line saccade sequence planning

  2005cites this paper
• Algorithms and evaluation for object detection and tracking in computer vision

  2005cites this paper
• PDR: A Performance Evaluation Method for Foreground-Background Segmentation Algorithms

  2005cites this paper
• Sudden illumination change detection using order consistency

  2004cites this paper
• Motion-based background subtraction using adaptive kernel density estimation

  2004cites this paper
• Omni-directional visual surveillance

  2004influential citation
• Stereo person tracking with adaptive plan-view templates of height and occupancy statistics

  2004cites this paper
• REDUCTION OF CAMERA MOTION ADJUSTMENTS UNDER A PLANNED VIDEO COMPOSITION WITH PAN-TILT CAMERA

  2003cites this paper
• Foveated observation of shape and motion

  2003cites this paper
• An adaptive color-based particle filter

  2003cites this paper
• Color features for tracking non-rigid objects

  2003cites this paper
• A Color-based Particle Filter

  2002cites this paper
• Adaptive Resolution System for Distributed Surveillance

  2002cites this paper
• Smart cameras with real-time video object generation

  2002cites this paper
• Stereo Person Tracking with Adaptive Plan-View Statistical Templates

  2002cites this paper
• Design, analysis, and engineering of video monitoring systems: an approach and a case study

  2001influential citation
• The systematic design and analysis cycle of a vision system: a case study in video surveillance

  2001cites this paper
• A MRF-based approach for real-time subway monitoring

  2001cites this paper
• Guest Editorial: Video Processing and Communications in Real-Time Surveillance Systems

  2001cites this paper
• Mixed Scale Motion Recovery Using Guidable Cameras

  2000cites this paper
• Robust detection and tracking of human faces with an active camera

  2000cites this paper