Enhanced PTZ Camera Dispatch Scheme for 3-D Environments Based on Deep Reinforcement Learning

In recent years, pan-tilt-zoom (PTZ) cameras with horizontal, vertical rotation, and zoom capabilities have enhanced the flexibility of fixed cameras. However, the existing research on PTZ cameras has not adequately addressed key monitoring requirements, such as viewing angle and resolution pixels per foot (PPF), often resulting in skewed perspectives or insufficient imaging quality. This study focuses on 3-D environments and aims to optimize PTZ camera dispatch for maximum target coverage while minimizing the number of cameras used. We formulate the problem as a mixed-integer linear programming problem, which is known to be NP-hard, and propose an intelligent solution using fast-prioritized experience deep Q-network (FPE-DDQN). This method leverages self-awareness and iterative learning to improve decision-making by incorporating past dispatch experiences and an innovative reward function design. FPE-DDQN prioritizes cameras based on their coverage potential and dispatch cost, significantly reducing the number of cameras needed while accelerating the adjustment of rotation angles and focal lengths. Experimental simulations demonstrate that FPE-DDQN achieves near-optimal coverage and dispatch efficiency, with the performance gap to the optimal solution being less than 0.52%–4.7%, while requiring only 1/10 to 1/100 of the computational time compared to the optimal solution.

• Publication year

  2025

• Venue

  IEEE Transactions on Instrumentation and Measurement

• Publication date

  Unknown publication date

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/TIM.2025.3548766
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A Flying Bird Object Detection Method for Surveillance Video

  2024cited by this paper
• Flocking of Under-Actuated Unmanned Surface Vehicles via Deep Reinforcement Learning and Model Predictive Path Integral Control

  2024cited by this paper
• Satellite Observation and Data-Transmission Scheduling Using Imitation Learning Based on Mixed Integer Linear Programming

  2023cited by this paper
• Flying Bird Object Detection Algorithm in Surveillance Video Based on Motion Information

  2023cited by this paper
• SpheriCol: A Driving Assistant for Power Wheelchairs Based on Spherical Vision

  2023cited by this paper
• QLP: Deep Q-Learning for Pruning Deep Neural Networks

  2022cited by this paper
• Joint Trajectory Design and BS Association for Cellular-Connected UAV: An Imitation-Augmented Deep Reinforcement Learning Approach

  2022cited by this paper
• Toward Optimal Deployment for Full-View Point Coverage in Camera Sensor Networks

  2022influential reference
• Coordinating Clearance and Postural Reorientation When Avoiding Physical and Virtual Pedestrians

  2022cited by this paper
• Distributed Coverage Hole Prevention for Visual Environmental Monitoring With Quadcopters Via Nonsmooth Control Barrier Functions

  2022influential reference
• A genetic algorithm-based approach for solving the target Q-coverage problem in over and under provisioned directional sensor networks

  2022cited by this paper
• Optimizing Node Deployment in Rechargeable Camera Sensor Networks for Full-View Coverage

  2022influential reference
• Coverage Enhance in Boundary Deployed Camera Sensor Networks for Airport Surface Surveillance

  2021cited by this paper
• A review of video surveillance systems

  2021cited by this paper
• Optimization of the Directional Sensor Networks With Rotatable Sensors for Target-Barrier Coverage

  2021cited by this paper
• 500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System

  2021cited by this paper
• Coverage Optimization of Multi-Camera for Deformable Contour Shapes

  2021cited by this paper
• A New Angle Coverage Scheduling Optimization Method for Heterogeneous Nodes in Directional Sensor Networks

  2020cited by this paper
• PTZ camera tuning for real time monitoring of cows in grazing fields

  2020cited by this paper
• Maximizing Camera Coverage in Multicamera Surveillance Networks

  2020cited by this paper
• Distributed Optimization of Visual Sensor Networks for Coverage of a Large-Scale 3-D Scene

  2020cited by this paper
• Edge Caching Replacement Optimization for D2D Wireless Networks via Weighted Distributed DQN

  2020cited by this paper
• A novel multi-objective optimization strategy for enhancing quality of service in IoT-enabled WSN applications

  2020cited by this paper
• Energy Efficient Transmission Power Control Policy of the Delay Tolerable Communication Service

  2020cited by this paper
• Deep reinforcement learning: a survey

  2020cited by this paper
• Dynamic Scheduling of an Autonomous PTZ Camera for Effective Surveillance

  2020cited by this paper
• Camera

  2019influential reference
• Deep Learning-based Visual Tracking of UAVs using a PTZ Camera System

  2019cited by this paper
• Orientation Optimization for Full-View Coverage Using Rotatable Camera Sensors

  2019influential reference
• Maximizing full-view target coverage in camera sensor networks

  2019influential reference
• Deep High-Resolution Representation Learning for Visual Recognition

  2019influential reference
• An efficient genetic algorithm for maximizing area coverage in wireless sensor networks

  2019cited by this paper
• Intelligent Physical Attack Against Mobile Robots With Obstacle-Avoidance

  2019cited by this paper
• A Visual Distance Approach for Multicamera Deployment With Coverage Optimization

  2018cited by this paper
• Differential Evolution-Based 3-D Directional Wireless Sensor Network Deployment Optimization

  2018cited by this paper
• Coverage Control of Sensor Networks in IoT Based on RPSO

  2018cited by this paper
• Maximizing heterogeneous coverage in over and under provisioned visual sensor networks

  2018cited by this paper
• Double Deep Q-Learning for Optimal Execution

  2018cited by this paper
• Coverage algorithms for visual sensor networks

  2013cited by this paper
• Depth of Field

  2007cited by this paper
• Coverage by directional sensors in randomly deployed wireless sensor networks

  2006cited by this paper

• A generalizable rapid multi-target capture framework based on a single conventional pan-tilt-zoom camera

  2026cites this paper
• Radius of Robust Feasibility for Ground Coverage in Aerial Sensor Networks

  2025cites this paper