An optimal control approach for the persistent monitoring problem

We propose an optimal control framework for persistent monitoring problems where the objective is to control the movement of mobile agents to minimize an uncertainty metric in a given mission space. For a single agent in a one-dimensional space, we show that the optimal solution is obtained in terms of a sequence of switching locations, thus reducing it to a parametric optimization problem. Using Infinitesimal Perturbation Analysis (IPA) we obtain a complete solution through a gradient-based algorithm. We illustrate our approach with numerical examples.

• Publication year

  2011

• Venue

  IEEE Conference on Decision and Control and European Control Conference

• Publication date

  2011-08-16

• Fields of study

  Mathematics, Computer Science, Engineering

• Identifiers
  DOI 10.1109/CDC.2011.6160379arXiv 1202.6110
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Stochastic Hybrid Systems

  2013cited by this paper
• Perturbation analysis of stochastic hybrid systems and applications to resource contention games

  2011cited by this paper
• Persistent ocean monitoring with underwater gliders: Adapting sampling resolution

  2011cited by this paper
• Persistent Robotic Tasks: Monitoring and Sweeping in Changing Environments

  2011cited by this paper
• Persistent monitoring of changing environments using a robot with limited range sensing

  2011cited by this paper
• Persistent ocean monitoring with underwater gliders: Towards accurate reconstruction of dynamic ocean processes

  2011cited by this paper
• Perturbation Analysis and Optimization of Stochastic Hybrid Systems

  2010influential reference
• A Unified Approach to Infinitesimal Perturbation Analysis in Stochastic Flow Models: The Single-Stage Case

  2010cited by this paper
• Persistent Surveillance Using Multiple Unmanned Air Vehicles

  2008cited by this paper
• A realistic model of frequency-based multi-robot polyline patrolling

  2008cited by this paper
• Multi-robot area patrol under frequency constraints

  2007cited by this paper
• On persistent coverage control

  2007cited by this paper
• On the Hybrid Optimal Control Problem: Theory and Algorithms

  2007cited by this paper
• Cooperative air and ground surveillance

  2006cited by this paper
• Transition-time optimization for switched-mode dynamical systems

  2006cited by this paper
• A Cooperative receding horizon controller for multivehicle uncertain environments

  2006cited by this paper
• Limited communication, multi-robot team based coverage

  2004cited by this paper
• Perturbation analysis and optimization of stochastic flow networks

  2004cited by this paper
• Border patrol and surveillance missions using multiple unmanned air vehicles

  2004cited by this paper
• Optimal control of switched systems based on parameterization of the switching instants

  2004cited by this paper
• Coverage control for mobile sensing networks

  2002cited by this paper
• Coverage control for mobile sensing networks

  2002cited by this paper
• Optimization: Algorithms and Consistent Approximations

  1997cited by this paper
• Stochastic and Dynamic Vehicle Routing in the Euclidean Plane with Multiple Capacitated Vehicles

  1993cited by this paper
• Introduction to Queuing Theory

  1989cited by this paper
• Applied optimal control

  1972cited by this paper
• This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY 1 Cooperative Control for Ocean Sampling: The Glider Coordinat

  year unknowncited by this paper

• Accelerated Decision Making for Distributed Network Estimation Problems

  2025cites this paper
• A Bilevel Optimization Scheme for Persistent Monitoring

  2023cites this paper
• Bounds on Optimal Revisit Times in Persistent Monitoring Missions With a Distinct and Remote Service Station

  2023cites this paper
• Age Optimal Information Gathering and Dissemination on Graphs

  2023cites this paper
• Radial basis function-based vector field algorithm for wildfire boundary tracking with UAVs

  2022influential citation
• Vector Field based Control of Quadrotor UAVs for Wildfire Boundary Monitoring

  2022cites this paper
• Optimal UAV Route Planning for Persistent Monitoring Missions

  2021cites this paper
• Bounds on Optimal Revisit Times in Persistent Monitoring Missions with a Distinct \& Remote Service Station

  2021cites this paper
• Age-of-Information based Beacon Scheduling in the Internet-of-Vehicles

  2020cites this paper
• Collision-free and crossing-free trajectory design for second-order agents persistent monitoring

  2020cites this paper
• Age Optimal Information Gathering and Dissemination on Graphs

  2019cites this paper
• On Sensing, Agility, and Computation Requirements for a Data-gathering Agile Robotic Vehicle

  2017cites this paper
• Vers une interaction humain-robot à une initiative mixe : une équipe coopérative composée par des drones et un opérateur humain

  2017cites this paper
• Monitoring using Heterogeneous Autonomous Agents

  2015cites this paper
• Cooperative Surveillance and Pursuit Using Unmanned Aerial Vehicles and Unattended Ground Sensors

  2015cites this paper
• Aerial Vehicle Path Planning for Monitoring Wildfire Frontiers

  2015cites this paper
• On maximum-reward motion in stochastic environments

  2015cites this paper
• An Optimal Control Approach to the Multi-Agent Persistent Monitoring Problem in Two-Dimensional Spaces

  2015cites this paper
• Learning and monitoring of spatio-temporal fields with sensing robots

  2015cites this paper
• Deterministic Decision Making

  2014cites this paper
• The Multiple Unmanned Air Vehicle Persistent Surveillance Problem: A Review

  2014cites this paper
• Optimal control approaches for persistent monitoring problems.

  2014cites this paper
• Formulation of control strategies for requirement definition of multi-agent surveillance systems

  2014cites this paper
• Lower Bounding Linear Program for the Perimeter Patrol Optimization Problem

  2014cites this paper
• Planning periodic persistent monitoring trajectories for sensing robots in Gaussian Random Fields

  2013cites this paper
• An optimal control approach to the multi-agent persistent monitoring problem in two-dimensional spaces

  2013cites this paper
• Collaborative path planning for event search and exploration in mixed sensor networks

  2013cites this paper
• Persistent visitation under revisit constraints

  2013cites this paper
• Optimal Control of Multi-agent Persistent Monitoring Systems with Performance Constraints

  2013influential citation
• An Optimal Control Approach to the Multi-Agent Persistent Monitoring Problem

  2012cites this paper
• Empty Container Management in Multi-Port System with Inventory-based Control

  2012cites this paper
• Cooperative Patrolling via Weighted Tours: Performance Analysis and Distributed Algorithms

  2012cites this paper
• Persistent monitoring in discrete environments: Minimizing the maximum weighted latency between observations

  2012cites this paper