An intelligent Cooperative Control Architecture

This paper presents an extension of existing cooperative control algorithms that have been developed for multi-UAV applications to utilize real-time observations and/or performance metric(s) in conjunction with learning methods to generate a more intelligent planner response. We approach this issue from a cooperative control perspective and embed elements of feedback control and active learning, resulting in an new intelligent Cooperative Control Architecture (iCCA). We describe this architecture, discuss some of the issues that must be addressed, and present illustrative examples of cooperative control problems where iCCA can be applied effectively.

• Publication year

  2010

• Venue

  Proceedings of the 2010 American Control Conference

• Publication date

  2010-07-01

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/ACC.2010.5530666
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Decentralized planning for complex missions with dynamic communication constraints

  2010cited by this paper
• Efficient Exploration in Reinforcement Learning

  2010cited by this paper
• Active Learning in Persistent Surveillance UAV Missions

  2009cited by this paper
• Consensus-Based Decentralized Auctions for Robust Task Allocation

  2009cited by this paper
• Neuro-Dynamic Programming

  2009cited by this paper
• Group health management of UAV teams with applications to persistent surveillance

  2008cited by this paper
• Human-in-the-loop vehicle routing policies for dynamic environments

  2008cited by this paper
• Experimental Demonstration of Adaptive MDP-Based Planning with Model Uncertainty

  2008cited by this paper
• Knows what it knows: a framework for self-aware learning

  2008cited by this paper
• Robust decision-making with model uncertainty in aerospace systems

  2008cited by this paper
• Incremental Natural Actor-Critic Algorithms

  2007cited by this paper
• A Robust Approach to the UAV Task Assignment Problem

  2006cited by this paper
• PPCP: Efficient Probabilistic Planning with Clear Preferences in Partially-Known Environments

  2006cited by this paper
• Advances in Neural Information Processing Systems 17: Proceedings of the 2004 Conference

  2006cited by this paper
• Convergence and No-Regret in Multiagent Learning

  2004cited by this paper
• Prioritized sweeping: Reinforcement learning with less data and less time

  2004cited by this paper
• Coordination in multiagent reinforcement learning: a Bayesian approach

  2003cited by this paper
• Planning in the Presence of Cost Functions Controlled by an Adversary

  2003cited by this paper
• A General Class of No-Regret Learning Algorithms and Game-Theoretic Equilibria

  2003cited by this paper
• Cooperative control and optimization

  2002cited by this paper
• Optimization of conditional value-at risk

  2000cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Planning and Acting in Partially Observable Stochastic Domains

  1998cited by this paper
• Ant colony system: a cooperative learning approach to the traveling salesman problem

  1997cited by this paper
• On the Complexity of Solving Markov Decision Problems

  1995cited by this paper
• Markov Decision Processes: Discrete Stochastic Dynamic Programming

  1994cited by this paper
• Dynamic Programming and Markov Processes

  1960cited by this paper

• Unmanned aerial vehicles using machine learning for autonomous flight; state-of-the-art

  2019cites this paper
• Autonomous UAV Navigation Using Reinforcement Learning

  2019cites this paper
• Information-driven Persistent Sensing of a Non-cooperative Mobile Target Using UAVs

  2017cites this paper
• Cooperative Control of Power System Load and Frequency by Using Differential Games

  2015cites this paper
• A Cooperative Control Method for Fully Mechanized Mining Machines Based on Fuzzy Logic Theory and Neural Networks

  2015cites this paper
• Improving cooperative tracking of an urban target with target motion model learning

  2015cites this paper
• An Automated Battery Management System to Enable Persistent Missions With Multiple Aerial Vehicles

  2015cites this paper
• Cooperative Mission Planning for Multi-UAV Teams

  2015cites this paper
• Cooperative control of interconnected power system load-frequency based on differential games

  2014cites this paper
• Information Consensus in Distributed Systems Under Local Communication and Switching Topologies

  2014cites this paper
• Intelligent Cooperative Control Architecture: A Framework for Performance Improvement Using Safe Learning

  2013cites this paper
• Cooperative Target Tracking Enhanced with the Sequence Memoizer

  2013cites this paper
• Dynamic Replanning for Multi-UAV Persistent Surveillance

  2013cites this paper
• Multiagent planning with Bayesian nonparametric asymptotics

  2013cites this paper
• Decentralized learning-based planning for multiagent missions in the presence of actuator failures

  2013cites this paper
• Intelligent Cooperative Control for Urban Tracking

  2013cites this paper
• Position-adaptive localization of an electro-magnetic source using static and mobile wireless sensor networks

  2013cites this paper
• Model estimation within planning and learning

  2012influential citation
• A Biopsychically Inspired Cognitive System for Intelligent Agents in Aerospace Applications

  2012cites this paper
• Cooperative Machine Learning with Information Fusion for Dynamic Decision Making in Diagnostic Applications

  2012cites this paper
• Biopsychically inspired cognitive control for autonomous agents based on motivated learning

  2012cites this paper
• Learning in Persistent Search : A Constrained Game Approach

  2012cites this paper
• Experimental Demonstration of Multi-Agent Learning and Planning under Uncertainty for Persistent Missions with Automated Battery Management

  2012cites this paper
• Practical reinforcement learning using representation learning and safe exploration for large scale Markov decision processes

  2012cites this paper
• Robust distributed planning strategies for autonomous multi-agent teams

  2012cites this paper
• Cooperative control of MAVs for a hidden emitter localization

  2012cites this paper
• Transfer Learning for Reinforcement Learning with Dependent Dirichlet Process and Gaussian Process

  2012cites this paper
• The architecture research for a multi-agent team cooperative mission management system

  2011cites this paper
• The GridWorld Domain : A Pedagogical Example

  2011influential citation
• Distributed continuous-time consensus seeking in multi-agent systems

  2011cites this paper
• UAV cooperative control with stochastic risk models

  2011influential citation
• Actor-Critic Policy Learning in Cooperative Planning

  2010influential citation
• Implicit cooperative control achieved by generic genetic fuzzy logic

  2010cites this paper
• Autonomous UAV Navigation in Unknown Terrain/Environment using Reinforcement Learning

  2008cites this paper
• MIT Open Access Articles Model Estimation Within Planning and Learning

  year unknowninfluential citation
• MIT Open Access Articles UAV Cooperative Control with Stochastic Risk Models

  year unknowninfluential citation