Multi-Agent Autonomous On-Demand Free Flight Operations in Urban Air Mobility

In urban air mobility (UAM), flying with electrical vertical takeoff and landing (eVTOL) aircraft will bring fundamental changes to city infrastructures and daily commutes. In order to enable safe and efficient autonomous on-demand free flight operations for the eVTOL aircraft in UAM, a centralized computational guidance algorithm is proposed and analyzed for multi cooperative aircraft. The approach proposed in this paper is to formulate this problem as a MarkovDecisionProcess (MDP) and solve it using anonline algorithmMonteCarloTree Search (MCTS). A coordination mechanism is designed to manage multiple cooperative aircraft. By generating real-time actions for all the cooperative aircraft to follow, the algorithm can guide all the aircraft to their respective destinations while avoiding potential conflicts between them. For the sake of illustration, a free flight airspace simulator is created to test the performance of this algorithm. Results show that this algorithm can help all the aircraft reach their trip destinations while only having 0.2% conflicts during the flights.

• Publication year

  2019

• Venue

  AIAA Aviation 2019 Forum

• Publication date

  2019-06-17

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.2514/6.2019-3520
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Energy Efficient Arrival with RTA Constraint for Urban eVTOL Operations

  2018influential reference
• A Proposed Approach to Studying Urban Air Mobility Missions Including an Initial Exploration of Mission Requirements

  2018cited by this paper
• Taking Air Travel to the Streets, or Just Above Them

  2018cited by this paper
• Simulation Evaluations of an Autonomous Urban Air Mobility Network Management and Separation Service

  2018cited by this paper
• Autonomous On-Demand Free Flight Operations in Urban Air Mobility using Monte Carlo Tree Search

  2018influential reference
• System-Level Urban Air Mobility Transportation Modeling and Determination of Energy-Related Constraints

  2018cited by this paper
• Mastering the game of Go without human knowledge

  2017cited by this paper
• Markov Decision Process-Based Distributed Conflict Resolution for Drone Air Traffic Management

  2017cited by this paper
• Systems-Level Analysis of On Demand Mobility for Aviation

  2017cited by this paper
• Enabling Airspace Integration for High-Density On-Demand Mobility Operations

  2017cited by this paper
• Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm

  2017cited by this paper
• PLATO: Policy learning using adaptive trajectory optimization

  2016cited by this paper
• Policy compression for aircraft collision avoidance systems

  2016cited by this paper
• Silicon Valley as an Early Adopter for On-Demand Civil VTOL Operations

  2016cited by this paper
• Mastering the game of Go with deep neural networks and tree search

  2016cited by this paper
• Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning

  2016cited by this paper
• Fast-Forwarding to a Future of On-Demand Urban Air Transportation

  2016cited by this paper
• DAIDALUS: Detect and avoid alerting logic for unmanned systems

  2015cited by this paper
• Learning deep control policies for autonomous aerial vehicles with MPC-guided policy search

  2015cited by this paper
• A Quantitative Metric to Enable Unmanned Aircraft Systems to Remain Well Clear

  2015cited by this paper
• Google Maps

  2014cited by this paper
• High Speed Mobility Through On-Demand Aviation

  2013cited by this paper
• Decentralized Model Predictive Control of Swarms of Spacecraft Using Sequential Convex Programming

  2013cited by this paper
• A Survey of Monte Carlo Tree Search Methods

  2012cited by this paper
• Generation of collision-free trajectories for a quadrocopter fleet: A sequential convex programming approach

  2012cited by this paper
• Mixed-integer quadratic program trajectory generation for heterogeneous quadrotor teams

  2012cited by this paper
• Decentralized path planning for multi-agent teams in complex environments using rapidly-exploring random trees

  2011cited by this paper
• Reciprocal n-Body Collision Avoidance

  2011cited by this paper
• Path planning based on Genetic Algorithms and the Monte-Carlo method to avoid aerial vehicle collisions under uncertainties

  2011cited by this paper
• Robust Airborne Collision Avoidance through Dynamic Programming

  2011cited by this paper
• Sampling-based algorithms for optimal motion planning

  2011cited by this paper
• Aircraft Conflict Resolution by Genetic Algorithm and B-Spline Approximation

  2010cited by this paper
• Multi-agent Reinforcement Learning: An Overview

  2010cited by this paper
• Particle Swarm Optimization Applied to Space Trajectories

  2010cited by this paper
• A mixed integer program for flight-level assignment and speed control for conflict resolution

  2009cited by this paper
• Multi-UAV collision avoidance with separation assurance under uncertainties

  2009cited by this paper
• Proportional navigation-based collision avoidance for UAVs

  2009cited by this paper
• Multi-UAV path planning in obstacle rich environments using Rapidly-exploring Random Trees

  2009cited by this paper
• Multiagent Systems: Introduction to Noncooperative Game Theory: Games in Normal Form

  2008cited by this paper
• UAV collision avoidance based on geometric approach

  2008cited by this paper
• A Concise Introduction to Multiagent Systems and Distributed Artificial Intelligence

  2007cited by this paper
• Convex programming approach to powered descent guidance for mars landing

  2007cited by this paper
• Path Planning by Negotiation for Decentralized Agents

  2007cited by this paper
• An Evasive Maneuvering Algorithm for UAVs in See-and-Avoid Situations

  2007cited by this paper
• Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search

  2006cited by this paper
• Probabilistic verification of a decentralized policy for conflict resolution in multi-agent systems

  2006cited by this paper
• Towards Autonomous UAV Flight in Forests

  2005cited by this paper
• Dynamic Optimization Strategies for Three-Dimensional Conflict Resolution of Multiple Aircraft

  2004cited by this paper
• Decentralized model predictive control of cooperating UAVs

  2004cited by this paper
• The Stanford testbed of autonomous rotorcraft for multi agent control (STARMAC)

  2004cited by this paper
• Decentralized Cooperative Trajectory Planning of Multiple Aircraft with Hard Safety Guarantees

  2004cited by this paper
• A Practical Approach to Obstacle Field Route Planning for Unmanned Rotorcraft

  2004cited by this paper
• Introduction to Autonomous Mobile Robots

  2004cited by this paper
• Automated Conflict Resolution for Air Trac Management Using Cooperative Multiagent Negotiation

  2004cited by this paper
• UAV Trajectory Design Using Total Field Collision Avoidance

  2003cited by this paper
• Decentralized nonlinear model predictive control of multiple flying robots

  2003cited by this paper
• Conflict resolution problems for air traffic management systems solved with mixed integer programming

  2002cited by this paper
• Decentralized optimization, with application to multiple aircraft coordination

  2002cited by this paper
• Aircraft trajectory planning with collision avoidance using mixed integer linear programming

  2002cited by this paper
• Designing for safety: the 'free flight' air traffic management concept

  2002cited by this paper
• Mixed integer programming for multi-vehicle path planning

  2001cited by this paper
• Resolution of Conflicts Involving Many Aircraft via Semidefinite Programming

  2001cited by this paper
• A DECENTRALIZED CONTROL STRATEGY FOR DISTRIBUTED AIR/GROUND TRAFFIC SEPARATION

  2000cited by this paper
• Cost-Benefit Study of Free Flight with Airborne Separation Assurance

  2000cited by this paper
• Performance evaluation of airborne separation assurance for free flight

  2000cited by this paper
• Conflict resolution for air traffic management: a study in multiagent hybrid systems

  1998cited by this paper
• Rapidly-exploring random trees : a new tool for path planning

  1998cited by this paper
• Conflict Detection and Resolution for Free Flight

  1997cited by this paper
• Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces

  1996cited by this paper
• Air traffic management: evolution with technology

  1996cited by this paper
• Discrete approximations to optimal trajectories using direct transcription and nonlinear programming

  1992cited by this paper
• TCAS: A system for preventing midair collisions

  1989cited by this paper
• A Markovian Decision Process

  1957cited by this paper

• Enhancing air traffic control: A transparent deep reinforcement learning framework for autonomous conflict resolution

  2025cites this paper
• Genetic Action Set Generation for Monte Carlo Tree Search in Six-Degree-of-Freedom Multi-Agent Overmatch

  2025cites this paper
• Multi-view representation learning for performance-based tactical conflict resolution in urban air mobility

  2025cites this paper
• Modelling and Control of an Urban Air Mobility Vehicle Subject to Empirically-Developed Urban Airflow Disturbances

  2024cites this paper
• Dynamic Reservation-Based Traffic Control System to Integrate VTOL Vehicle Operations in Connected Vehicle Surface Traffic

  2024cites this paper
• A Coupled Optimization Framework for Correlated Equilibria in Normal-Form Games

  2024cites this paper
• Chance-constrained UAM traffic flow optimization with fast disruption recovery under uncertain waypoint occupancy time

  2024cites this paper
• An ETA-Based Tactical Conflict Resolution Method for Air Logistics Transportation

  2023cites this paper
• Designing a Surveillance Sensor Network with Information Clearinghouse for Advanced Air Mobility

  2023cites this paper
• Dynamic Graph Propagation for Performance-based Tactical Conflict Resolution in Urban Air Mobility

  2023cites this paper
• Applied Game Theory to Enhance Air Traffic Control in 3D Airspace

  2023cites this paper
• Applications and classifications of unmanned aerial vehicles: A literature review with focus on multi-rotors

  2022cites this paper
• A context-aware warehouse robots collision detection and avoidance using Markov Decision Process (MDP)

  2022cites this paper
• Optimal Vertiport Airspace and Approach Control Strategy for Urban Air Mobility (UAM)

  2022cites this paper
• Approach Control Concepts and Optimal Vertiport Airspace Design for Urban Air Mobility (UAM) Operation

  2021cites this paper
• Wireless-Enabled Asynchronous Federated Fourier Neural Network for Turbulence Prediction in Urban Air Mobility (UAM)

  2021cites this paper
• Terminal area control rules and eVTOL adaptive scheduling model for multi-vertiport system in urban air Mobility

  2021cites this paper
• Trajectory-based flight scheduling for AirMetro in urban environments by conflict resolution

  2021cites this paper
• Automated flight planning of high-density urban air mobility

  2021cites this paper
• Development of optimal scheduling strategy and approach control model of multicopter VTOL aircraft for urban air mobility (UAM) operation

  2021cites this paper
• 3D path planning and real-time collision resolution of multirotor drone operations in complex urban low-altitude airspace

  2021cites this paper
• Multi-Agent Autonomous Operations in Urban Air Mobility with Communication Constraints

  2020influential citation
• Enabling Drones Collaboration in ITS Applications Using a BDI Architecture Based on a 5-Dimensional Social Model

  2020cites this paper
• Rotorcraft systems for urban air mobility: A reality check

  2020cites this paper
• Flying Car Transportation System: Advances, Techniques, and Challenges

  2020cites this paper
• A Collaborative Approach for an Integrated Modeling of Urban Air Transportation Systems

  2020cites this paper
• A MODULAR DESIGN CONCEPT FOR VERTIPORTS IN URBAN AIR MOBILITY SYSTEMS

  year unknowncites this paper