Intelligent Resource Allocation for Train-to-Train Communication: A Multi-Agent Deep Reinforcement Learning Approach

The application of train-to-train (T2T) communication in urban rail transit is expected to simplify system structure, reduce maintenance costs, and improve operational efficiency. In particular, train-to-wayside (T2W) communication coexist with T2T communication in the train control system based on T2T communication. To make full use of limited spectrum resources, frequency reuse is adopted as an efficient technique, but it brings the co-channel interference unfortunately, which affects the quality of service (QoS) for T2T and T2W users. In this paper, we propose a multi-agent deep reinforcement learning (MADRL) based autonomous channel selection and transmission power selection algorithm for T2T communication to reduce the co-channel interference. Specifically, each agent interacts with the environment and selects actions to implement a distributed resource allocation mechanism independently, adopting asynchronous updates to avoid different agents choosing the same sub-band. Simulation results show the superiority of our proposed algorithm: compared with the existing resource allocation schemes for T2T communication, the system throughput and the successful transmission probability of T2T links are greatly improved.

• Publication year

  2020

• Venue

  IEEE Access

• Publication date

  2020-01-03

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/ACCESS.2019.2963751
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Enhancing Transmission on Hybrid Precoding Based Train-to-Train Communication

  2020cited by this paper
• Train-Centric CBTC Meets Age of Information in Train-to-Train Communications

  2020cited by this paper
• Multi-Agent Deep Reinforcement Learning-Based Cooperative Spectrum Sensing With Upper Confidence Bound Exploration

  2019cited by this paper
• Joint Security and QoS Provisioning in Train-Centric CBTC Systems Under Sybil Attacks

  2019cited by this paper
• Reliability Analysis of Next-Generation CBTC Data Communication Systems

  2019cited by this paper
• Location-Assisted Beam Alignment for Train-to-Train Communication in Urban Rail Transit System

  2019cited by this paper
• Weighted cooperative reinforcement learning-based energy-efficient autonomous resource selection strategy for underlay D2D communication

  2019cited by this paper
• Availability and Performance Analysis of Train-to-Train Data Communication System

  2019cited by this paper
• Channel Sounding and Ray Tracing for Train-to-Train Communications at the THz Band

  2019cited by this paper
• Enhancing Communication-Based Train Control Systems Through Train-to-Train Communications

  2019cited by this paper
• A Bio-Inspired Solution to Cluster-Based Distributed Spectrum Allocation in High-Density Cognitive Internet of Things

  2019cited by this paper
• Multiband Cooperation for 5G HetNets: A Promising Network Paradigm

  2019cited by this paper
• Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks

  2018cited by this paper
• A Dual-Link Soft Handover Scheme for C/U Plane Split Network in High-Speed Railway

  2018cited by this paper
• An adaptive Q-learning approach to power control for D2D communications

  2018cited by this paper
• Train-to-train Communication Resource Allocation Scheme for Train Control System

  2018cited by this paper
• A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks

  2018cited by this paper
• Multi-Agent RL based User-Centric Spectrum Allocation Scheme in D2D Enabled Hetnets

  2018cited by this paper
• A Simple Distributed Channel Allocation Algorithm for D2D Communication Pairs

  2018cited by this paper
• Research on Train Control System Based on Train to Train Communication

  2018cited by this paper
• An Actor-Critic Reinforcement Learning for Device-to-Device Communication Underlaying Cellular Network

  2018cited by this paper
• Direct train-to-train communications at low UHF frequencies

  2018cited by this paper
• Path Loss Models for Train-to-Train Communications in Typical High Speed Railway Environments

  2018cited by this paper
• Bayesian Reinforcement Learning-Based Coalition Formation for Distributed Resource Sharing by Device-to-Device Users in Heterogeneous Cellular Networks

  2017cited by this paper
• Radio Communication for Communications-Based Train Control (CBTC): A Tutorial and Survey

  2017cited by this paper
• Distributed Interference and Energy-Aware Power Control for Ultra-Dense D2D Networks: A Mean Field Game

  2017cited by this paper
• Availability analysis of next generation CBTC data communication systems

  2017cited by this paper
• Train-to-train propagation at 450 MHz

  2017cited by this paper
• Transmit Power Control for D2D-Underlaid Cellular Networks Based on Statistical Features

  2017cited by this paper
• Modeling and Measurement of Radio Propagation in Tunnel Environments

  2017cited by this paper
• Q-learning based power control algorithm for D2D communication

  2016cited by this paper
• Asynchronous Methods for Deep Reinforcement Learning

  2016cited by this paper
• E-MAC: An evolutionary solution for collision avoidance in wireless ad hoc networks

  2016cited by this paper
• Communication-Based Train Control (CBTC) Systems With Cooperative Relaying: Design and Performance Analysis

  2014cited by this paper
• Power Allocation based on Genetic Simulated Annealing Algorithm in Cognitive Radio Networks

  2013cited by this paper
• Power control algorithm of cognitive radio based on non-cooperative game theory

  2013cited by this paper

• Multiple High-Speed Trains Cooperative Tracking Control Based on Distributed Adaptive Model Predictive Control

  2026cites this paper
• Dynamic Resource Allocation for Multi-Access Edge Computing in Urban Rail Transit

  2025cites this paper
• Joint Optimization Approach of T2T Communication Channel Allocation and Power Control

  2025cites this paper
• Distributed Adaptive Fault-Tolerant Control for High-Speed Trains Based on a Multi-Body Dynamics Model

  2025cites this paper
• A Resilient Control Strategy for Train-to-Train Communications under Jamming Attacks

  2025influential citation
• Design and Optimization of Cooperative MAC Protocol for Mobile Ad Hoc Network-Enabled Train-to-Train Communications

  2025cites this paper
• Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach

  2024influential citation
• Parallel Offloading and Resource Optimization for Multi-Hop Ad Hoc Network-Enabled CBTC With Mobile Edge Computing

  2024cites this paper
• Train-to-Edge Cooperative Intelligence for Obstacle Intrusion Detection in Rail Transit

  2024cites this paper
• Resource allocation problem and artificial intelligence: the state-of-the-art review (2009–2023) and open research challenges

  2024cites this paper
• Federated Learning-Based Resource Allocation in RSU Assisted Moving Network

  2024cites this paper
• Artificial intelligence in rail transit wireless communication systems: Status, challenges and solutions

  2024cites this paper
• Optimizing Pneumonia Detection: Integrating Quadratic Discriminant Analysis and Deep Q-Networks Through Reinforcement Learning

  2024cites this paper
• Research on maximizing throughput of high-speed railway system by allocating train-to-train communication resources

  2024cites this paper
• Research on Train-to-Train Communication Resource Allocation for Urban Rail Transport

  2023cites this paper
• Efficient Resource Allocation in Multi-UAV Assisted Vehicular Networks With Security Constraint and Attention Mechanism

  2023cites this paper
• Robust Train-to-Train Transmission Scheduling in mmWave Band for High Speed Train Communication Systems

  2023cites this paper
• Task Offloading and Resource Management for CBTC via Multi-Hop Ad Hoc Network and MEC

  2023cites this paper
• Dynamic Algorithm for Interference Mitigation Between Cells in Networks Operating in the 250 MHz Band

  2022cites this paper
• Resource allocation optimization using artificial intelligence methods in various computing paradigms: A Review

  2022cites this paper
• The state-of-the-art review on resource allocation problem using artificial intelligence methods on various computing paradigms

  2022cites this paper
• Recent Advances in Artificial Intelligence for Improving Railway Operations

  2022cites this paper
• Deep Reinforcement Learning Based Resource Allocation for URLLC User-Centric Network

  2022cites this paper
• Resource Allocation Using Deep Learning in Mobile Small Cell Networks

  2021cites this paper
• Future 5G-oriented system for urban rail transit: Opportunities and challenges

  2021cites this paper
• Analysis of Failure Features of High-Speed Automatic Train Protection System

  2021cites this paper
• Intelligent train control for cooperative train formation: A deep reinforcement learning approach

  2021cites this paper
• Enhancing the Reliability of Communication between Vehicle and Everything (V2X) Based on Deep Learning for Providing Efficient Road Traffic Information

  2021cites this paper