Attention-Based Hierarchical-DRL With Mask for Multi-Timescale Caching, Association, and Secure Content Delivery in UAV-Enabled ISAC Networks

In this research, we investigate the long-term secure content delivery problem in uncrewed aerial vehicle (UAV)-enabled integrated sensing and communication (ISAC) networks. We consider that ISAC-assisted UAVs are allowed to store user-requested contents, provide content delivering service to users, and perform eavesdropper detection. However, the openness of UAV-enabled networks makes the content delivery network more susceptible to security threats. To address the eavesdropper detection, we propose a Cramér-Rao Lower Bound (CRLB) and an extended Kalman Filter (EKF)-based location estimation algorithm. We then examine the secrecy throughput of users and formulate the joint user association, UAV deployment, content caching, communication, and sensing beamforming problem as a long-term secure throughput maximization problem. As the formulated problem is a mixed-integer non-linear programming problem (MINLP) and cannot be solved conveniently, we decompose it into two subproblems, namely, a long-timescale content caching subproblem, and a short-timescale user association, UAV deployment, communication and sensing beamforming subproblem. To solve the subproblems, we transform it into a Markov decision process (MDP) and we propose an attention-based hierarchical deep reinforcement learning (HDRL) with an action mask and design a double deep Q-network (DDQN) algorithm to obtain the long-timescale and an attention-based DDQN with an action mask for short-timescale strategies. Specifically, we first obtain a long-timescale strategy for content caching. Given the long-timescale strategy, we then obtain the short-timescale user association, UAV deployment, communication, and sensing beamforming strategy. Simulation results demonstrate the effectiveness of the proposed algorithms.

• Publication year

  2026

• Venue

  IEEE Transactions on Green Communications and Networking

• Publication date

  Unknown publication date

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/TGCN.2026.3651458
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Dual UAV-Assisted Secure IoT Networks: Resource Allocation and 3D Trajectory Design

  2026cited by this paper
• On Secure UAV-Aided ISCC Systems

  2025influential reference
• Near-Field Integrated Sensing and Communications for Secure UAV Networks

  2025influential reference
• A Survey on Artificial Intelligence Techniques for Improved Rich Media Content Delivery in a 5G and Beyond Network Slicing Context

  2025cited by this paper
• Energy-Constrained Multidimensional Optimization for UAV-Aided Secure Data Collection With Cooperative Jamming

  2025cited by this paper
• Joint Service Caching and Secure Computation Offloading for Reconfigurable-Intelligent-Surface-Assisted Edge Computing Networks

  2024cited by this paper
• Secure Transmission for IRS-Aided UAV-ISAC Networks

  2024cited by this paper
• Resource and Trajectory Optimization for UAV-Relay-Assisted Secure Maritime MEC

  2024cited by this paper
• Secure Channel Establishment Scheme for Task Delivery in Vehicular Cloud Computing

  2024cited by this paper
• UAV-Enabled Secure ISAC Against Dual Eavesdropping Threats: Joint Beamforming and Trajectory Design

  2024influential reference
• Security Enhancement of ISAC via IRS-UAV

  2024influential reference
• Secure Rate Maximization for ISAC-UAV Assisted Communication Amidst Multiple Eavesdroppers

  2024influential reference
• Throughput Maximization for Multipath Secure Transmission in Wireless Ad-Hoc Networks

  2024cited by this paper
• Air-Ground Integrated Sensing and Communications: Opportunities and Challenges

  2023cited by this paper
• Integrated Sensing and Communication Signals Toward 5G-A and 6G: A Survey

  2023cited by this paper
• Incentivizing Secure Edge Caching for Scalable Coded Videos in Heterogeneous Networks

  2023cited by this paper
• Toward Trusted and Swift UAV Communication: ISAC-Enabled Dual Identity Mapping

  2023cited by this paper
• When UAVs Meet ISAC: Real-Time Trajectory Design for Secure Communications

  2023influential reference
• Edge Learning for B5G Networks With Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless Sensing

  2022cited by this paper
• Security Threats and Mitigation Techniques in UAV Communications: A Comprehensive Survey

  2022cited by this paper
• Caching and UAV Friendly Jamming for Secure Communications With Active Eavesdropping Attacks

  2022cited by this paper
• UAV-Aided Positioning Systems for Ground Devices: Fundamental Limits and Algorithms

  2022cited by this paper
• Securing UAV Communication with Mobile UAV Eavesdroppers: Joint Trajectory and Communication Design

  2021cited by this paper
• Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking

  2021cited by this paper
• Joint Resource and Trajectory Optimization for Security in UAV-Assisted MEC Systems

  2021cited by this paper
• Resource Allocation for Secure Multi-UAV Communication Systems With Multi-Eavesdropper

  2020cited by this paper
• A Comprehensive Overview on 5G-and-Beyond Networks With UAVs: From Communications to Sensing and Intelligence

  2020cited by this paper
• UAVs as an Intelligent Service: Boosting Edge Intelligence for Air-Ground Integrated Networks

  2020cited by this paper
• Secure 3D Mobile UAV Relaying for Hybrid Satellite-Terrestrial Networks

  2020cited by this paper
• Reinforcement learning

  2019cited by this paper
• A Survey of Caching Techniques in Cellular Networks: Research Issues and Challenges in Content Placement and Delivery Strategies

  2018cited by this paper
• A Survey of Security Attacks in Information-Centric Networking

  2015cited by this paper

• No citing papers are available for this paper.