Deep Reinforcement Learning-Based Task Scheduling in IoT Edge Computing

Edge computing (EC) has recently emerged as a promising paradigm that supports resource-hungry Internet of Things (IoT) applications with low latency services at the network edge. However, the limited capacity of computing resources at the edge server poses great challenges for scheduling application tasks. In this paper, a task scheduling problem is studied in the EC scenario, and multiple tasks are scheduled to virtual machines (VMs) configured at the edge server by maximizing the long-term task satisfaction degree (LTSD). The problem is formulated as a Markov decision process (MDP) for which the state, action, state transition, and reward are designed. We leverage deep reinforcement learning (DRL) to solve both time scheduling (i.e., the task execution order) and resource allocation (i.e., which VM the task is assigned to), considering the diversity of the tasks and the heterogeneity of available resources. A policy-based REINFORCE algorithm is proposed for the task scheduling problem, and a fully-connected neural network (FCN) is utilized to extract the features. Simulation results show that the proposed DRL-based task scheduling algorithm outperforms the existing methods in the literature in terms of the average task satisfaction degree and success ratio.

• Publication year

  2021

• Venue

  Italian National Conference on Sensors

• Publication date

  2021-02-28

• Fields of study

  Medicine, Computer Science, Engineering

• Identifiers
  DOI 10.3390/s21051666PMID 33671072PMCID 7957605
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Cloud Resource Scheduling With Deep Reinforcement Learning and Imitation Learning

  2021cited by this paper
• Energy-Aware Marine Predators Algorithm for Task Scheduling in IoT-Based Fog Computing Applications

  2021cited by this paper
• Mobility-Aware Joint Task Scheduling and Resource Allocation for Cooperative Mobile Edge Computing

  2021cited by this paper
• Heterogeneous Task Offloading and Resource Allocations via Deep Recurrent Reinforcement Learning in Partial Observable Multifog Networks

  2020cited by this paper
• Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

  2020cited by this paper
• Deep-Reinforcement-Learning-Based Offloading Scheduling for Vehicular Edge Computing

  2020cited by this paper
• Mode Selection and Resource Allocation in Sliced Fog Radio Access Networks: A Reinforcement Learning Approach

  2020cited by this paper
• ReCARL: Resource Allocation in Cloud RANs With Deep Reinforcement Learning

  2020cited by this paper
• Offloading and Resource Allocation With General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach

  2020cited by this paper
• Online Deadline-Aware Task Dispatching and Scheduling in Edge Computing

  2020cited by this paper
• Enhanced Online Q-Learning Scheme for Resource Allocation with Maximum Utility and Fairness in Edge-IoT Networks

  2020cited by this paper
• Collaborative Cloud and Edge Computing for Latency Minimization

  2019cited by this paper
• Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

  2019cited by this paper
• Dynamic Task Offloading and Scheduling for Low-Latency IoT Services in Multi-Access Edge Computing

  2019cited by this paper
• From Cloud Down to Things: An Overview of Machine Learning in Internet of Things

  2019cited by this paper
• Collaborative cache allocation and task scheduling for data-intensive applications in edge computing environment

  2019influential reference
• A $Q$ -Learning-Based Proactive Caching Strategy for Non-Safety Related Services in Vehicular Networks

  2019cited by this paper
• Joint Task Assignment, Transmission, and Computing Resource Allocation in Multilayer Mobile Edge Computing Systems

  2019cited by this paper
• Joint Resource Allocation for Latency-Sensitive Services Over Mobile Edge Computing Networks With Caching

  2019cited by this paper
• Credit-Based Payments for Fast Computing Resource Trading in Edge-Assisted Internet of Things

  2019cited by this paper
• iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks

  2019cited by this paper
• Resource Scheduling for Delay Minimization in Multi-Server Cellular Edge Computing Systems

  2019cited by this paper
• Computation Offloading Toward Edge Computing

  2019cited by this paper
• Joint Cotask-Aware Offloading and Scheduling in Mobile Edge Computing Systems

  2019cited by this paper
• Resource Allocation for a UAV-Enabled Mobile-Edge Computing System: Computation Efficiency Maximization

  2019cited by this paper
• A Hybrid Task Scheduling Scheme for Heterogeneous Vehicular Edge Systems

  2019cited by this paper
• Application Aware Workload Allocation for Edge Computing-Based IoT

  2018cited by this paper
• Optimal Scheduling of VMs in Queueing Cloud Computing Systems With a Heterogeneous Workload

  2018cited by this paper
• DRL-Scheduling: An Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

  2018cited by this paper
• Mobile Edge Computing: A Survey

  2018cited by this paper
• A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications

  2017cited by this paper
• Online job dispatching and scheduling in edge-clouds

  2017cited by this paper
• Joint Task Offloading and Resource Allocation for Multi-Server Mobile-Edge Computing Networks

  2017cited by this paper
• Edge Computing: Vision and Challenges

  2016cited by this paper
• Reference Architectures for the Internet of Things

  2016cited by this paper
• Computation Offloading for Service Workflow in Mobile Cloud Computing

  2015cited by this paper
• Policy Gradient Methods for Reinforcement Learning with Function Approximation

  1999cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper

• Resource scheduling and management of multidimensional data stream cloud platforms based on deep neural networks

  2026cites this paper
• Toward intelligent IoT scheduling with quantum-inspired latent models for energy and latency optimization

  2026cites this paper
• HG-MRLS: A Hierarchical Graph Meta-Reinforcement Learning Framework for Dynamic Scheduling in Heterogeneous Computing Networks

  2026cites this paper
• SMART EDGE COMPUTING INTEGRATION FOR LATENCY-CRITICAL APPLICATIONS IN NEXT-GENERATION WIRELESS NETWORKS

  2026cites this paper
• A Context-Aware Intelligent Scheduling Framework for Modern Operating Systems Using Hybrid Machine Learning Models

  2026cites this paper
• SLA aware deep reinforcement learning for adaptive EdgeCloud task scheduling.

  2026cites this paper
• Enhanced federated reinforcement learning framework for task management in fog computing using eligibility traces and targeted model dissemination

  2026cites this paper
• Adaptive and intelligent customized deep Q-network for energy-efficient task offloading in mobile edge computing environments

  2026cites this paper
• Priority-Based Scheduling and Orchestration in Edge-Cloud Computing: A Deep Reinforcement Learning-Enhanced Concurrency Control Approach

  2025cites this paper
• Reinforcement Learning-based Scheduling for Efficient Edge-IoT Resource Allocation

  2025cites this paper
• Hybrid Genetic Algorithm and Deep Reinforcement Learning Framework for IoT-Enabled Healthcare Equipment Maintenance Scheduling

  2025cites this paper
• A dependency-aware task offloading in IoT-based edge computing system using an optimized deep learning approach

  2025cites this paper
• Efficient Task Allocation in IOTWSNs Using Opposition-based learning Elite Cloning Grasshopper Optimization Algorithm

  2025cites this paper
• Joint Clustering and Hierarchical Reinforcement Learning for Complex Task Allocation in Heterogeneous Swarm Systems

  2025cites this paper
• An advanced parallel hybrid metaheuristic approach for multi-objective optimization in cloud task scheduling

  2025cites this paper
• Deep Reinforcement Learning-Based Task Scheduling and Resource Allocation for Vehicular Edge Computing: A Survey

  2025cites this paper
• Optimizing the distribution of tasks in Internet of Things using edge processing-based reinforcement learning

  2025cites this paper
• Management of autoscaling serverless functions in edge computing via Q-Learning

  2025cites this paper
• Decentralized queue control with delay shifting in edge-IoT using reinforcement learning

  2025influential citation
• An novel cloud task scheduling framework using hierarchical deep reinforcement learning for cloud computing

  2025cites this paper
• English teaching network subject mechanism in the edge computing IoT ecosystem

  2025cites this paper
• Regression-based investigation of latency in automated networks

  2025cites this paper
• Dynamic resource orchestration in edge computing environments using multi-agent reinforcement learning

  2025cites this paper
• Reinforcement learning-based task scheduling in edge fog cloud environment

  2025cites this paper
• Emergent Architectures in Edge Computing Revolutionizing AI-Driven Approaches for Low Latency Applications

  2025cites this paper
• Scalable and Energy-Efficient Service Orchestration in the Edge-Cloud Continuum With Multi-Objective Reinforcement Learning

  2025cites this paper
• A Review on Reinforcement Learning Based Task Scheduling in Edge Computing

  2025cites this paper
• A Multi-Granularity Task Scheduling Method for Heterogeneous Computing Resources

  2025cites this paper
• The mapping trick: leveraging RoboSoccer obstacle avoidance and navigation for advanced task scheduling solutions in foggy IoE ecosystems

  2025cites this paper
• Intelligent Scheduling in Wireless Sensor Networks using Reinforcement Learning based Deep Q-Networks

  2025cites this paper
• Fog Computing Tasks Management Based on Federated Reinforcement Learning

  2025cites this paper
• Node selection using adversarial expert-based multi-armed bandits in distributed computing

  2025cites this paper
• A Survey on Task Scheduling in Edge-Cloud

  2025cites this paper
• AI-based approaches for improving autonomous mobile robot localization in indoor environments: A comprehensive review

  2025cites this paper
• Implementing an intelligent learning-based algorithm for efficient task scheduling in cloud computing environments

  2025cites this paper
• Review on Meta-heuristic Algorithm-Based Priority-Aware Computation Offloading in Edge Computing System

  2025cites this paper
• Revolutionizing load harmony in edge computing networks with probabilistic cellular automata and Markov decision processes

  2025cites this paper
• An Adaptive Slicing-Based Task Admission Scheduling Strategy in Multiaccess Edge Computing

  2025cites this paper
• Graph-Based Proximal Policy Optimization Empowered Adaptive Task Scheduling Leveraging Cloud–Edge Collaboration for Consumer Electronics

  2025cites this paper
• A Chaotic Elite Cloning Artificial Jellyfish Algorithm for Efficient Task Allocation in IOTWSNs

  2025cites this paper
• DQN-Based Dynamic Workload Scheduling with Aging-Aware Queues

  2025cites this paper
• An Intellectual Deep Resource Allocation with Task Scheduling for Semi-Synchronous Internet-Based Edge Computing Network

  2025cites this paper
• Dynamic Multi-Accelerator Management for Deep Learning Applications on the FPGA Edge

  2025influential citation
• Gradient Bandit Experts For Node Selection In Edge Computing

  2025cites this paper
• Adaptation in IoT-Fog Data Transmission: SLR and Future Perspectives on Dynamic Frequency Control

  2025cites this paper
• QTE-IoT: Q-learning-based task scheduling scheme to enhance energy consumption and QoS in IoT environments

  2025cites this paper
• Federated reinforcement learning-based adaptive stream applications scheduling in edge and cloud computing

  2025cites this paper
• Exploration of Multi-Task Scheduling in Multi-Access Edge Computing

  2024cites this paper
• Pricing Optimization in MEC Systems: Maximizing Resource Utilization Through Joint Server Configuration and Dynamic Operation

  2024cites this paper
• A Review on Wireless Networked Control System: The Communication Perspective

  2024cites this paper
• Deep learning-based task scheduling in edge computing

  2024cites this paper
• Machine learning-based computation offloading in multi-access edge computing: A survey

  2024cites this paper
• IoT-Edge technology based cloud optimization using artificial neural networks

  2024cites this paper
• A greedy randomized adaptive search procedure for scheduling IoT tasks in virtualized fog–cloud computing

  2024cites this paper
• DAS: A DRL-Based Scheme for Workload Allocation and Worker Selection in Distributed Coded Machine Learning

  2024cites this paper
• Dynamic edge clustering and task scheduling for edge assisted metaverse system in the field of remote work and collaboration

  2024cites this paper
• DGCQN: a RL and GCN combined method for DAG scheduling in edge computing

  2024cites this paper
• An Online Simulated Annealing-Based Task Offloading Strategy for a Mobile Edge Architecture

  2024cites this paper
• Deep Q-learning based Resource Scheduling in IoT Edge Computing

  2024cites this paper
• BD-TTS: A blockchain and DRL-based framework for trusted task scheduling in edge computing

  2024cites this paper
• Edge AI: A Taxonomy, Systematic Review and Future Directions

  2024cites this paper
• Efficient Workflow Scheduling in Edge Cloud-Enabled Space-Air-Ground-Integrated Information Systems

  2024cites this paper
• Reinforcement Learning Based Online Request Scheduling Framework for Workload-Adaptive Edge Deep Learning Inference

  2024cites this paper
• Comparison of Reinforcement Learning Algorithms for Edge Computing Applications Deployed by Serverless Technologies

  2024cites this paper
• Towards Intelligent Pulverized Systems: a Modern Approach for Edge-Cloud Services

  2024cites this paper
• The effect of task processing management on energy consumption at the edge of Internet of things network with using reinforcement learning method

  2024cites this paper
• Network Resource Optimization Allocation Algorithm Based on Deep Reinforcement Learning

  2024cites this paper
• An Efficient Task Scheduling for Latency Sensitive Tasks in Edge - Cloud Computing Environment

  2024cites this paper
• Soft Actor-Critic-based Distributed Routing Scheme for Edge Computing Integrated with Dynamic IoT Networks

  2024cites this paper
• Deep reinforcement learning-based optimal deployment of IoT machine learning jobs in fog computing architecture

  2024cites this paper
• Split-Federated Reinforcement Learning for IoMT Data and Task Management in Edge-Fog-Cloud Infrastructure

  2024cites this paper
• Real-time and Energy-aware Scheduling for Edge-to-Cloud Continuum based on Reinforcement Learning

  2024cites this paper
• Zero-Touch MEC Resources for Connected Autonomous Vehicles Managed by Federated Learning

  2023cites this paper
• Dual Interactive Wasserstein Generative Adversarial Network optimized with arithmetic optimization algorithm-based job scheduling in cloud-based IoT

  2023cites this paper
• Offloading Demand Prediction-Driven Latency-Aware Resource Reservation in Edge Networks

  2023cites this paper
• Fundamental Research Challenges for Distributed Computing Continuum Systems

  2023cites this paper
• Resource Scheduling in Edge Computing: Architecture, Taxonomy, Open Issues and Future Research Directions

  2023cites this paper
• Heuristic deep learning scheduling in cloud for resource-intensive internet of things systems

  2023cites this paper
• Performance Comparison of Different Deep Reinforcement Learning Algorithms for Task Scheduling Problem in Blockchain-Enabled Internet of Vehicles

  2023cites this paper
• A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload

  2023cites this paper
• Delay and energy aware task scheduling mechanism for fog-enabled IoT applications: A reinforcement learning approach

  2023cites this paper
• A Decomposition-Based Approach for Multitask Scheduling With Execution Uncertainty in Industrial Internet of Things

  2023cites this paper
• IRATS: A DRL-based intelligent priority and deadline-aware online resource allocation and task scheduling algorithm in a vehicular fog network

  2023cites this paper
• An effective Technique to Schedule priority aware tasks to offload data at edge and cloud servers

  2023cites this paper
• Speeding Task Allocation Search for Reconfigurations in Adaptive Distributed Embedded Systems Using Deep Reinforcement Learning

  2023cites this paper
• RESPECT: Reinforcement Learning based Edge Scheduling on Pipelined Coral Edge TPUs

  2023cites this paper
• DRLBTSA: Deep reinforcement learning based task-scheduling algorithm in cloud computing

  2023cites this paper
• Federated-Based Deep Reinforcement Learning (Fed-DRL) for Energy Management in a Distributive Wireless Network

  2023cites this paper
• A High-Reliability Edge-Side Mobile Terminal Shared Computing Architecture Based on Task Triple-Stage Full-Cycle Monitoring

  2023cites this paper
• Reinforcement Learning for Reducing the Interruptions and Increasing Fault Tolerance in the Cloud Environment

  2023cites this paper
• Accelerating Exact Combinatorial Optimization via RL-based Initialization - A Case Study in Scheduling

  2023cites this paper
• Data conversion control of virtual network devices in cloud computing: A deep reinforcement learning approach

  2023cites this paper
• Reinforcement learning-based multi-objective energy-efficient task scheduling in fog-cloud industrial IoT-based systems

  2023cites this paper
• DRL-Based Workload Allocation for Distributed Coded Machine Learning

  2023cites this paper
• Computation Offloading and Resource Allocation in IoT-Based Mobile Edge Computing Systems

  2023cites this paper
• Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning

  2023cites this paper
• An Intelligent Scheduling Strategy in Fog Computing System Based on Multi-Objective Deep Reinforcement Learning Algorithm

  2023cites this paper
• An intelligent and interpretable rule-based metaheuristic approach to task scheduling in cloud systems

  2023cites this paper
• Industry 4.0 and industrial workflow scheduling: A survey

  2023cites this paper
• An Improving List Scheduling Algorithm Based on Reinforcement Learning and Task Duplication

  2022cites this paper