Edge-Enabled Two-Stage Scheduling Based on Deep Reinforcement Learning for Internet of Everything

Nowadays, the concept of Internet of Everything (IoE) is becoming a hotly discussed topic, which is playing an increasingly indispensable role in modern intelligent applications. These applications are known for their real-time requirements under limited network and computing resources, thus it becomes a highly demanding task to transform and compute tremendous amount of raw data in a cloud center. The edge–cloud computing infrastructure allows a large amount of data to be processed on nearby edge nodes and then only the extracted and encrypted key features are transmitted to the data center. This offers the potential to achieve an end–edge–cloud-based big data intelligence for IoE in a typical two-stage data processing scheme, while satisfying a data security constraint. In this study, a deep-reinforcement-learning-enhanced two-stage scheduling (DRL-TSS) model is proposed to address the NP-hard problem in terms of operation complexity in end–edge–cloud Internet of Things systems, which is able to allocate computing resources within an edge-enabled infrastructure to ensure computing task to be completed with minimum cost. A presorting scheme based on Johnson’s rule is developed and applied to preprocess the two-stage tasks on multiple executors, and a DRL mechanism is developed to minimize the overall makespan based on a newly designed instant reward that takes into account the maximal utilization of each executor in edge-enabled two-stage scheduling. The performance of our method is evaluated and compared with three existing scheduling techniques, and experimental results demonstrate the ability of our proposed algorithm in achieving better learning efficiency and scheduling performance with a 1.1-approximation to the targeted optimal IoE applications.

• Publication year

  2023

• Venue

  IEEE Internet of Things Journal

• Publication date

  2023-02-15

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/JIOT.2022.3179231
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Actively Engaged

  2024cited by this paper
• Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning

  2022cited by this paper
• Hierarchical Adversarial Attacks Against Graph-Neural-Network-Based IoT Network Intrusion Detection System

  2022cited by this paper
• Variational Few-Shot Learning for Microservice-Oriented Intrusion Detection in Distributed Industrial IoT

  2022cited by this paper
• Deep Correlation Mining Based on Hierarchical Hybrid Networks for Heterogeneous Big Data Recommendations

  2021cited by this paper
• Convergence of Blockchain and Edge Computing for Secure and Scalable IIoT Critical Infrastructures in Industry 4.0

  2021cited by this paper
• On Sensor Security in the Era of IoT and CPS

  2021cited by this paper
• Siamese Neural Network Based Few-Shot Learning for Anomaly Detection in Industrial Cyber-Physical Systems

  2021cited by this paper
• Energy-Efficient Smart Routing Based on Link Correlation Mining for Wireless Edge Computing in IoT

  2021cited by this paper
• Scalable Parallel Task Scheduling for Autonomous Driving Using Multi-Task Deep Reinforcement Learning

  2020cited by this paper
• Collaborative Task Scheduling for IoT-Assisted Edge Computing

  2020cited by this paper
• Deep-Reinforcement-Learning-Based Energy-Efficient Resource Management for Social and Cognitive Internet of Things

  2020cited by this paper
• Communication-Aware Task Scheduling for Energy-Harvesting Nonvolatile Processors

  2020cited by this paper
• Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

  2020cited by this paper
• Edge-Aided Computing and Transmission Scheduling for LTE-U-Enabled IoT

  2020cited by this paper
• Intelligent IoT Connectivity: Deep Reinforcement Learning Approach

  2020cited by this paper
• Parallel Reinforcement Learning With Minimal Communication Overhead for IoT Environments

  2020cited by this paper
• Task Scheduling Strategies for Utility Maximization in a Renewable-Powered IoT Node

  2020cited by this paper
• MMDP: A Mobile-IoT Based Multi-Modal Reinforcement Learning Service Framework

  2020cited by this paper
• Reinforcement Learning for Adaptive Resource Allocation in Fog RAN for IoT With Heterogeneous Latency Requirements

  2019cited by this paper
• Offloading Delay Constrained Transparent Computing Tasks With Energy-Efficient Transmission Power Scheduling in Wireless IoT Environment

  2019cited by this paper
• Reinforcement Learning for Real-Time Optimization in NB-IoT Networks

  2019cited by this paper
• Resource and Task Scheduling for SWIPT IoT Systems With Renewable Energy Sources

  2019cited by this paper
• Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services

  2018cited by this paper
• Internet-of-Things Security and Vulnerabilities: Taxonomy, Challenges, and Practice

  2018cited by this paper
• Applications of Deep Reinforcement Learning in Communications and Networking: A Survey

  2018cited by this paper
• MEETS: Maximal Energy Efficient Task Scheduling in Homogeneous Fog Networks

  2018cited by this paper
• Green Resource Allocation Based on Deep Reinforcement Learning in Content-Centric IoT

  2018cited by this paper
• A data intensive heuristic approach to the two-stage streaming scheduling problem

  2017cited by this paper
• PREEMPTIVE SCHEDULING IN A TWO-STAGE MULTIPROCESSOR FLOW SHOP IS NP-HARD

  1996cited by this paper
• Assistant Professor

  1995cited by this paper
• Optimal two- and three-stage production schedules with setup times included

  1954cited by this paper
• Intelligence

  1836cited by this paper

• Toward intelligent IoT scheduling with quantum-inspired latent models for energy and latency optimization

  2026cites this paper
• EFFICIENCY OF HANDLINE TUNA FISHERMEN'S WORKING TIME USING THE PERT APPROACH

  2026cites this paper
• Assessing rural sustainability in Guoliang village, China: an expectation livelihood prophecy approach

  2026cites this paper
• IGAA: Intent-Driven General Agentic AI for Edge Services Scheduling using Generative Meta Learning

  2026cites this paper
• FLARE: Federated Lightweight Agents for Reinforcement Environments in Microgrids

  2026cites this paper
• Cost Minimization Resource Allocation with Service Instance Caching and Task Migration for UAV Mobile Edge Computing

  2026cites this paper
• EdgeSched-DQN: An intelligent deep reinforcement learning-based framework for optimized task scheduling in edge-cloud environments

  2026cites this paper
• A Feature-Enhancement 6D Pose Estimation Method for Weakly Textured and Occluded Targets

  2025cites this paper
• Hybrid Programming-Based Scheduling Approach for Many Heterogeneous Computing Tasks With Asynchronous Generation in IIoT

  2025cites this paper
• Multi-Chain Fusion Reasoning for Knowledge Graph Link Prediction

  2025cites this paper
• Supporting QUIC Data Flows Over Consumer Electronic Devices: A Mobile Edge Computing-Oriented Queuing Delay Control Policy

  2025cites this paper
• Diversified caching algorithm with cooperation between edge servers

  2025cites this paper
• ADEmono-SLAM: Absolute Depth Estimation for Monocular Visual Simultaneous Localization and Mapping in Complex Environments

  2025cites this paper
• EDGECLOUD-DRL: A DEEP REINFORCEMENT LEARNING-BASED TASK SCHEDULING FRAMEWORK FOR EDGE-CLOUD COMPUTING

  2025cites this paper
• A Graph-Based Deep Reinforcement Learning Model for Task Scheduling on Heterogeneous Resource-Elastic Management of Resource Pool

  2025cites this paper
• A cloud edge resources scheduling method based on reinforcement learning in industrial internet of things

  2025cites this paper
• Momentum Survey Propagation: A Statistical Physics Approach to Resource Allocation in mMTC

  2025cites this paper
• Two-Stage Energy Prediction With Prior Estimation and Dynamic Adaptation for Symbiotic IOV

  2025cites this paper
• A Privacy Policy Text Compliance Reasoning Framework with Large Language Models for Healthcare Services

  2025cites this paper
• Optimizing LoRaWAN performance through Reinforcement Q-Convolutional Deterministic Policy Gradient: a comprehensive approach to efficient resource allocation

  2025cites this paper
• A Recovery-Mechanism-Driven Wireless Group Key Generation Protocol for Multiuser Scenarios

  2025cites this paper
• Reinforcement learning based Secure edge enabled multi task scheduling model for internet of everything applications

  2025influential citation
• Human Activity Recognition in Mobile Edge Computing: A Low-Cost and High-Fidelity Digital Twin Approach With Deep Reinforcement Learning

  2025cites this paper
• Optimizing the distribution of tasks in Internet of Things using edge processing-based reinforcement learning

  2025cites this paper
• Tensor-based task allocation using multi-objective optimization in GECC environment

  2025cites this paper
• Design and Research of High-Energy-Efficiency Underwater Acoustic Target Recognition System

  2025cites this paper
• Lightweight Algorithm for Steel Surface Defect Detection Based on PPY-YOLO

  2025cites this paper
• Collaborative task scheduling in IIoT: A comparative study of evolutionary algorithms and deep reinforcement learning

  2025cites this paper
• Systematic Review on Fluidized Bed Fault Diagnosis: From Fault Characteristics to Data-Driven Methods

  2025cites this paper
• Research on Computation Offloading and Resource Allocation Strategy Based on MADDPG for Integrated Space–Air–Marine Network

  2025cites this paper
• PacketDiff: A Flow Guided Diffusion Model for Network Packet Trace Generation

  2025cites this paper
• DRLO: Optimizing edge server placement in dynamic MEC scenarios using deep reinforcement learning

  2025cites this paper
• Collaborative Diversified Caching Strategies for Enhanced Performance in Edge Server Networks

  2025cites this paper
• Optimization of AI-Enabled Health Monitoring Equipment Configuration for Rescue Personnel

  2025cites this paper
• A Survey of Machine Unlearning in Generative AI Models: Methods, Applications, Security, and Challenges

  2025cites this paper
• Adaptive Two-Layer Inspection Framework for Mitigating Security Risks in Large-Scale Vertical Domain Language Models

  2025cites this paper
• Quantum-AI Scheduling Framework for Secure Healthcare Systems

  2025cites this paper
• A Survey of Freshness-Aware Wireless Networking with Reinforcement Learning

  2025cites this paper
• A Lightweight and Adaptive Image Inference Strategy for Earth Observation on LEO Satellites

  2025cites this paper
• IDCC: Influence-Driven Content Cache for NFC in IoE

  2025cites this paper
• Allocating constraint tasks schedules to promote on-demand cloud services by utilizing the Hungarian Algorithm

  2025cites this paper
• Distributed and real-time IoT task scheduling approach through a decision tree reinforcement learning

  2025cites this paper
• Signal Modulation Recognition Based on DRSLSTM Neural Network

  2025cites this paper
• Clustering TV Viewing Behavior for Digital Twin Construction Using Television Viewing History Data

  2025cites this paper
• Full Process Dynamics and HIL Simulation of Precise Airdrop System

  2025cites this paper
• Energy Consumption Optimization of UAV-Assisted Traffic Monitoring Scheme With Tiny Reinforcement Learning

  2024cites this paper
• An Online Scheduling Framework for Multiple TBD Flows in Intelligent Transportation Systems

  2024cites this paper
• A Domain Embedding Model for Botnet Detection Based on Smart Blockchain

  2024cites this paper
• Lightweight Blockchain-Enhanced Mutual Authentication Protocol for UAVs

  2024cites this paper
• Device-Specific QoE Enhancement Through Joint Communication and Computation Resource Scheduling in Edge-Assisted IoT Systems

  2024cites this paper
• Mean-field reinforcement learning for decentralized task offloading in vehicular edge computing

  2024cites this paper
• Cloud-SMPC: two-round multilinear maps secure multiparty computation based on LWE assumption

  2024cites this paper
• A Comprehensive Survey: Evaluating the Efficiency of Artificial Intelligence and Machine Learning Techniques on Cyber Security Solutions

  2024cites this paper
• HCEC: An efficient geo-distributed deep learning training strategy based on wait-free back-propagation

  2024cites this paper
• An intelligent prediction model of epidemic characters based on multi-feature

  2024cites this paper
• A Deep Reinforcement Learning-Based Optimal Transmission Control Method for Streaming Videos

  2024cites this paper
• Makespan minimization for workflows with multiple privacy levels

  2024cites this paper
• Big data for furniture intelligent manufacturing: conceptual framework, technologies, applications, and challenges

  2024cites this paper
• Enhancing Cybersecurity With P-Code Analysis and XGBoost: A Novel Approach for Malicious VBA Macro Detection in Office Documents

  2024cites this paper
• MPR-QUIC: Multi-path partially reliable transmission for priority and deadline-aware video streaming

  2024cites this paper
• Deep reinforcement learning based interpretable photovoltaic power prediction framework

  2024cites this paper
• Intelligent Services in the IoE Paradigm: A New Age of Collaboration

  2024cites this paper
• An End-to-End Deep Reinforcement Learning Framework for Electric Vehicle Routing Problem

  2024cites this paper
• Over-the-Air Computation Based on Optimal Node Selection in Densely Deployed IoT Networks

  2024cites this paper
• Model-Based GNN Enabled Energy-Efficient Beamforming for Ultra-Dense Wireless Networks

  2024cites this paper
• ERTH scheduler: enhanced red-tailed hawk algorithm for multi-cost optimization in cloud task scheduling

  2024cites this paper
• Towards a Blockchain and Opportunistic Edge Driven Metaverse of Everything

  2024cites this paper
• Internet of Everything for Monitoring Exhaust Gas Emissions on Green Campuses: A Survey

  2024cites this paper
• Dynamic Adaptive Reinforcement Learning based Resource Allocation in Industrial Internet of Things

  2024cites this paper
• Decentralized IoT Resource Monitoring and Scheduling Framework Based on Blockchain

  2023cites this paper
• Security Framework for Internet-of-Things-Based Software-Defined Networks Using Blockchain

  2023cites this paper
• Edge Computing Scheduling Method for Related Tasks of Industrial Internet of Things

  2023cites this paper
• A Blockchain-Assisted Intelligent Edge Cooperation System for IoT Environments With Multi-Infrastructure Providers

  2023cites this paper
• Secured Dynamic Request Scheduling and Optimal CSP Selection for Analyzing Cloud Service Performance Using Intelligent Approaches

  2023cites this paper
• Fidan: a predictive service demand model for assisting nursing home health-care robots

  2023cites this paper
• Intelligent Cooperative Caching at Mobile Edge based on Offline Deep Reinforcement Learning

  2023cites this paper
• Evaluating test quality of Python libraries for IoT applications at the network edge

  2023cites this paper
• Application of Chaotic Cat Swarm Optimization in Cloud Computing Multi Objective Task Scheduling

  2023cites this paper
• Energy Efficient Beamforming for Small Cell Systems: A distributed Learning and Multicell Coordination Approach

  2023cites this paper
• MFGAD-INT: in-band network telemetry data-driven anomaly detection using multi-feature fusion graph deep learning

  2023cites this paper
• Blockchain-Enabled Lightweight Fine-Grained Searchable Knowledge Sharing for Intelligent IoT

  2023cites this paper
• Opportunistic Digital Twin: an Edge Intelligence enabler for Smart City

  2023cites this paper
• ROMSS: a rational optional multi-secret sharing scheme based on reputation mechanism

  2023cites this paper
• A novel forgery classification method based on multi‐scale feature capsule network in mobile edge computing

  2023cites this paper
• A License Management and Fine-Grained Verifiable Data Access Control System for Online Catering

  2023cites this paper
• A Many-Objective Optimized Sharding Scheme for Blockchain Performance Improvement in End–Edge-Enabled Internet of Things

  2023cites this paper
• Edge-enabled federated sequential recommendation with knowledge-aware Transformer

  2023cites this paper
• A distributed game theoretical approach for credibility-guaranteed multimedia data offloading in MEC

  2023cites this paper
• TMETA: Trust Management for the Cold Start of IoT Services With Digital-Twin-Aided Blockchain

  2023cites this paper
• Hedera: A Permissionless and Scalable Hybrid Blockchain Consensus Algorithm in Multiaccess Edge Computing for IoT

  2023cites this paper
• Ensuring security in edge computing through effective blockchain node detection

  2023cites this paper
• Blockchain-Based Data Access Security Solutions for Medical Wearables

  2023cites this paper
• Blockchain-Based Access and Timeliness Control for Administrative Punishment Market Supervision

  2023cites this paper
• Identification of encrypted and malicious network traffic based on one-dimensional convolutional neural network

  2023cites this paper
• An Efficient Framework for Unsupervised Anomaly Detection over Edge-Assisted Internet of Things

  2023cites this paper
• Potentially Unwanted App Detection for Blockchain-Based Android App Marketplace

  2023cites this paper
• Securing FPGAs in IoT: a new run-time monitoring technique against hardware Trojan

  2023cites this paper
• A Robust Deep Learning Framework Based on Spectrograms for Heart Sound Classification

  2023cites this paper
• Searchable and secure edge pre-cache scheme for intelligent 6G wireless systems

  2022cites this paper
• Predicting the reaction efficiency of ginkgo biloba residues pyrolysis by using artificial intelligent algorithms under the background of Carbon Neutrality

  2022cites this paper