Satellite Observation and Data-Transmission Scheduling Using Imitation Learning Based on Mixed Integer Linear Programming

The Earth observation satellites (EOSs) scheduling problem is generally considered as a complex combinatorial optimization problem due to various technical constraints. It is significant to develop efficient computational frameworks to solve this problem. In this article, an intelligent EOSs scheduling framework is developed using imitation learning based on mixed integer linear programming (MILP). The scheduling framework is composed of two processes: preprocessing, modeling, and solving process. In the preprocessing process, an analytical method to generate the available time windows of an EOS is derived after considering the effects of Earth's $J_{2}$ perturbation on the elliptic orbit. Based on the preprocessing results, this problem is formulated as an MILP model in the modeling process. In the solving process, a smart algorithm is proposed based on imitation learning for branch-and-bound to accelerate the solving process. Compared with normal imitation learning, a data selection method works in our algorithm to avoid potential misleading for learning. Besides, an iterative view is also adopted to improve the performance of the trained strategy. In the end, several real-world EOSs scheduling scenarios are investigated to demonstrate the reliability and high efficiency of this framework.

• Publication year

  2023

• Venue

  IEEE Transactions on Aerospace and Electronic Systems

• Publication date

  2023-04-01

• Fields of study

  Computer Science, Engineering, Environmental Science

• Identifiers
  DOI 10.1109/TAES.2022.3210073
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Learning generalized strong branching for set covering, set packing, and 0-1 knapsack problems

  2022cited by this paper
• An improved genetic algorithm for the integrated satellite imaging and data transmission scheduling problem

  2022cited by this paper
• Multitree Search for Multisatellite Responsiveness Scheduling Considering Orbital Maneuvering

  2022cited by this paper
• Learning-Based Policy Optimization for Adversarial Missile-Target Assignment

  2022cited by this paper
• Solving the Agile Earth Observation Satellite Scheduling Problem With Time-Dependent Transition Times

  2022cited by this paper
• A Generic Markov Decision Process Model and Reinforcement Learning Method for Scheduling Agile Earth Observation Satellites

  2022cited by this paper
• An era of Sentinels in flood management: Potential of Sentinel-1, -2, and -3 satellites for effective flood management

  2021cited by this paper
• Multi-satellites imaging scheduling using individual reconfiguration based integer coding genetic algorithm

  2021cited by this paper
• An Online Distributed Satellite Cooperative Observation Scheduling Algorithm Based on Multiagent Deep Reinforcement Learning

  2021cited by this paper
• Task scheduling for optimal power management and quality-of-service assurance in CubeSats

  2021cited by this paper
• Geometric Analysis of Ground-Target Coverage from a Satellite by Field-Mapping Method

  2021cited by this paper
• Revising the Observation Satellite Scheduling Problem Based on Deep Reinforcement Learning

  2021cited by this paper
• Scheduling of a Constellation of Satellites: Creating a Mixed-Integer Linear Model

  2021cited by this paper
• A population perturbation and elimination strategy based genetic algorithm for multi-satellite TT&C scheduling problem

  2021cited by this paper
• Data-Driven Heuristic Assisted Memetic Algorithm for Efficient Inter-Satellite Link Scheduling in the BeiDou Navigation Satellite System

  2021cited by this paper
• Deep reinforcement learning and parameter transfer based approach for the multi-objective agile earth observation satellite scheduling problem

  2021cited by this paper
• Mission planning for Earth observation satellite with competitive learning strategy

  2021cited by this paper
• China's Gaofen-3 Satellite System and Its Application and Prospect

  2021cited by this paper
• Geometric analysis of a constellation with a ground target

  2021cited by this paper
• Robust Earth Observation Satellite Scheduling With Uncertainty of Cloud Coverage

  2020cited by this paper
• A Data-Driven Parallel Scheduling Approach for Multiple Agile Earth Observation Satellites

  2020cited by this paper
• What is being transferred in transfer learning?

  2020cited by this paper
• Automated Processing of Declassified KH-9 Hexagon Satellite Images for Global Elevation Change Analysis Since the 1970s

  2020cited by this paper
• Hybrid Models for Learning to Branch

  2020cited by this paper
• Agile Earth Observation Satellite Scheduling Over 20 Years: Formulations, Methods, and Future Directions

  2020cited by this paper
• Optimisation problems and resolution methods in satellite scheduling and space-craft operation: a survey

  2019cited by this paper
• A two-stage flow-shop scheme for the multi-satellite observation and data-downlink scheduling problem considering weather uncertainties

  2019cited by this paper
• Competition:

  2019cited by this paper
• Exact Combinatorial Optimization with Graph Convolutional Neural Networks

  2019influential reference
• BAIL: Best-Action Imitation Learning for Batch Deep Reinforcement Learning

  2019cited by this paper
• Forest structure parameter extraction using SPOT-7 satellite data by object- and pixel-based classification methods

  2019cited by this paper
• An Algorithm for the Traveling Salesman Problem

  2019cited by this paper
• Analysis of Satellite Constellations for the Continuous Coverage of Ground Regions

  2017cited by this paper
• Learning to Branch in Mixed Integer Programming

  2016cited by this paper
• The evolution of Earth Observation satellites in Europe and its impact on the performance of emergency response services

  2016cited by this paper
• A Supervised Machine Learning Approach to Variable Branching in Branch-And-Bound

  2014cited by this paper
• Landsat: building a strong future

  2012cited by this paper
• Branching rules revisited

  2005cited by this paper

• FlexSatIoE: Flexible Routing and Buffering for Satellite Networks Enabled Internet of Everything Applications

  2026cites this paper
• UHTS-DRL: A deep reinforcement learning framework for integrated agile satellite observation and data transmission scheduling

  2026cites this paper
• Earth observation satellite scheduling problem for multitemporal revisit tasks: A variable neighborhood search algorithm

  2026cites this paper
• Autonomous scheduling method for multi-satellite collaboration with multi-dimensional optimization

  2026cites this paper
• A unified scheduling approach for earth observation satellites with large-scale and heterogeneous tasks

  2026cites this paper
• Multisatellite Scheduling via Reinforcement Learning-Based Mixed Integer Linear Programming

  2026cites this paper
• Efficient Tube Model Predictive Control for Nonlinear Stochastic Systems

  2026cites this paper
• Joint observation and transmission scheduling of multiple agile satellites with energy constraint using improved ACO algorithm

  2025cites this paper
• RCM: A Neural Policy Model With Reconstruction Mechanism to Construct a Solution for the Agile Satellite Scheduling Problem

  2025cites this paper
• Enhanced PTZ Camera Dispatch Scheme for 3-D Environments Based on Deep Reinforcement Learning

  2025cites this paper
• A neural priority model for agile earth observation satellite scheduling using deep reinforcement learning

  2025cites this paper
• A review of the frameworks, models, and algorithms for large-scale imaging satellite mission planning

  2025cites this paper
• Deep Reinforcement Learning and Edge Computing for Multisatellite On-Orbit Task Scheduling

  2025cites this paper
• Integrated Earth Observation Satellite Scheduling with Relay-Assisted Downlink

  2025cites this paper
• Deep Reinforcement Learning for Joint Observation and On-Orbit Computation Scheduling in Agile Satellite Constellations

  2025cites this paper
• Rapid Assembly Mission Planning of Remote Sensing Constellations for Hotspot Area Observation

  2025cites this paper
• Learning to Construct a Solution for the Agile Satellite Scheduling Problem With Time-Dependent Transition Times

  2024cites this paper
• Parallel Dual Adaptive Genetic Algorithm: A Method for Satellite Constellation Task Assignment in Time-Sensitive Target Tracking

  2024cites this paper
• Reinforcement Learning Driven Time-Sensitive Moving Target Tracking of Intelligent Agile Satellite

  2024cites this paper
• Reinforcement Learning for Solving the Job Shop Scheduling Problem Based on Traveling Salesman Problem Model

  2024cites this paper
• Chain-Splitting-Solving-Splicing Approach to Large-Scale OFISP-Modeled Satellite Range Scheduling Problem

  2024cites this paper
• Multi-Layer Objective Model and Progressive Optimization Mechanism for Multi-Satellite Imaging Mission Planning in Large-Scale Target Scenarios

  2024cites this paper
• A Multi-Pointer Network for Multiple Agile Optical Satellite Scheduling Problem

  2024cites this paper
• A Distributed Hungarian-Based Algorithm for Multi-Robot Task Allocation with Load Balancing

  2024cites this paper
• Knowledge-guided evolutionary algorithm for multi-satellite resource scheduling optimization

  2024cites this paper
• Earth Observation Satellite Scheduling With Interval-Varying Profits

  2024cites this paper
• Reviews and prospects in satellite range scheduling problem

  2023cites this paper
• Prediction-Assisted Task Offloading and Resource Allocation in Two-Tier Mobile-Edge Computing Network Based on LSTM

  2023cites this paper
• Solving Distribute Flexible Flow Shop Scheduling Problem with an Imitation Learning Framework

  2023cites this paper
• Improving energy aware nanosatellite task scheduling by a branch-cut-and-price algorithm

  2023cites this paper
• A Novel Scheduling Scheme for Earth Observation in LEO Satellite Systems

  2023cites this paper
• Cooperative Spacecraft Formation Flying Based on Reinforcement Learning

  2023cites this paper
• Multi-satellite Mission Planning Algorithm Based on Preemptive Priority Model

  2023cites this paper