A review of remote sensing image segmentation by deep learning methods

ABSTRACT Remote sensing (RS) images enable high-resolution information collection from complex ground objects and are increasingly utilized in the earth observation research. Recently, RS technologies are continuously enhanced by various characterized platforms and sensors. Simultaneously, artificial intelligence vision algorithms are also developing vigorously and playing a significant role in RS image analysis. In particular, aiming to divide images into different ground elements with specific semantic labels, RS image segmentation could realize the visual acquisition and interpretation. As one of the pioneering methods with the advantages of deep feature extraction ability, deep learning (DL) algorithms have been exploited and proved to be highly beneficial for precise segmentation in recent years. In this paper, a comprehensive review is performed on remote sensing survey systems and various kinds of specially designed deep learning architectures. Meanwhile, DL-based segmentation methods applied on four domains are also illustrated, including geography, precision agriculture, hydrology, and environmental protection issues. In the end, the existing challenges and promising research directions in RS image segmentation are discussed. It is envisioned that this review is able to provide a comprehensive and technical reference, deployment and successful exploitation of DL empowered RS image segmentation approaches.

• Publication year

  2024

• Venue

  International Journal of Digital Earth

• Publication date

  2024-03-18

• Fields of study

  Computer Science, Environmental Science

• Identifiers
  DOI 10.1080/17538947.2024.2328827
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Deep-Learning-Based Semantic Segmentation of Remote Sensing Images: A Survey

  2024cited by this paper
• Coupling of deep learning and remote sensing: a comprehensive systematic literature review

  2023cited by this paper
• Semi-Supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning

  2023cited by this paper
• Research on remote sensing image carbon emission monitoring based on deep learning

  2023cited by this paper
• AI meets UAVs: A survey on AI empowered UAV perception systems for precision agriculture

  2023cited by this paper
• Extended Vision Transformer (ExViT) for Land Use and Land Cover Classification: A Multimodal Deep Learning Framework

  2023cited by this paper
• Changes in Carbon Dioxide Balance Associated with Land Use and Land Cover in Brazilian Legal Amazon Based on Remotely Sensed Imagery

  2023cited by this paper
• RingMo: A Remote Sensing Foundation Model With Masked Image Modeling

  2023cited by this paper
• Novel Convolutions for Semantic Segmentation of Remote Sensing Images

  2023cited by this paper
• Segment Anything

  2023cited by this paper
• DensePPMUNet-a: A Robust Deep Learning Network for Segmenting Water Bodies From Aerial Images

  2023cited by this paper
• SpectralGPT: Spectral Foundation Model

  2023cited by this paper
• Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networks

  2023cited by this paper
• SpectralDiff: A Generative Framework for Hyperspectral Image Classification With Diffusion Models

  2023cited by this paper
• Deep learning-based semantic segmentation of remote sensing images: a review

  2023cited by this paper
• Remotely Sensed Crop Disease Monitoring by Machine Learning Algorithms: A Review

  2023cited by this paper
• Deep segmentation and classification of complex crops using multi-feature satellite imagery

  2022influential reference
• Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-high-resolution Remote Sensing Imagery

  2022cited by this paper
• A Novel Weakly Supervised Remote Sensing Landslide Semantic Segmentation Method: Combining CAM and cycleGAN Algorithms

  2022cited by this paper
• DSS-TRM: deep spatial–spectral transformer for hyperspectral image classification

  2022cited by this paper
• UAV Multispectral Image-Based Urban River Water Quality Monitoring Using Stacked Ensemble Machine Learning Algorithms - A Case Study of the Zhanghe River, China

  2022cited by this paper
• Self-Supervised Learning in Remote Sensing: A review

  2022cited by this paper
• Land use land cover classification of remote sensing images based on the deep learning approaches: a statistical analysis and review

  2022cited by this paper
• Hyperspectral Image Transformer Classification Networks

  2022cited by this paper
• Hyperspectral Imagery Classification Based on Contrastive Learning

  2022cited by this paper
• Accurate Water Extraction Using Remote Sensing Imagery Based on Normalized Difference Water Index and Unsupervised Deep Learning

  2022cited by this paper
• A Dual Global-local Attention Network for Hyperspectral Band Selection

  2022cited by this paper
• High-Resolution Boundary-Constrained and Context-Enhanced Network for Remote Sensing Image Segmentation

  2022cited by this paper
• Perceiving Spectral Variation: Unsupervised Spectrum Motion Feature Learning for Hyperspectral Image Classification

  2022cited by this paper
• Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

  2022cited by this paper
• Deep Learning for Landslide Detection and Segmentation in High-Resolution Optical Images along the Sichuan-Tibet Transportation Corridor

  2022cited by this paper
• Hyper-LGNet: Coupling Local and Global Features for Hyperspectral Image Classification

  2022cited by this paper
• Hyper-ES2T: Efficient Spatial-Spectral Transformer for the classification of hyperspectral remote sensing images

  2022influential reference
• Convolutional Neural Network Algorithms for Semantic Segmentation of Volcanic Ash Plumes Using Visible Camera Imagery

  2022cited by this paper
• Transformers in Remote Sensing: A Survey

  2022cited by this paper
• Segmentation of Weakly Visible Environmental Microorganism Images Using Pair-wise Deep Learning Features

  2022cited by this paper
• Semi-Supervised and Unsupervised Deep Visual Learning: A Survey

  2022cited by this paper
• Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

  2022cited by this paper
• Intriguing Properties of Vision Transformers

  2021cited by this paper
• Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

  2021cited by this paper
• A review of deep learning methods for semantic segmentation of remote sensing imagery

  2021cited by this paper
• Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions

  2021cited by this paper
• Plant diseases and pests detection based on deep learning: a review

  2021cited by this paper
• Deep Learning-Based Semantic Segmentation of Urban Features in Satellite Images: A Review and Meta-Analysis

  2021cited by this paper
• UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery

  2021influential reference
• Global and Local Contrastive Self-Supervised Learning for Semantic Segmentation of HR Remote Sensing Images

  2021cited by this paper
• Label-Efficient Semantic Segmentation with Diffusion Models

  2021influential reference
• Masked Autoencoders Are Scalable Vision Learners

  2021cited by this paper
• Deep learning for geological hazards analysis: Data, models, applications, and opportunities

  2021cited by this paper
• Spectral-Spatial Transformer Network for Hyperspectral Image Classification: A Factorized Architecture Search Framework

  2021cited by this paper
• STransFuse: Fusing Swin Transformer and Convolutional Neural Network for Remote Sensing Image Semantic Segmentation

  2021cited by this paper
• Comparative Analysis of Machine Learning Algorithms in Automatic Identification and Extraction of Water Boundaries

  2021cited by this paper
• Urban tree species classification using UAV-based multi-sensor data fusion and machine learning

  2021cited by this paper
• Semantic Segmentation of Tree-Canopy in Urban Environment with Pixel-Wise Deep Learning

  2021cited by this paper
• A Deep-Learning-Based Approach for Wheat Yellow Rust Disease Recognition from Unmanned Aerial Vehicle Images

  2021cited by this paper
• Efficient Transformer for Remote Sensing Image Segmentation

  2021cited by this paper
• Ir-UNet: Irregular Segmentation U-Shape Network for Wheat Yellow Rust Detection by UAV Multispectral Imagery

  2021cited by this paper
• Deep-Learning-Based Multispectral Satellite Image Segmentation for Water Body Detection

  2021cited by this paper
• Tomato plant disease detection using transfer learning with C-GAN synthetic images

  2021cited by this paper
• Semantic Segmentation of Remote Sensing Images With Self-Supervised Multitask Representation Learning

  2021cited by this paper
• SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers

  2021cited by this paper
• Land-Use Mapping for High-Spatial Resolution Remote Sensing Image Via Deep Learning: A Review

  2021cited by this paper
• Aerial Visual Perception in Smart Farming: Field Study of Wheat Yellow Rust Monitoring

  2021influential reference
• A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images

  2021cited by this paper
• CT-UNet: An Improved Neural Network Based on U-Net for Building Segmentation in Remote Sensing Images

  2021cited by this paper
• High-Resolution Remote Sensing Image Segmentation Framework Based on Attention Mechanism and Adaptive Weighting

  2021cited by this paper
• Emerging Properties in Self-Supervised Vision Transformers

  2021cited by this paper
• Semantic Segmentation of Remote Sensing Images Using Transfer Learning and Deep Convolutional Neural Network With Dense Connection

  2020cited by this paper
• HSI-BERT: Hyperspectral Image Classification Using the Bidirectional Encoder Representation From Transformers

  2020cited by this paper
• Automated regional seismic damage assessment of buildings using an unmanned aerial vehicle and a convolutional neural network

  2020cited by this paper
• A Simple Framework for Contrastive Learning of Visual Representations

  2020cited by this paper
• Environmental and Health Impacts of Air Pollution: A Review

  2020cited by this paper
• A convolutional neural network approach for counting and geolocating citrus-trees in UAV multispectral imagery

  2020cited by this paper
• Review: Cost-Effective Unmanned Aerial Vehicle (UAV) Platform for Field Plant Breeding Application

  2020cited by this paper
• Water Identification from High-Resolution Remote Sensing Images Based on Multidimensional Densely Connected Convolutional Neural Networks

  2020cited by this paper
• Classification method of CO2 hyperspectral remote sensing data based on neural network

  2020influential reference
• A review of remote sensing applications for water security: Quantity, quality, and extremes

  2020cited by this paper
• Land-Use Land-Cover Classification by Machine Learning Classifiers for Satellite Observations - A Review

  2020cited by this paper
• A Multi-Scale Water Extraction Convolutional Neural Network (MWEN) Method for GaoFen-1 Remote Sensing Images

  2020cited by this paper
• Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

  2020cited by this paper
• Big Self-Supervised Models are Strong Semi-Supervised Learners

  2020cited by this paper
• Unsupervised Learning of Visual Features by Contrasting Cluster Assignments

  2020cited by this paper
• The color out of space: learning self-supervised representations for Earth Observation imagery

  2020cited by this paper
• Convolutional Neural Network Based on Bandwise-Independent Convolution and Hard Thresholding for Hyperspectral Band Selection

  2020cited by this paper
• Surface water detection and delineation using remote sensing images: a review of methods and algorithms

  2020cited by this paper
• A New Multi-Channel Deep Convolutional Neural Network for Semantic Segmentation of Remote Sensing Image

  2020cited by this paper
• More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification

  2020cited by this paper
• Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images

  2020cited by this paper
• A Review of Advanced Technologies and Development for Hyperspectral-Based Plant Disease Detection in the Past Three Decades

  2020influential reference
• PseudoSeg: Designing Pseudo Labels for Semantic Segmentation

  2020cited by this paper
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

  2020cited by this paper
• When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework

  2020cited by this paper
• Semi-Supervised Remote Sensing Image Semantic Segmentation via Consistency Regularization and Average Update of Pseudo-Label

  2020cited by this paper
• A method for experimental warming of developing tree seeds with a common garden demonstration of seedling responses

  2020cited by this paper
• HRCNet: High-Resolution Context Extraction Network for Semantic Segmentation of Remote Sensing Images

  2020cited by this paper
• Transfer Learning on EfficientNet for Remote Sensing image Classification

  2020influential reference
• Crop Classification using Multi-spectral and Multitemporal Satellite Imagery with Machine Learning

  2019cited by this paper
• Momentum Contrast for Unsupervised Visual Representation Learning

  2019cited by this paper
• Object-Contextual Representations for Semantic Segmentation

  2019cited by this paper
• Detection of Changes in Surface Water Bodies Urban Area with NDWI and MNDWI Methods

  2019influential reference

• Ecological mapping with geospatial foundation models

  2026cites this paper
• Breaking the Scale Barrier: A Scale-Progressive Water Body Extraction Framework Inspired by Human Cognitive Mechanisms

  2026cites this paper
• Progressive Attention-Enhanced EfficientNet–UNet for Robust Water-Body Mapping from Satellite Imagery

  2026cites this paper
• Deep Learning Applied to Spaceborne SAR Interferometry for Detecting Sinkhole-Induced Land Subsidence Along the Dead Sea

  2026cites this paper
• LGD-DeepLabV3+: An Enhanced Framework for Remote Sensing Semantic Segmentation via Multi-Level Feature Fusion and Global Modeling

  2026cites this paper
• CryoFlora: Automated Instance Segmentation of Cushion Plants for Species-Level Monitoring in Moraine–Talus Ecosystem

  2026cites this paper
• Slag Detection From Molten Material Using Visible Images and the SIFT Algorithm

  2026cites this paper
• A Deformable Dual-Branch Visual State-Space Network for Landslide Identification with Multi-Scale Recognition and Irregular Boundary Enhancement

  2026cites this paper
• Adaptive Remote Sensing Image Enhancement for KOMPSAT Imagery

  2026cites this paper
• ULISSE: Parameter-efficient adaptation of earth vision models to monitor forest disturbance in sentinel-2 time series

  2026cites this paper
• Multi-scale boundary-aware network for remote sensing image semantic segmentation

  2026cites this paper
• A High-Level Survey of Optical Remote Sensing

  2026cites this paper
• Mapping soil total carbon using multisource remote sensing at the continental scale

  2026cites this paper
• Hybrid Integration of CNN and Kolmogorov–Arnold Networks for Multispectral Image Super-Resolution

  2026cites this paper
• Frequency-Guided Denoising Network for Semantic Segmentation of Remote Sensing Images

  2026cites this paper
• MAF-UFormer: Oil spill detection in SAR images using multi-scale alignment and fusion U-shaped transformer network

  2026cites this paper
• GeoVision Labeler: Zero-Shot Geospatial Classification with Vision and Language Models

  2025cites this paper
• Weakly-Supervised Semantic Segmentation Based on Multi-Strategy Collaboration

  2025cites this paper
• Prototype-Aligned Federated Learning for Robust Object Extraction in Heterogeneous Remote Sensing

  2025cites this paper
• 一种耦合ResNet与Transformer的高分遥感语义分割方法

  2025cites this paper
• Optimizing farmland shelterbelts identification: a novel framework based on the PF-Deeplab model and multi-task collaborative strategy

  2025cites this paper
• Crop Classification in UAV Remote Sensing Images Using Segment Anything Model

  2025cites this paper
• Deep Learning-Driven Transformation of Remote Sensing Education for Ecological Civilization and Sustainable Development

  2025cites this paper
• Enhancing land use and land cover classification with deep learning-based satellite imagery segmentation

  2025cites this paper
• RLRAnet: Reinforcement Learning-Guided Reverse Attention Network for Remote Sensing Tubular Structure

  2025cites this paper
• WetSegNet: An Edge-Guided Multi-Scale Feature Interaction Network for Wetland Classification

  2025cites this paper
• Deep learning for air pollutant forecasting: opportunities, challenges, and future directions

  2025cites this paper
• Prior knowledge-informed semantic segmentation framework for precise glacial lake mapping from multimodal imagery

  2025cites this paper
• Scale-adaptive and mask refinement modules for accurate alluvial fan boundary detection in remote sensing data

  2025cites this paper
• GLMambaNet: Mamba-based decoder with local detail enhancement for semantic segmentation of remote sensing imagery

  2025cites this paper
• Establishing a Historical Fine-Resolution Urban Database from KH-9 HEXAGON MCS and PCS Imagery Including an Urban Landscape Map, Stereo Anaglyph Image and Digital Surface Model

  2025cites this paper
• Adaptive Feature Recalibration Network for More Accurate Instance Segmentation in Remote Sensing

  2025cites this paper
• Automated mask generation in citizen science smartphone photos and their value for mapping plant species in drone imagery

  2025cites this paper
• Developing Interpretable Deep Learning Model for Subtropical Forest Type Classification Using Beijing-2, Sentinel-1, and Time-Series NDVI Data of Sentinel-2

  2025cites this paper
• Multitemporal Multispectral Dataset for Palaeochannels Segmentation (MAPS)

  2025cites this paper
• Multihop Weighted Graph Fusion Network For SAR Image Segmentation

  2025cites this paper
• Detecting Abandoned Cropland in Monsoon-Influenced Regions Using HLS Imagery and Interpretable Machine Learning

  2025cites this paper
• A review of deep learning based agricultural remote sensing image segmentation

  2025cites this paper
• GPRNet: A Geometric Prior-Refined Semantic Segmentation Network for Land Use and Land Cover Mapping

  2025cites this paper
• Advancing Riverine–Lacustrine Ecosystem Vulnerability Prediction Using Multi-Sensor Satellite Data, Attention-Based Deep Learning, and Evolutionary Metaheuristics

  2025cites this paper
• RELACT: instance segmentation method for remote sensing small object based on phase enhancement and optimized sorting

  2025cites this paper
• Optimising Deep Learning-Based Segmentation of Crop and Soil Marks with Spectral Enhancements on Sentinel-2 Data

  2025cites this paper
• Toward Stable Semi-Supervised Remote Sensing Segmentation via Co-Guidance and Co-Fusion

  2025cites this paper
• Multimodal Interpretation of Remote Sensing Images: Dynamic Resolution Input Strategy and Multi-scale Vision-Language Alignment Mechanism

  2025cites this paper
• Intelligent Landslide Susceptibility Assessment Framework Using the Swin Transformer Technique: A Case Study of Changbai County, Jilin Province, China

  2025cites this paper
• Artificial Intelligence-Powered Space Systems Including Launch, Space, Ground and User Segments: Current Status and Future Challenges

  2025cites this paper
• A vision-language model for predicting potential distribution land of soybean double cropping

  2025cites this paper
• Sea surface wind field retrieval under typhoon sea state using DenseNet

  2025cites this paper
• SCR-Net: A Dual-Channel Water Body Extraction Model Based on Multi-Spectral Remote Sensing Imagery—A Case Study of Daihai Lake, China

  2025cites this paper
• STURM-Flood: a curated dataset for deep learning-based flood extent mapping leveraging Sentinel-1 and Sentinel-2 imagery

  2025cites this paper
• A Land Spatial Optimization Approach for the Reutilization of Abandoned Mine Land: A Case Study of Ningbo, China

  2025cites this paper
• A Weakly Supervised and Self-Supervised Learning Approach for Semantic Segmentation of Land Cover in Satellite Images with National Forest Inventory Data

  2025cites this paper
• DLNet: A Dual-Level Network with Self- and Cross-Attention for High-Resolution Remote Sensing Segmentation

  2025influential citation
• Integrating unsupervised domain adaptation and SAM technologies for image semantic segmentation: a case study on building extraction from high-resolution remote sensing images

  2025cites this paper
• Multimodal Image Classification Based on Convolutional Network and Attention-Based Hidden Markov Random Field

  2025cites this paper
• Adaptive Structure-Aware Connectivity-Preserving Loss for Improved Road Segmentation in Remote Sensing Images

  2025cites this paper
• Using Aerial Videos for Natural Disaster Damage Assessment

  2025cites this paper
• Integration of Hyperspectral Imaging and AI Techniques for Crop Type Mapping: Present Status, Trends, and Challenges

  2025cites this paper
• Oversized ore segmentation using SAM-enhanced U-Net with self-supervised pre-training and semi-supervised self-training

  2025cites this paper
• From Pixels to Images: Deep Learning Advances in Remote Sensing Image Semantic Segmentation

  2025cites this paper
• A hybrid deep learning approach for accurate water body segmentation in satellite imagery

  2025cites this paper
• Segmentation Based Detection of Jackfruit Diseases: A YOLOv11 Approach

  2025cites this paper
• YOLO-FHE: A Lightweight and Efficient Feature Aggregation Network for Object Detection in Remote Sensing

  2025cites this paper
• From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentation

  2025cites this paper
• Land-Cover Classification Technology Based on Deep Learning Algorithms for Predicting Fire Spread in Wildland-Urban Interface

  2024cites this paper
• Automated agricultural monitoring using deep learning: Crop type classification and farmland segmentation in Rwanda

  2024cites this paper
• Target Detection of Diamond Nanostructures Based on Improved YOLOv8 Modeling

  2024cites this paper
• Gaussian-based R-CNN with large selective kernel for rotated object detection in remote sensing images

  2024cites this paper
• Advancing perturbation space expansion based on information fusion for semi-supervised remote sensing image semantic segmentation

  2024cites this paper
• AAMS-YOLO: enhanced farmland parcel detection for high-resolution remote sensing images

  2024cites this paper
• Revealing the evolution of order in materials microstructures using multi-modal computer vision

  2024cites this paper
• A land parcel segmentation method for remote-sensing images based on an improved U-Net network

  2024cites this paper
• High-resolution feature pyramid attention network for high spatial resolution images land-cover classification in arid oasis zones

  2024cites this paper
• A Comprehensive Approach Towards Enhancing Land Use Land Cover Classification Through Machine Learning and Object-Based Image Analysis

  2024influential citation
• High-Resolution Solar Panel Detection in Sfax, Tunisia: A UNet-Based Approach

  2024cites this paper
• ASCEND-UNet: An Improved UNet Configuration Optimized for Rural Settlements Mapping

  2024cites this paper
• Rethinking high-resolution remote sensing image segmentation not limited to technology: a review of segmentation methods and outlook on technical interpretability

  2024cites this paper
• Federated learning meets remote sensing

  2024cites this paper
• Optimising Pixel-Wise Time-Series Analysis of Vegetation Indices Imagery via Key-Pixel Selection

  year unknowncites this paper