Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community

Abstract. In recent years, deep learning (DL), a rebranding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, and natural language processing. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV, e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should not only be aware of advancements such as DL, but also be leading researchers in this area. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools, and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as they relate to (i) inadequate data sets, (ii) human-understandable solutions for modeling physical phenomena, (iii) big data, (iv) nontraditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial, and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.

• Publication year

  2017

• Venue

  Journal of Applied Remote Sensing

• Publication date

  2017-09-23

• Fields of study

  Computer Science, Engineering, Environmental Science

• Identifiers
  DOI 10.1117/1.JRS.11.042609
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Introduction to Deep Learning

  2019cited by this paper
• Land Use and Land Cover Classification Using Deep Learning Techniques

  2019cited by this paper
• Recurrent Neural Networks

  2018cited by this paper
• On the Expressive Power of Overlapping Operations of Deep Networks

  2017cited by this paper
• Scene classification based on a hierarchical convolutional sparse auto-encoder for high spatial resolution imagery

  2017cited by this paper
• Hyperspectral image reconstruction by deep convolutional neural network for classification

  2017cited by this paper
• Convolutional neural networks for hyperspectral image classification

  2017cited by this paper
• BEGAN: Boundary Equilibrium Generative Adversarial Networks

  2017cited by this paper
• Remote Sensing Image Scene Classification: Benchmark and State of the Art

  2017influential reference
• How deep learning extracts and learns leaf features for plant classification

  2017cited by this paper
• Transferred Deep Learning for Anomaly Detection in Hyperspectral Imagery

  2017cited by this paper
• Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

  2017cited by this paper
• Top Downloads in IEEE Xplore [Reader's Choice]

  2017cited by this paper
• R-VCANet: A New Deep-Learning-Based Hyperspectral Image Classification Method

  2017cited by this paper
• SatCNN: satellite image dataset classification using agile convolutional neural networks

  2017cited by this paper
• A survey of deep neural network architectures and their applications

  2017cited by this paper
• Fully Convolutional Networks for Semantic Segmentation

  2017cited by this paper
• Plant identification using deep neural networks via optimization of transfer learning parameters

  2017cited by this paper
• ArtGAN: Artwork synthesis with conditional categorical GANs

  2017cited by this paper
• CDC: Convolutional-De-Convolutional Networks for Precise Temporal Action Localization in Untrimmed Videos

  2017cited by this paper
• Hyperspectral and LiDAR Data Fusion Using Extinction Profiles and Deep Convolutional Neural Network

  2017cited by this paper
• Object-oriented ensemble classification for polarimetric SAR Imagery using restricted Boltzmann machines

  2017cited by this paper
• Hyperspectral Image Classification Using Deep Pixel-Pair Features

  2017cited by this paper
• Efficient Multiple Kernel Classification Using Feature and Decision Level Fusion

  2017cited by this paper
• CNN based suburban building detection using monocular high resolution Google Earth images

  2016cited by this paper
• Spectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-Encoder

  2016cited by this paper
• Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances

  2016cited by this paper
• S-CNN-BASED SHIP DETECTION FROM HIGH-RESOLUTION REMOTE SENSING IMAGES

  2016cited by this paper
• Hyperspectral image classification using two-channel deep convolutional neural network

  2016cited by this paper
• Deep Tracking: Seeing Beyond Seeing Using Recurrent Neural Networks

  2016cited by this paper
• DCAP: A deep convolution architecture for prediction of urban growth

  2016cited by this paper
• SINGLE-IMAGE SUPER RESOLUTION FOR MULTISPECTRAL REMOTE SENSING DATA USING CONVOLUTIONAL NEURAL NETWORKS

  2016cited by this paper
• How useful is region-based classification of remote sensing images in a deep learning framework?

  2016cited by this paper
• Road network extraction via deep learning and line integral convolution

  2016cited by this paper
• Deep Convolutional networks with superpixel segmentation for hyperspectral image classification

  2016cited by this paper
• Efficient Deep Learning for Stereo Matching

  2016cited by this paper
• Novel segmented stacked autoencoder for effective dimensionality reduction and feature extraction in hyperspectral imaging

  2016cited by this paper
• Big Data for Remote Sensing: Challenges and Opportunities

  2016cited by this paper
• Learning City Structures from Online Maps

  2016cited by this paper
• Appearance-based Brake-Lights recognition using deep learning and vehicle detection

  2016cited by this paper
• 3D shape retrieval using a single depth image from low-cost sensors

  2016cited by this paper
• Scene Classification via a Gradient Boosting Random Convolutional Network Framework

  2016influential reference
• Hyperspectral image analysis using deep learning — A review

  2016cited by this paper
• Knowledge Based 3d Building Model Recognition Using Convolutional Neural Networks from LIDAR and Aerial Imageries

  2016cited by this paper
• An overview of gradient descent optimization algorithms

  2016cited by this paper
• Orientation-boosted Voxel Nets for 3D Object Recognition

  2016cited by this paper
• Recurrent Highway Networks

  2016cited by this paper
• Convolutional neural network based classification for hyperspectral data

  2016cited by this paper
• Contextual deep CNN based hyperspectral classification

  2016cited by this paper
• Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification

  2016cited by this paper
• A universal remote sensing image quality improvement method with deep learning

  2016cited by this paper
• Vehicle detection in urban point clouds with orthogonal-view convolutional neural network

  2016cited by this paper
• Using CNN-based high-level features for remote sensing scene classification

  2016cited by this paper
• Highway and Residual Networks learn Unrolled Iterative Estimation

  2016cited by this paper
• Online vehicle detection using deep neural networks and lidar based preselected image patches

  2016cited by this paper
• Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks

  2016cited by this paper
• A survey of randomized algorithms for training neural networks

  2016cited by this paper
• SEMANTIC SEGMENTATION OF AERIAL IMAGES WITH AN ENSEMBLE OF CNNS

  2016cited by this paper
• Multi-view 3D Object Detection Network for Autonomous Driving

  2016cited by this paper
• Point cloud labeling using 3D Convolutional Neural Network

  2016cited by this paper
• Learning What and Where to Draw

  2016cited by this paper
• Benchmarking State-of-the-Art Deep Learning Software Tools

  2016cited by this paper
• 3D fully convolutional network for vehicle detection in point cloud

  2016cited by this paper
• Robust Large Margin Deep Neural Networks

  2016cited by this paper
• Large patch convolutional neural networks for the scene classification of high spatial resolution imagery

  2016cited by this paper
• Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks

  2016cited by this paper
• Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks

  2016cited by this paper
• Deep fusion of hyperspectral and LiDAR data for thematic classification

  2016influential reference
• Energy-based Generative Adversarial Network

  2016cited by this paper
• Differential Geometry Boosts Convolutional Neural Networks for Object Detection

  2016cited by this paper
• Bands Sensitive Convolutional Network for Hyperspectral Image Classification

  2016cited by this paper
• Terrain classification with Polarimetric SAR based on Deep Sparse Filtering Network

  2016cited by this paper
• Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection

  2016cited by this paper
• Multiview RGB-D Dataset for Object Instance Detection

  2016cited by this paper
• Recurrent Attention Models for Depth-Based Person Identification

  2016cited by this paper
• FusionNet: 3D Object Classification Using Multiple Data Representations

  2016cited by this paper
• CNN-Based Object Segmentation in Urban LIDAR with Missing Points

  2016cited by this paper
• Integrating spectral and spatial information into deep convolutional Neural Networks for hyperspectral classification

  2016cited by this paper
• Active Deep Learning for Classification of Hyperspectral Images

  2016cited by this paper
• Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art

  2016influential reference
• Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks

  2016cited by this paper
• Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery

  2016cited by this paper
• Spatiotemporal scene interpretation of space videos via deep neural network and tracklet analysis

  2016cited by this paper
• Application of deep learning to the problem of vehicle detection in UAV images

  2016cited by this paper
• Theano: A Python framework for fast computation of mathematical expressions

  2016cited by this paper
• Why Deep Neural Networks for Function Approximation?

  2016cited by this paper
• Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks

  2016influential reference
• Temporal Segment Networks: Towards Good Practices for Deep Action Recognition

  2016cited by this paper
• Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation

  2016cited by this paper
• Very deep learning for ship discrimination in Synthetic Aperture Radar imagery

  2016cited by this paper
• Multilabel classification of UAV images with Convolutional Neural Networks

  2016cited by this paper
• Active learning based autoencoder for hyperspectral imagery classification

  2016cited by this paper
• Neural Taylor Approximations: Convergence and Exploration in Rectifier Networks

  2016cited by this paper
• Towards better exploiting convolutional neural networks for remote sensing scene classification

  2016cited by this paper
• gvnn: Neural Network Library for Geometric Computer Vision

  2016cited by this paper
• Classification and Segmentation of Satellite Orthoimagery Using Convolutional Neural Networks

  2016cited by this paper
• Deep learning approach for large scale land cover mapping based on remote sensing data fusion

  2016cited by this paper
• TensorFlow: A system for large-scale machine learning

  2016cited by this paper
• CLASSIFICATION OF URBAN AERIAL DATA BASED ON PIXEL LABELLING WITH DEEP CONVOLUTIONAL NEURAL NETWORKS AND LOGISTIC REGRESSION

  2016cited by this paper
• Hyperspectral image classification with small training set by deep network and relative distance prior

  2016cited by this paper

• Semantic segmentation performance of aerial image segmentation using weighted ensemble trained networks CNNs

  2026cites this paper
• Unsupervised volcanic change detection using deep learning embeddings: Case studies of Nevados de Chillán and Llaima volcanoes, Chile (2017–2023)

  2026cites this paper
• A Review of State-of-the-Art Deep Learning Models for Knowledge Graphs

  2026cites this paper
• Monitoring Dendrolimus punctatus Walker Infestations Using Sentinel-2: A Monthly Time-Series Approach

  2026cites this paper
• UniMGS: Unsupervised Multimodal Guided Segmentation for High-Resolution Remote Sensing Images

  2026cites this paper
• Automated oil spill detection using deep learning and SAR satellite data: a case study of the Lower Congo Basin

  2026cites this paper
• Learning from the Rare: Overcoming Class Imbalance in Archaeological Object Detection with Boosting Methods

  2026cites this paper
• Mapping the Spatial Distribution of Photovoltaic Power Plants in Northwest China Using Remote Sensing and Machine Learning

  2026cites this paper
• Global Distribution and Seasonal Variation of Transient Luminous Events Observed by ISUAL Over 12 Years

  2026cites this paper
• Reconstruction Guided Few-shot Network For Remote Sensing Image Classification

  2026cites this paper
• Shipwreck detection in bathymetry data using semi-automated methods: Combining machine learning and topographic inference approaches

  2025cites this paper
• Evaluating the potential of the Time-SIFT approach using Pléiades satellite imagery for 3D change detection

  2025cites this paper
• RDSF-Net: Residual Wavelet Mamba-Based Differential Completion and Spatio-Frequency Extraction Remote Sensing Change Detection Network

  2025cites this paper
• Spatiotemporal Evolution and Driving Factors of Karst Rocky Desertification in Guangxi, China, Under Climate Change and Human Activities

  2025cites this paper
• Transfer Learning in Earth Observation Data Analysis: A review

  2025cites this paper
• SARLANG-1M: A Benchmark for Vision–Language Modeling in SAR Image Understanding

  2025cites this paper
• Deep Learning-Based Intelligent Monitoring of Petroleum Infrastructure Using High-Resolution Remote Sensing Imagery

  2025cites this paper
• Evaluation of agriculture land transformations with socio-economic influences on wheat demand and supply for food sustainability

  2025cites this paper
• Quantifying Greenspace with Satellite Images in Karachi, Pakistan, Using a New Data Augmentation Paradigm

  2025cites this paper
• The impacts of training data spatial resolution on deep learning in remote sensing

  2025cites this paper
• Unmanned Aerial Vehicles for Real-Time Vegetation Monitoring in Antarctica: A Review

  2025cites this paper
• Scalable Higher Resolution Polar Sea Ice Classification and Freeboard Calculation from ICESat-2 ATL03 Data

  2025cites this paper
• A lightweight CNN-LSTM hybrid model for land cover classification in satellite imagery

  2025cites this paper
• Harnessing Time-Series Satellite Data and Deep Learning to Monitor Historical Patterns of Deforestation in Eastern Himalayan Foothills of India

  2025cites this paper
• An Overview of Vision Transformers and Deep Learning Methods for Classifying Remote Sensing Images

  2025cites this paper
• Evaluation and Application of the PT-JPL Physical Model Optimized with XGBoost Algorithm in Latent Heat Flux Estimation

  2025cites this paper
• A multimodal machine learning fused global 0.1° daily evapotranspiration dataset from 1950-2022

  2025cites this paper
• Detection of Greenhouse and Typical Rural Buildings with Efficient Weighted YOLOv8 in Hebei Province, China

  2025cites this paper
• Establishing Land Use Maps using a Deep Learning Model and UAV imagery: Testing for Rice Land in the Mekong Delta

  2025cites this paper
• Deep learning approaches on Landsat observations: a review and meta-analysis

  2025cites this paper
• A hybrid approach for island recognition by synthesizing object-oriented deep learning and pixel-based adaptive thresholding: global experiments on Sentinel-2 imagery

  2025cites this paper
• WRSI: Wavelet scale reduction and spatiotemporal boundary interaction network for remote sensing change detection

  2025cites this paper
• Lightweight deep neural networks: Optimization of vehicle classification using ICBAM based on depthwise separable convolutions

  2025cites this paper
• Knowledge-driven deep learning approaches for computer vision tasks: A survey

  2025cites this paper
• EANV: An Edge Attention Network with VMamba Block for Semantic Segmentation from Remote Sensing Images

  2025cites this paper
• Implementation of Explainable AI(XAI) Approach for Combating Urban Heat Island in Changing Climate

  2025cites this paper
• Accelerating Diffusion Models with Progressive Distillation for Remote Sensing Semantic Segmentation

  2025cites this paper
• A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs

  2025cites this paper
• SAM Enhanced Semantic Segmentation for Remote Sensing Imagery Without Additional Training

  2025cites this paper
• From Pixels to Species: A Review of Remote Sensing for Biodiversity Assessment

  2025cites this paper
• Application of data-driven methods for laser powder bed fusion of Ni-based superalloys: A review

  2025cites this paper
• Deep Learning in Remote Sensing Image Fusion: Methods, protocols, data, and future perspectives

  2025cites this paper
• An Adaptive Weighted Residual-Guided Algorithm for Non-Uniformity Correction of High-Resolution Infrared Line-Scanning Images

  2025cites this paper
• Advanced characterization of deforestation frontiers in Nigeria utilizing deep learning and Bayesian approaches with sentinel-1 SAR imagery

  2025cites this paper
• STFCropNet: A Spatiotemporal Fusion Network for Crop Classification in Multiresolution Remote Sensing Images

  2025cites this paper
• Harnessing Multi-Source Data and Deep Learning for High-Resolution Land Surface Temperature Gap-Filling Supporting Climate Change Adaptation Activities

  2025cites this paper
• A Missing Data Imputation Method for Waste Dump Landslide Deformation Monitoring Based on a Seq2Seq LSTM–Posterior Correction Model

  2025cites this paper
• Comparative Performance of Machine Learning Classifiers for Photovoltaic Mapping in Arid Regions Using Google Earth Engine

  2025cites this paper
• Optimizing zero-shot text-based segmentation of remote sensing imagery using SAM and Grounding DINO

  2025cites this paper
• Responsible AI for Cities: A Case Study of GeoAI in African Informal Settlements

  2025cites this paper
• Land Use/Land Cover Remote Sensing Classification in Complex Subtropical Karst Environments: Challenges, Methodological Review, and Research Frontiers

  2025cites this paper
• A Review on Advancing Agricultural Efficiency through Geographic Information Systems, Remote Sensing, and Automated Systems

  2025cites this paper
• Hierarchical spatial–spectral enhancement network for hyperspectral image and light detection and ranging data classification

  2025cites this paper
• GSSR-Net: Geo-Spatial Structural Refinement Network for Remote Sensing Change Detection

  2025cites this paper
• Large Vision Language Model: Enhanced-RSCLIP with Exemplar-Image Prompting for Uncommon Object Detection in Satellite Imagery

  2025cites this paper
• Impact of Image Compression on Banana Trunk Detection with YOLOv5 for Mobile Robot Deployment in Banana Plantations

  2025cites this paper
• Satellite retrievals of total phosphorus in Taihu Lake using Sentinel-2 images and an optimized XGBoost model

  2025cites this paper
• A deep learning method for generating gap-free FAPAR time series from Landsat data

  2025cites this paper
• Pollution risk assessment in sub-basins of an open dump using drones and geographic information systems

  2025cites this paper
• The Role of Machine Learning in Distance Education

  2025cites this paper
• Speeding-up diffusion models for remote sensing semantic segmentation

  2025cites this paper
• SEMSF-Net: Explainable Squeeze–Excitation Multiscale Fusion Network for Aerial Scene and Coastal Area Recognition Using Remote Sensing Images

  2025cites this paper
• Exploration of machine learning techniques for cloud removal and gap filling on sentinel-2 time series images for better exploitation in far North Cameroon

  2025cites this paper
• Semantic Segmentation of Urban Green Space and Water Body in High-Resolution Remote Sensing Images Based on Low-Rank Adaptation

  2025cites this paper
• DFANet: A Deep Feature Attention Network for Building Change Detection in Remote Sensing Imagery

  2025cites this paper
• Exploring You Only Look Once v8 and v9 for efficient airplane detection in very high resolution remote sensing imagery

  2025cites this paper
• Assessing Model Trade-Offs in Agricultural Remote Sensing: A Review of Machine Learning and Deep Learning Approaches Using Almond Crop Mapping

  2025cites this paper
• Deep learning and remote sensing for scalable building age prediction in urban energy modeling

  2025cites this paper
• Reducing SAR-EO Domain Gap via Semantic Alignment for SAR Segmentation

  2025cites this paper
• Rock mass exposure fracture detection through 2D close-range images using image processing techniques: a review

  2025influential citation
• Deep learning model BiFPN-YOLOv8m for tree counting in mango orchards using satellite remote sensing data

  2025cites this paper
• Global patterns in forest carbon storage estimation: bibliometric analysis of technological evolution, accuracy gains and scaling challenges

  2025cites this paper
• Evaluation of U-Net + + architectures in high resolution image classification for urban planning

  2025cites this paper
• An Integrated Feature Framework for Wetland Mapping Using Multi-Source Imagery

  2025cites this paper
• Spatial temporal fusion based features for enhanced remote sensing change detection

  2025cites this paper
• Cross-Domain Land Surface Temperature Retrieval via Strategic Fine-Tuning-Based Transfer Learning: Application to GF5-02 VIMI Imagery

  2025cites this paper
• Dependable DPU Architectures on AMD-Xilinx Versal Adaptive SoCs for Space Applications

  2025cites this paper
• Prediction of Large-Scale Regional Evapotranspiration Based on Multi-Scale Feature Extraction and Multi-Headed Self-Attention

  2024cites this paper
• Deep learning workflow to support in-flight processing of digital aerial imagery for wildlife population surveys

  2024cites this paper
• Combining Multi-View UAV Photogrammetry, Thermal Imaging, and Computer Vision Can Derive Cost-Effective Ecological Indicators for Habitat Assessment

  2024cites this paper
• MFIL-FCOS: A Multi-Scale Fusion and Interactive Learning Method for 2D Object Detection and Remote Sensing Image Detection

  2024cites this paper
• RSAM-Seg: A SAM-based Approach with Prior Knowledge Integration for Remote Sensing Image Semantic Segmentation

  2024cites this paper
• Methods and datasets on semantic segmentation for Unmanned Aerial Vehicle remote sensing images: A review

  2024cites this paper
• A Hyperspectral Change Detection (HCD-Net) Framework Based on Double Stream Convolutional Neural Networks and an Attention Module

  2024cites this paper
• A Multitask Network for Multiview Stereo Reconstruction: When Semantic Consistency-Based Clustering Meets Depth Estimation Optimization

  2024cites this paper
• Leveraging Internal Representations of Model for Magnetic Image Classification

  2024cites this paper
• Uncertainty quantification for probabilistic machine learning in earth observation using conformal prediction

  2024cites this paper
• Critical Assessment of Cocoa Classification with Limited Reference Data: A Study in Côte d'Ivoire and Ghana Using Sentinel-2 and Random Forest Model

  2024cites this paper
• Robust spacecraft relative pose estimation via CNN-aided line segments detection in monocular images

  2024cites this paper
• Segmentation of arbitrary features in very high resolution remote sensing imagery

  2024cites this paper
• Advancements and Applications of Deep Learning: A Comprehensive Review

  2024cites this paper
• Exploring the Relationship: Transformative Adaptive Activation Functions in Comparison to Other Activation Functions

  2024cites this paper
• Exploration of Interdisciplinary Fusion and Interorganizational Collaboration With the Advancement of AI Research: A Case Study on Natural Language Processing

  2024cites this paper
• Earthquake-induced building damage detection using the fusion of optical and radar data in intelligent systems

  2024cites this paper
• Using deep learning algorithms for built-up area extraction from high-resolution GÖKTÜRK-1 satellite imagery

  2024cites this paper
• Strategies to alleviate flickering: Bayesian and smoothing methods for deep learning classification in video

  2024cites this paper
• Super-resolution reconstruction of remote sensing images based on micro-pyramid generative adversarial networks

  2024cites this paper
• A 3D-convolutional-autoencoder embedded Siamese-attention-network for classification of hyperspectral images

  2024cites this paper
• Assessing environmental effects on yardang development in the Qaidam Basin: Findings based on large-scale mapping of yardangs

  2024cites this paper
• A Physics-Guided Neural Network for Flooding Area Detection Using SAR Imagery and Local River Gauge Observations

  2024cites this paper