Deep learning-based framework for spatiotemporal data fusion: an instance of Landsat 8 and Sentinel 2 NDVI

Abstract. Multi-source, multi-temporal, and multi-resolution satellite images have been increasing over a couple of years. The spatiotemporal data fusion technique could be a promising solution to achieve the advantage of temporal and spatial details of multi-platform remote sensing images. Due to the unavailability of required temporal resolution of normalized difference vegetation index (NDVI) of high-spatial-resolution dataset (e.g., Sentinel 2 A/B), the remote sensing-based crop monitoring is limiting in several parts of the world, primarily in the monsoon Asia and tropical region. We propose a deep learning-based framework to fill the gap of high-resolution NDVI value using corresponding low-spatial-resolution NDVI images. Time-series NDVI images from Sentinel 2 and Landsat 8 are used to implement the proposed framework. We evaluate our method on two study areas with different climatic conditions: subtropical and temperate. The results demonstrate that spatiotemporal data fusion with our proposed framework is very effective to synthesize and generate new datasets which represents the unique features of both input sources, namely, spatial and temporal details of each input image regardless of the climatic and temporal variations.

• Publication year

  2021

• Venue

  Journal of Applied Remote Sensing

• Publication date

  2021-07-01

• Fields of study

  Computer Science, Engineering, Environmental Science

• Identifiers
  DOI 10.1117/1.JRS.15.034520
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Single-Image Super Resolution Using Convolutional Neural Network

  2021cited by this paper
• Deep learning-based remote and social sensing data fusion for urban region function recognition

  2020cited by this paper
• Stock Price Forecasting with Deep Learning: A Comparative Study

  2020cited by this paper
• Tree Species Classification of Drone Hyperspectral and RGB Imagery with Deep Learning Convolutional Neural Networks

  2020cited by this paper
• CNN based spectral super-resolution of remote sensing images

  2020cited by this paper
• Multisource Hyperspectral and LiDAR Data Fusion for Urban Land-Use Mapping based on a Modified Two-Branch Convolutional Neural Network

  2019cited by this paper
• Deep Learning for Image Super-Resolution: A Survey

  2019cited by this paper
• Multi-Modal Object Tracking and Image Fusion With Unsupervised Deep Learning

  2019cited by this paper
• Spatiotemporal Image Fusion in Remote Sensing

  2019cited by this paper
• An Unsupervised Convolutional Feature Fusion Network for Deep Representation of Remote Sensing Images

  2018cited by this paper
• Deep Hyperspectral Image Sharpening

  2018cited by this paper
• Multi-temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation

  2018cited by this paper
• Remote Sensing Image Fusion With Deep Convolutional Neural Network

  2018cited by this paper
• Pan-sharpening via deep metric learning

  2018cited by this paper
• Spatiotemporal Satellite Image Fusion Using Deep Convolutional Neural Networks

  2018cited by this paper
• Spatiotemporal Fusion of Multisource Remote Sensing Data: Literature Survey, Taxonomy, Principles, Applications, and Future Directions

  2018cited by this paper
• Deep Learning for Fusion of APEX Hyperspectral and Full-Waveform LiDAR Remote Sensing Data for Tree Species Mapping

  2018cited by this paper
• Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network

  2018cited by this paper
• Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources

  2017cited by this paper
• Deep Feature Fusion for VHR Remote Sensing Scene Classification

  2017cited by this paper
• Factorization tricks for LSTM networks

  2017cited by this paper
• A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening

  2017cited by this paper
• Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data

  2017cited by this paper
• FusionNet: Edge Aware Deep Convolutional Networks for Semantic Segmentation of Remote Sensing Harbor Images

  2017cited by this paper
• Mapping of Shorea robusta Forest Using Time Series MODIS Data

  2017cited by this paper
• Satellite super-resolution images depending on deep learning methods: A comparative study

  2017cited by this paper
• Region-Based Convolutional Networks for Accurate Object Detection and Segmentation

  2016cited by this paper
• Pansharpening by Convolutional Neural Networks

  2016influential reference
• Estimation of biomass in wheat using random forest regression algorithm and remote sensing data

  2016influential reference
• Super-resolution mapping of wetland inundation from remote sensing imagery based on integration of back-propagation neural network and genetic algorithm

  2015cited by this paper
• You Only Look Once: Unified, Real-Time Object Detection

  2015cited by this paper
• A New Pan-Sharpening Method With Deep Neural Networks

  2015cited by this paper
• Long-term recurrent convolutional networks for visual recognition and description

  2014cited by this paper
• Sensitivity Analysis for L-Band Polarimetric Descriptors and Fusion for Urban Land Cover Change Detection

  2014cited by this paper
• Predictive modeling of groundwater nitrate pollution using Random Forest and multisource variables related to intrinsic and specific vulnerability: a case study in an agricultural setting (Southern Spain).

  2014cited by this paper
• Optical and SAR data integration for automatic change pattern detection

  2014cited by this paper
• ImageNet classification with deep convolutional neural networks

  2012cited by this paper
• Scikit-learn: Machine Learning in Python

  2011influential reference
• Random Forests

  2001cited by this paper
• Long Short-Term Memory

  1997cited by this paper
• Correspondence among the correlation, RMSE, and Heidke forecast verification measures; refinement of the Heidke score

  1992cited by this paper

• Harnessing Earth Observation and Machine Learning for Sustainable Development Goals

  2025cites this paper
• Comparative Analysis of Application Between GF-1 WFV_2 and GF-6 WFV Image Data in Monitoring of Crop Physiological Parameters

  2025cites this paper
• Incorporating Environmental Variables Into Spatiotemporal Fusion Model to Reconstruct High-Quality Vegetation Index Data

  2024cites this paper
• Monitoring apple flowering date at 10 m spatial resolution based on crop reference curves

  2024cites this paper
• Deep Learning-Based Spatiotemporal Fusion Architecture of Landsat 8 and Sentinel-2 Data for 10 m Series Imagery

  2024cites this paper
• CNN-LSTM vs. LSTM-CNN to Predict Power Flow Direction: A Case Study of the High-Voltage Subnet of Northeast Germany

  2023cites this paper
• Forest fire pattern and vulnerability mapping using deep learning in Nepal

  2023cites this paper
• Novel MIA-LSTM Deep Learning Hybrid Model with Data Preprocessing for Forecasting of PM2.5

  2023cites this paper
• A cooperative scheme for late leaf spot estimation in peanut using UAV multispectral images

  2023cites this paper
• Peanut yield prediction with UAV multispectral imagery using a cooperative machine learning approach

  2023cites this paper
• Recent Advances in Crop Disease Detection Using UAV and Deep Learning Techniques

  2023cites this paper
• Classification of Citrus Huanglongbing Degree Based on CBAM-MobileNetV2 and Transfer Learning

  2023cites this paper
• Wetland spectral unmixing using multispectral satellite images

  2022cites this paper
• Fruit classification using attention-based MobileNetV2 for industrial applications

  2022cites this paper
• Explanatory classification of CXR images into COVID-19, Pneumonia and Tuberculosis using deep learning and XAI

  2022cites this paper
• Can remote sensing enable a Biomass Climate Adaptation Index for agricultural systems?

  2022cites this paper
• Methods in the spatial deep learning: current status and future direction

  2022cites this paper
• Attention based Recurrent Neural Network for Nepali Text Summarization

  2022cites this paper
• Fusing Landsat 8 and Sentinel-2 data for 10-m dense time-series imagery using a degradation-term constrained deep network

  2022cites this paper
• Deep Learning-Based Methods for Sentiment Analysis on Nepali COVID-19-Related Tweets

  2021cites this paper