Optimizing Sentinel-2 image selection in a Big Data context

Abstract Processing large amounts of image data such as the Sentinel-2 archive is a computationally demanding task. However, for most applications, many of the images in the archive are redundant and do not contribute to the quality of the final result. An optimization scheme is presented here that selects a subset of the Sentinel-2 archive in order to reduce the amount of processing, while retaining the quality of the resulting output. As a case study, we focused on the creation of a cloud-free composite, covering the global land mass and based on all the images acquired from January 2016 until September 2017. The total amount of available images was 2,128,556. The selection of the optimal subset was based on quicklooks, which correspond to a spatial and spectral subset of the original Sentinel-2 products and are lossy compressed. The selected subset contained 94,093 image tiles in total, reducing the amount of images to be processed to 4.42% of the full set.

• Publication year

  2017

• Venue

  Big Earth Data

• Publication date

  2017-12-20

• Fields of study

  Computer Science, Engineering, Environmental Science

• Identifiers
  DOI 10.1080/20964471.2017.1407489
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A versatile data-intensive computing platform for information retrieval from big geospatial data

  2018cited by this paper
• THE JRC EARTH OBSERVATION DATA AND PROCESSING PLATFORM

  2017cited by this paper
• Data Center Energy Consumption Modeling: A Survey

  2016cited by this paper
• 50 years of biometric research: Accomplishments, challenges, and opportunities

  2016cited by this paper
• Assessment of the Added-Value of Sentinel-2 for Detecting Built-up Areas

  2016cited by this paper
• Proceedings of 2016 conference on Big Data from Space (BiDS'16)

  2016cited by this paper
• Remotely Sensed High-Resolution Global Cloud Dynamics for Predicting Ecosystem and Biodiversity Distributions

  2016cited by this paper
• TOWARDS A JRC EARTH OBSERVATION DATA AND PROCESSING PLATFORM

  2016cited by this paper
• CERNBox + EOS: end-user storage for science

  2015cited by this paper
• Assessing the environmental impact of data centres part 1: Background, energy use and metrics

  2014cited by this paper
• Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services

  2012influential reference
• Distributed computing in practice: the Condor experience

  2005cited by this paper
• Morphological Image Analysis: Principles and Applications

  2003cited by this paper
• The MODIS 2.1-μm channel-correlation with visible reflectance for use in remote sensing of aerosol

  1997cited by this paper

• SCOPES: Spatially-Constrained Optimization for Efficient Image Selection in Remote Sensing

  2026cites this paper
• Characterizing the Impact of Non-Stand Replacing Disturbances on LiDAR Based Forest Structure Using a Harmonized Landsat-Sentinel-2 Time-Series

  2026cites this paper
• On-demand, semantic EO data cubes – knowledge-based, semantic querying of multimodal data for mesoscale analyses anywhere on Earth

  2025cites this paper
• Evaluation framework for the generation of continental bare surface reflectance composites

  2025cites this paper
• Deep spatio-textural feature driven multi-constraints pool-based active learning model for resource-efficient big earth observations

  2025cites this paper
• Detection of non-stand replacing disturbances (NSR) using Harmonized Landsat-Sentinel-2 time series

  2025cites this paper
• Automatic Classification of Agricultural Crops Using Sentinel-2 Data in the Rainfed Zone of Southern Kazakhstan

  2025cites this paper
• The concept, technical architecture, applications and impacts of satellite internet: A systematic literature review

  2024cites this paper
• Automatized Sentinel-2 mosaicking for large area forest mapping

  2024cites this paper
• An In-Memory Data-Cube Aware Distributed Data Discovery Across Clouds for Remote Sensing Big Data

  2023cites this paper
• Wasting petabytes: A survey of the Sentinel-2 UTM tiling grid and its spatial overhead

  2023cites this paper
• An improved coverage-oriented retrieval algorithm for large-area remote sensing data

  2022cites this paper
• Serviço web para extração de métricas fenológicas para agricultura usando séries temporais de imagens de satélite

  2022cites this paper
• Technology Assessment Using Satellite Big Data Analytics for India's Agri-Insurance Sector

  2022cites this paper
• Joint Supervised Classification and Reconstruction of Irregularly Sampled Satellite Image Times Series

  2022cites this paper
• Tree species classification using Sentinel-2 imagery and Bayesian inference

  2021cites this paper
• Investigating ESA Sentinel-2 products' systematic cloud cover overestimation in very high altitude areas

  2021cites this paper
• Semi-automated Workflow for Mapping the Extent and Elevation Profile of Intertidal Zone of Parts of Gulf of Kutch, India, Using Landsat Time Series Data

  2021cites this paper
• Pan-tropical Sentinel-2 cloud-free annual composite datasets

  2021cites this paper
• Challenges and Opportunities for Growing Bioenergy Crops in the EU: Linking Support Schemes With Sustainability Issues Towards Carbon Neutrality

  2021cites this paper
• OPERATIONAL PIPELINE FOR A GLOBAL CLOUD-FREE MOSAIC AND CLASSIFICATION OF SENTINEL-2 IMAGES

  2020cites this paper
• An End-to-End Adversarial Hashing Method for Unsupervised Multispectral Remote Sensing Image Retrieval

  2020cites this paper
• A global cloud free pixel- based image composite from Sentinel-2 data

  2020cites this paper
• Mapping Natural Forest Remnants with Multi-Source and Multi-Temporal Remote Sensing Data for More Informed Management of Global Biodiversity Hotspots

  2020cites this paper
• Mosaicking Copernicus Sentinel-1 Data at Global Scale

  2020cites this paper
• Management of humanitarian relief operations using satellite big data analytics: the case of Kerala floods

  2020cites this paper
• Open Innovation Using Satellite Imagery for Initial Site Assessment of Solar Photovoltaic Projects

  2020cites this paper
• Learning Disentangled Representations of Satellite Image Time Series

  2019cites this paper
• Insights into CODE-DE – Germany’s Copernicus data and exploitation platform

  2019cites this paper
• Accuracy of determining specific parameters of the urban forest using remote sensing

  2019cites this paper
• pyjeo: A Python Package for the Analysis of Geospatial Data

  2019cites this paper
• Country-wide high-resolution vegetation height mapping with Sentinel-2

  2019cites this paper
• Big Earth data: disruptive changes in Earth observation data management and analysis?

  2019cites this paper
• Advances in Interactive Processing and Visualisation with Jupyter on the JRC Big Data Platform (JEODPP)

  2018cites this paper
• THE JRC EARTH OBSERVATION DATA AND PROCESSING PLATFORM

  2017cites this paper