Scientific article
OA Policy
English

Scalable Data Processing Platform for Earth Observation Data Repositories

Published inScalable Computing. Practice and Experience, vol. 24, no. 1, p. 35-44
Publication date2023-04-19
First online date2023-04-19
Abstract

Earth observation (EO) satellite data is essential to environmental monitoring. At a national and regional level, the open data cubes harness the power of satellite data by providing application programming interfaces and services to the end-users. The volume and the complexity of satellite observations are increasing, demanding novel approaches for data storing, managing, and processing. High-performance computing (HPC) and cloud platforms may improve Big EO data processing performance. However, it is necessary to consider several vital aspects for efficient and flexible EO data processing, such as the interoperability from cloud-HPC and EO data repositories, automatic provisioning and scaling of cloud-HPC resources, cost-effectiveness, support of new EO data formats and open-source packages, or linkage with data cube platforms. The article proposes a scalable EO data processing platform interoperable from cloud-HPC and EO data repositories. The platform enables linking any data repository supporting web coverage service or SpatioTemporal Asset Catalog Application Programming Interfaces (STAC-API), and any cloud or HPC resource supporting scheduling system API for providing access to the cluster backends.

Keywords
  • Earth observation satellite data
  • Cloud and HPC
  • DataCube
  • STAC
  • COG
  • Dask
Citation (ISO format)
ASTSATRYAN, Hrachya, LALAYAN, Arthur, GIULIANI, Gregory. Scalable Data Processing Platform for Earth Observation Data Repositories. In: Scalable Computing. Practice and Experience, 2023, vol. 24, n° 1, p. 35–44. doi: 10.12694/scpe.v24i1.2041
Main files (1)
Article (Published version)
accessLevelPublic
Identifiers
Journal ISSN1895-1767
96views
418downloads

Technical informations

Creation26/04/2023 05:45:38
First validation26/04/2023 14:19:02
Update24/10/2025 13:27:50
Status update24/10/2025 13:27:50
Last indexation24/10/2025 13:32:06
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack