Scientific article
English

A Multi-Objective Optimization Service for Enhancing Performance and Cost Efficiency in Earth Observation Data Processing Workflows

Published inBaltic Journal of Modern Computing, vol. 11, no. 3, p. 420-434
Publication date2023
First online date2023
Abstract

Earthobservationtechnologyhasbecomeincreasinglycrucialformonitoringvarious aspects of our planet through systematic data collection. However, processing the large volume of satellite data generated can be challenging, requiring high-performance computing solutions. The Dask framework has gained popularity for its flexibility and efficiency in processing large amounts of data in a distributed manner. Nevertheless, determining the optimal Dask cluster configuration remains challenging, as it requires balancing performance and cost objectives. A novel multi-objective optimization service is proposed to address this challenge that enhances the performance and cost efficiency of earth observation data processing workflows. Our approach is to generate a set of Pareto-optimal solutions, allowing users to make informed decisions regarding the optimal trade-offs between performance and cost. The effectiveness is demonstrated using real-world earth observation datasets and outperforms existing performance and cost-efficiency solutions.

Keywords
  • Earthobservation
  • HPCovercloud
  • Dask
  • Multi-objectiveoptimization
  • Pareto-optimal
Citation (ISO format)
LALAYAN, Arthur, ASTSATRYAN, Hrachya, GIULIANI, Gregory. A Multi-Objective Optimization Service for Enhancing Performance and Cost Efficiency in Earth Observation Data Processing Workflows. In: Baltic Journal of Modern Computing, 2023, vol. 11, n° 3, p. 420–434. doi: 10.22364/bjmc.2023.11.3.05
Main files (1)
Article (Published version)
accessLevelRestricted
Identifiers
Journal ISSN2255-8942
89views
0downloads

Technical informations

Creation13/10/2023 11:07:43
First validation18/10/2023 11:39:39
Update24/10/2025 13:27:41
Status update24/10/2025 13:27:41
Last indexation24/10/2025 13:31:54
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack