UNIGE document Chapitre d'actes
previous document  unige:137989  next document
add to browser collection
Title

On the Benefits of Anticipating Load Imbalance for Performance Optimization of Parallel Applications

Authors
Abdennadher, Nabil
Published in IEEE International Conference on Cluster Computing, CLUSTER 2019. Albuquerque (NM, USA) - 23-26 Sept. 2019 - IEEE. 2019, p. 1-9
Abstract In parallel iterative applications, computational efficiency is essential for addressing large problems. Load imbalance is one of the major performance degradation factors of parallel applications. Therefore, distributing, cleverly, and as evenly as possible, the workload among processing elements (PE) maximizes application performance. So far, the standard load balancing method consists in distributing the workload evenly between PEs and, when load imbalance appears, redistributing the extra load from overloaded PEs to underloaded PEs. However, this does not anticipate the load imbalance growth that may continue during the next iterations. In this paper, we present a first step toward a novel philosophy of load balancing that unloads the PEs that will be overloaded in the near future to let the application rebalance itself via its own dynamics. Herein, we present a formal definition of our new approach using a simple mathematical model and discuss its advantages compared to the standard load balancing method. In addition to the theoretical study, we apply our method to an application that reproduces the computation of a fluid model with non-uniform erosion. The performance validates the benefit of anticipating load imbalance. We observed up to 16% performance improvement compared to the standard load balancing method.
Keywords High performance computingLoad balancingPerformance optimizationAnticipation
Identifiers
ISBN: 9781728147345
Full text
Structures
Research group Scientific and Parallel Computing
Citation
(ISO format)
BOULMIER, Anthony et al. On the Benefits of Anticipating Load Imbalance for Performance Optimization of Parallel Applications. In: IEEE International Conference on Cluster Computing, CLUSTER 2019. Albuquerque (NM, USA). [s.l.] : IEEE, 2019. p. 1-9. doi: 10.1109/CLUSTER.2019.8890998 https://archive-ouverte.unige.ch/unige:137989

34 hits

0 download

Update

Deposited on : 2020-06-26

Export document
Format :
Citation style :