ADAPTIVE ALGORITHM OF BARRIER SYNCHRONIZATION IN THE MPI STANDARD ON THE BASIS OF PARALLEL COMPUTING MODELS LOGP

The problem of developing an adaptive algorithm for barrier synchronization of branches of parallel MPI-programs in distributed computing systems is considered. An algorithm of barrier synchronization providing a suboptimal choice of the scheme for implementing barrier synchronization is proposed. During the selection process, the time of execution of information exchanges in the LogP parallel computing model is taken into account. Analytic estimates of the execution time of the barrier synchronization algorithms in the LogP model are constructed. The proposed adaptive algorithm is implemented in the MPI standard. The results of field experiments on cluster computer systems for analyzing the efficiency of the created algorithms are presented. The results of the experiments allow us to trace the relationship between the parameters of the LogP model, the number of processes and the choice of algorithms for the implementation of barrier synchronization. The developed algorithm made it possible to achieve a 4% decrease in the average implementation time for the implementation of barrier synchronization.

Authors: V. V. Zharikov, A. A. Paznikov

Direction: Informatics and Computer Technologies

Keywords: Collective exchanges, barrier synchronization, distributed computing systems, LogP, MPI, parallel programming

---

View full article