High performance MPI-2 one-sided communication over InfiniBand
|
| Chicago, IL, USA April 19-April 22 |
Weihang Jiang, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
Jiuxing Liu, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
Hyun-Wook Jin, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
D.K. Panda, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
W. Gropp, Dept. of Biomed. Informatics, Ohio State Univ., Columbus, OH, USA
R. Thakur, Dept. of Comput. Sci., Indiana Univ., Bloomington, IN, USA
Many existing MPI-2 one-sided communication implementations are built on top of MPI send/receive operations. Although this approach can achieve good portability, it suffers front high communication overhead and dependency on remote process for communication progress. To address these problems, we propose a high performance MPI-2 one-sided communication design over the InfiniBand Architecture. In our design, MPI-2 one-sided communication operations such as MPI-Put, MPI-Get and MPI-Accumulate are directly mapped to InfiniBand Remote Direct Memory Access (RDMA) operations. Our design has been implemented based on MPICH2 over InfiniBand. We present detailed design issues for this approach and perform a set of microbenchmarks to characterize different aspects of its performance. Our performance evaluation shows that compared with the design based on MPI send/receive, our design can improve throughput up to 77%, and reduce latency and synchronization overhead up to 19% and 13%, respectively. Under certain process skew, the bad impact can be significantly reduced by new design, from 41% to nearly 0%. It also can achieve better overlap of communication and computation.
Citation:
Weihang Jiang, Jiuxing Liu, Hyun-Wook Jin, D.K. Panda, W. Gropp, R. Thakur, "High performance MPI-2 one-sided communication over InfiniBand," ccgrid, pp.531-538, Fourth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'04), 2004
Usage of this product signifies your acceptance of the
Terms of Use.
|
|
|
|
|
|
|
|