InfiniBand host channel adapters (HCAs) with PCI Express achieve 20 to 30 percent lower latency for small messages compared with HCAs using 64-bit, 133-MHz PCI-X interfaces. PCI Express also improves performance at the MPI level, achieving a latency of 4.1 ?s for small messages. It can also improve MPI collective communication and bandwidth-bound MPI application performance.
Citation:
Jiuxing Liu, Amith Mamidala, Abhinav Vishnu, Dhabaleswar K. Panda, "Evaluating InfiniBand Performance with PCI Express," IEEE Micro, vol. 25, no. 1, pp. 20-29, Jan./Feb. 2005, doi:10.1109/MM.2005.9