Performance of MVAPICH2-GDR Collectives

Machine Specifications

CPU Model CPU Core Info Memory IB Card OS OFED GPUs per node CUDA
Duel Intel Xeon Platinum 8168 24 @ 2.7Ghz 1.5TB Mellanox Connect-X5 (8x56Gbps) Ubuntu 7.3.0 MOFED 4.4 16 NVIDIA Tesla V100-SXM2-32GB CUDA 9.2.148

Machine Specifications

CPU Model CPU Core Info Memory IB Card IB Switch OS GPUs per node CUDA
POWER9 44 @ 3.45 GHz 256GB Dual Mellanox Connect-X5 (2x100Gbps) Mellanox EDR IB Switch RHEL 7.5 6 NVIDIA Tesla V100-SXM2-16GB CUDA 9.2.148

Machine Specifications

CPU Model CPU Core Info Memory IB Card IB Switch OS GPUs per node CUDA
POWER9 40 @ 3.5 GHz 256GB Dual Mellanox Connect-X5 (2x100Gbps) Mellanox EDR IB Switch RHEL 7.6 4 NVIDIA Tesla V100-SXM2-16GB CUDA 10.1.243

Machine Specifications

CPU Model CPU Core Info Memory IB Card IB Switch OS GPUs per node CUDA
Intel E5-2620 v4 2x16 @ 2.1 GHz 240GB Dual Mellanox Connect-X3 (1x56Gbps) Mellanox FDR IB Switch CentOS 7 4 NVIDIA Quadro RTX 5000 16GB CUDA 10.1.243

Machine Specifications

CPU Model CPU Core Info Memory IB Card OS OFED GPU CUDA
Intel E5-2690 v3 2x12 @ 2.6Ghz 252GB Mellanox Connect-IB (2x56Gbps) Redhat 7 MOFED 3.4 NVIDIA Tesla K80 CUDA 8.0

These numbers were taken on CSCS KESCH System. We would like to thank CSCS staff members for providing us access to this system.