Performance of MVAPICH2-GDR Collectives
Machine Specifications
CPU Model | CPU Core Info | Memory | IB Card | OS | OFED | GPUs per node | CUDA |
---|---|---|---|---|---|---|---|
Duel Intel Xeon Platinum 8168 | 24 @ 2.7Ghz | 1.5TB | Mellanox Connect-X5 (8x56Gbps) | Ubuntu 7.3.0 | MOFED 4.4 | 16 NVIDIA Tesla V100-SXM2-32GB | CUDA 9.2.148 |


Machine Specifications
CPU Model | CPU Core Info | Memory | IB Card | IB Switch | OS | GPUs per node | CUDA |
---|---|---|---|---|---|---|---|
POWER9 | 44 @ 3.45 GHz | 256GB | Dual Mellanox Connect-X5 (2x100Gbps) | Mellanox EDR IB Switch | RHEL 7.5 | 6 NVIDIA Tesla V100-SXM2-16GB | CUDA 9.2.148 |


Machine Specifications
CPU Model | CPU Core Info | Memory | IB Card | IB Switch | OS | GPUs per node | CUDA |
---|---|---|---|---|---|---|---|
POWER9 | 40 @ 3.5 GHz | 256GB | Dual Mellanox Connect-X5 (2x100Gbps) | Mellanox EDR IB Switch | RHEL 7.6 | 4 NVIDIA Tesla V100-SXM2-16GB | CUDA 10.1.243 |

Machine Specifications
CPU Model | CPU Core Info | Memory | IB Card | IB Switch | OS | GPUs per node | CUDA |
---|---|---|---|---|---|---|---|
Intel E5-2620 v4 | 2x16 @ 2.1 GHz | 240GB | Dual Mellanox Connect-X3 (1x56Gbps) | Mellanox FDR IB Switch | CentOS 7 | 4 NVIDIA Quadro RTX 5000 16GB | CUDA 10.1.243 |

Machine Specifications
CPU Model | CPU Core Info | Memory | IB Card | OS | OFED | GPU | CUDA |
---|---|---|---|---|---|---|---|
Intel E5-2690 v3 | 2x12 @ 2.6Ghz | 252GB | Mellanox Connect-IB (2x56Gbps) | Redhat 7 | MOFED 3.4 | NVIDIA Tesla K80 | CUDA 8.0 |


These numbers were taken on CSCS KESCH System. We would like to thank CSCS staff members for providing us access to this system.