Machine Specifications
| CPU Model | CPU Core Info | Memory | IB Card | IB Switch | OS | ROCm | GPU |
|---|---|---|---|---|---|---|---|
| AMD EPYC 7401 | 2x24 @ 2.0GHz | 64GB | Mellanox ConnectX-6 (HDR 100Gbps) | Mellanox HDR100 IB Switch | RHEL 7.0 | ROCm 3.9 | AMD Mi60 PCIE |
Inter-Node Performance numbers of MVAPICH2-GDR with ROCm on AMD EPYC 7401 processor using two Mi60 GPUs connected through Mellanox ConenctX-6 (12/02/20)
| One Way Latency | Unidirectional Bandwidth | Bidirectional Bandwidth | Notes |
|---|---|---|---|
| 3.95 us | 6365.29 MBps | 8947.16 MBps | Inter-Node GPU to GPU (Device-to-Device) using single HCA |
Machine Specifications
| CPU Model | CPU Core Info | Memory | IB Card | IB Switch | OS | ROCm | GPU |
|---|---|---|---|---|---|---|---|
| AMD EPYC 7401 | 2x24 @ 2.0GHz | 64GB | Mellanox ConnectX-6 (HDR 100Gbps) | Mellanox HDR100 IB Switch | RHEL 7.0 | ROCm 3.9 | AMD Mi60 PCIE |
Intra-Node Performance numbers of MVAPICH2-GDR with ROCm on AMD EPYC 7401 processor using two Mi60 GPUs on same socket (12/02/20)
| One Way Latency | Unidirectional Bandwidth | Bidirectional Bandwidth | Notes |
|---|---|---|---|
| 1.84 us | 16586.08 MBps | 30904.74 MBps | Intra-Node over PCI-e within same socket (Device-to-Device) |
