Scaling TensorFlow, PyTorch, and MXNet using MVAPICH2 for High-Performance Deep Learning on Frontera A. Jain, A. Awan, H. Subramoni, D. Panda 3rd Deep Learning on Supercomputers Workshop (DLS) at SC19, Nov 2019.