SUPER: SUb-Graph Parallelism for TransformERs
A. Jain, T. Moon, T. Benson, H. Subramoni, S. Jacobs, D. Panda, B. Essen
35th IEEE International Parallel &  Distributed Processing Symposium,
May 2021.