• OSU Micro-Benchmarks 7.5 (11/01/24) [Tarball]
• Please see CHANGES for the full changelog.
• You may also take a look at the appropriate README files for more information.
• C Benchmarks README.
• Java Benchmarks README.
• Python Benchmarks README.
• The benchmarks are available under the BSD license.
• Here, we list various benchmarks that are part of the OMB package in the C, Java, and Python programming languages for various parallel programming models like MPI, OpenSHMEM, UPC, UPC++, and NCCL. A high-level description of these benchmarks are provided below:
  • C Benchmarks
    • MPI
      • Host-based Benchmarks
        • Point-to-Point MPI Benchmarks: Latency, multi-threaded latency, multi-pair latency, multiple bandwidth / message rate test, bandwidth, bidirectional bandwidth
        • Blocking Collective MPI Benchmarks: Collective latency tests for various MPI collective operations such as MPI_Allgather, MPI_Alltoall, MPI_Allreduce, MPI_Barrier, MPI_Bcast, MPI_Gather, MPI_Reduce, MPI_Reduce_Scatter, MPI_Scatter and vector collectives.
        • Non-Blocking Collective (NBC) MPI Benchmarks: Collective latency and Overlap tests for various MPI collective operations such as MPI_Iallgather, MPI_Iallreduce, MPI_Ialltoall, MPI_Ibarrier, MPI_Ibcast, MPI_Igather, MPI_Ireduce, MPI_Iscatter and vector collectives.
        • One-sided MPI Benchmarks: one-sided put latency, one-sided put bandwidth, one-sided put bidirectional bandwidth, one-sided get latency, one-sided get bandwidth, one-sided accumulate latency, compare and swap latency, fetch and operate and get_accumulate latency for MVAPICH2 (MPI-2 and MPI-3).
        • Startup Benchmarks: osu_init, osu_hello
      • Device-based Benchmarks
        • CUDA, ROCm, and OpenACC Extensions to OSU Micro Benchmarks
        • Support for CUDA Managed Memory
    • OpenSHMEM Benchmarks
      • Point-to-Point OpenSHMEM Benchmarks: put latency, get latency, message rate, atomics,
      • Collective OpenSHMEM Benchmarks: collect latency, broadcast latency, reduce latency, and barrier latency
    • UPC Benchmarks
      • Point-to-Point UPC Benchmarks: put latency, get latency
      • Collective UPC Benchmarks: broadcast latency, scatter latency, gather latency, all_gather latency, and exchange latency
    • UPC++ Benchmarks
      • Point-to-Point UPC++ Benchmarks: async copy put latency, async copy get latency
      • Collective UPC++ Benchmarks: broadcast latency, scatter latency, gather latency, reduce latency, all_gather latency, and all_to_all latency
    • NCCL Benchmarks
      • Point-to-Point NCCL Benchmarks: NCCL-based Latency, bandwidth, bidirectional bandwidth
      • Collective NCCL Benchmarks: Collective latency tests for various NCCL collective operations such as Allgather, Allreduce, Bcast, Reduce, Reduce_Scatter, Alltoall.
  • Java Benchmarks
    • Point-to-Point Java Bindings Benchmarks: Latency, Bandwidth, Bidirectional Bandwidth, Bandwidth Test for Open MPI Java Bindings, Bidirectional Bandwidth Test for Open MPI Java Bindings
    • Collective Java Bindings Benchmarks: Collective latency tests for various MPI collective operations such as MPI_Allgather, MPI_Allgatherv, MPI_Allreduce, MPI_Alltoall, MPI_Alltoallv, MPI_Barrier, MPI_Bcast, MPI_Gather, MPI_Gatherv, MPI_Reduce, MPI_Reduce_scatter, MPI_Scatter, MPI_Scatterv
  • Python Benchmarks
    • Point-to-Point Python Benchmarks: Latency, Bandwidth, Bidirectional Bandwidth, Multi-pair Latency
    • Collective Python Benchmarks: Collective latency tests for various MPI collective operations such as MPI_Allgather, MPI_Allgatherv, MPI_Allreduce, MPI_Alltoall, MPI_Alltoallv, MPI_Barrier, MPI_Bcast, MPI_Gather, MPI_Gatherv, MPI_Reduce, MPI_Reduce_scatter, MPI_Scatter, MPI_Scatterv

Please note that there are many different ways to measure these performance parameters. For example, the bandwidth test can have different variations regarding the types of MPI calls (blocking vs. non-blocking) being used, total number of back-to-back messages sent in one iteration, number of iterations, etc. Other ways to measure bandwidth may give different numbers. Readers are welcome to use other tests, as appropriate to their application environments.