Skip to content

Benchmark Results

Representative performance notes, not a universal promise.

This page is now only the results snapshot surface. For trust policy and interpretation rules, use Validation. For experiment design, use Methodology.

Reference snapshot

End-to-end snapshot

Sample numbers from an RTX 3060 Laptop at 1024 x 1024 x 1024:

KernelGFLOPSvs cuBLAS
cuBLAS5727100.0%
Tiled75313.1%
Double Buffer70112.2%
Bank-Free67311.8%
Naive60410.6%

Compute-only WMMA snapshot

The repository also reports a narrower fast-path measurement for Tensor Core-friendly shapes:

KernelGFLOPSvs cuBLAS
Tensor Core (WMMA compute-only)230040.2%

The benchmark harness also emits WMMA end-to-end results, but this condensed page does not publish a single headline number for that path because FP32→FP16 conversion and fallback behavior depend strongly on the exact local execution path. Treat the compute-only row as an upper-bound reference, then use Benchmark Scope and local runs to interpret the full end-to-end gap.

How to read this page

  • These numbers are a representative local snapshot, not a promise for every GPU.
  • Compare them only after reading Benchmark Scope.
  • Read the end-to-end table first; treat WMMA compute-only as a narrow fast-path label, not a replacement for end-to-end behavior.
  • Assume hosted CI did not prove these numbers. Only local GPU runs can.

Tensor Core note

The benchmark suite reports:

  • WMMA end-to-end: the safe FP32 wrapper, including conversion and fallback handling
  • WMMA compute-only: the pure pre-converted FP16 path, shown only when M, K, and N are multiples of 16

When dimensions are not Tensor Core friendly, the implementation falls back to a safer FP32 path instead of forcing WMMA.

Read together with

MIT Licensed