Matrix multiplication of square bf16 matrices, accumulated in fp32.

N=4096
Kernel: 763 TFLOPs
cuBLAS: 716 TFLOPs

N=8192
Kernel: 808 TFLOPs
cuBLAS: 795 TFLOPs

Explanation in https://cudaforfun.substack.com/p/outperforming-cublas-on-h100-a-worklog

make matmul && out/matmul

Example kernels are in examples/matmul/ and orchestration is in matmul.cu

We compute sum of 2^30 elements.

make sum && out/sum

Kernel: 3240.11 GB/s
cub Library: 3193 GB/s

Example kernels are in sum.cu