Patrick W. Rall

21 | CS + Math @Purdue | i like making GPUs go brrrr | Nix enthusiast

[Patrick W. Rall @patwrall]

@gpuemi @wafer_ai @AMD @ianye0212 good writeup. one question - did you try an 8 + 4 head split instead of padding 12 to 16? both are supported shapes, though i guess you'd end up reading the latent kv twice, which might cost more than the dead quarter tile at 172k