Sign up to save your podcasts
Or
Share [Gluon][Tutorial] Persistent attention by Mogball · Pull Request #7298 · triton-lang/triton
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
[Gluon][Tutorial] Persistent attention by Mogball · Pull Request #7298 · triton-lang/triton
https://github.com/triton-lang/triton/pull/7298
Rewrite the attention kernel to be persistent. This gives better performance at low-contexts. However, fp16 at large context has suffered a bit due to a ptxas instruction scheduling issue in the so...
View all episodes
By VoiceFeedhttps://github.com/triton-lang/triton/pull/7298
Rewrite the attention kernel to be persistent. This gives better performance at low-contexts. However, fp16 at large context has suffered a bit due to a ptxas instruction scheduling issue in the so...