Implement a GPU Kernel for a Transformer Layer
A dynamically dispatched, hardware-aware Transformer kernel suite that achieves 11.97x speedups peak and processes 100k tokens by exploiting NVIDIA architecture and custom Triton-Gluon fusion.
A dynamically dispatched, hardware-aware Transformer kernel suite that achieves 11.97x speedups peak and processes 100k tokens by exploiting NVIDIA architecture and custom Triton-Gluon fusion.
Log in or sign up for Devpost to join the conversation.