Team Fable's Transformer Kernel Optimisation
Drop-in PyTorch Transformer layer for Track 3: 1.92× geo-mean speedup, strict state_dict, 932× under tolerance. Shape 14 completes in 5 GB; the reference cannot run (18 TB score tensor per layer).
Drop-in PyTorch Transformer layer for Track 3: 1.92× geo-mean speedup, strict state_dict, 932× under tolerance. Shape 14 completes in 5 GB; the reference cannot run (18 TB score tensor per layer).
Log in or sign up for Devpost to join the conversation.