KernelKraft
KernelKraft is an adaptive Transformer inference accelerator that delivers up to 1.471× end-to-end speedup—with a 1.272× geometric mean across 13 official workloads—on an NVIDIA T4.
KernelKraft is an adaptive Transformer inference accelerator that delivers up to 1.471× end-to-end speedup—with a 1.272× geometric mean across 13 official workloads—on an NVIDIA T4.
Log in or sign up for Devpost to join the conversation.