FastPath64: the missing Arm smmla kernel for IQ4_XS
IQ4_XS is the smallest standard 4-bit GGUF and had a tiled matmul kernel on Intel AMX, none on Arm. FastPath64 writes it: 2.12x prefill on Neoverse N2, 1.30x a whole agent turn, byte-identical output.
Log in or sign up for Devpost to join the conversation.