Cascade4Arm - CloudAI Track
A router-driven Qwen2.5 cascade on AWS Graviton4 that beats a self-hosted baseline by 20x and a hosted API by 4x — built with llama.cpp, KleidiAI kernels, and speculative decoding for Neoverse-V2
A router-driven Qwen2.5 cascade on AWS Graviton4 that beats a self-hosted baseline by 20x and a hosted API by 4x — built with llama.cpp, KleidiAI kernels, and speculative decoding for Neoverse-V2
Log in or sign up for Devpost to join the conversation.