ARMScale
Autonomously optimizes LLM inference across quantization, CPU threads, and context size to find the fastest, most efficient configuration for edge deployment.
Autonomously optimizes LLM inference across quantization, CPU threads, and context size to find the fastest, most efficient configuration for edge deployment.
Log in or sign up for Devpost to join the conversation.