ATLAS
ATLAS Engine is a high-performance LLM framework featuring Paged KV Cache and Fused Triton Kernels. It optimizes GPU throughput via an autotuner, outperforming vLLM in speed and P99 latency.
ATLAS Engine is a high-performance LLM framework featuring Paged KV Cache and Fused Triton Kernels. It optimizes GPU throughput via an autotuner, outperforming vLLM in speed and P99 latency.
Log in or sign up for Devpost to join the conversation.