LLMBoost
LLMBoost benchmarks quantisation and speculative decoding on your own GPU, showing real speedups with confidence intervals and testing the research formula against what you get.
LLMBoost benchmarks quantisation and speculative decoding on your own GPU, showing real speedups with confidence intervals and testing the research formula against what you get.
Log in or sign up for Devpost to join the conversation.