InferX
We propose inference speedups via pruning+SVD and quantization, and improved Chain-of-Thought memory to boost LLM accuracy, efficiency, and long-context reasoning.
We propose inference speedups via pruning+SVD and quantization, and improved Chain-of-Thought memory to boost LLM accuracy, efficiency, and long-context reasoning.
Log in or sign up for Devpost to join the conversation.