ArmInfer
ArmInfer automatically benchmarks and tunes llama.cpp inference on Arm64 hardware, then reports the fastest measured configuration with reproducible before/after results.
ArmInfer automatically benchmarks and tunes llama.cpp inference on Arm64 hardware, then reports the fastest measured configuration with reproducible before/after results.
Log in or sign up for Devpost to join the conversation.