picchio
Catches silent CPU fallback and mislabeled tok/s in local LLMs. llama.cpp and ollama, one file, no deps.
About
Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.
Languages
Contributors1
No features listed.
Comments Theme
