Fossy
fossy
Back logxio/picchio
picchio

picchio

Catches silent CPU fallback and mislabeled tok/s in local LLMs. llama.cpp and ollama, one file, no deps.

12 315 HN points
MIT
 last commit 2026-07-15
apple-siliconbenchmarkdiagnosticsggufllama-cppllmlocal-llmmetalollamaperformance
Source
Share:

About

Catches silent CPU fallback and mislabeled tok/s in local LLMs. llama.cpp and ollama, one file, no deps.

Languages

Python100%

Contributors1

logxio94

No features listed.

Comments Theme
Keywords
apple-silicon
benchmark
diagnostics
gguf
llama-cpp
llm
local-llm
metal
ollama
performance
slug: picchio

Sponsored

SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)