reame

Reame — CPU-first LLM inference server on llama.cpp: disk KV cache, self-regulating speculation, generation archive, interleaved multi-user, the Conclave. Your hardware, your realm.

60 5

MIT

last commit 2026-07-12

cpu gguf inference kv-cache llama-cpp llm openai-api speculative-decoding

Source

About

Reame — CPU-first LLM inference server on llama.cpp: disk KV cache, self-regulating speculation, generation archive, interleaved multi-user, the Conclave. Your hardware, your realm.