Fossy
fossy
Back to home·All projects
Keyword Tag

cpu-inference

Curated open-source repositories matching the tag/keyword "cpu-inference".

1 project found
hotpin-llm
hotpin-llm
LozzKappa/hotpin-llm
HotPin: routing-guided expert pinning for lossless low-RAM MoE inference on consumer CPU+NVMe - 120B model at 3.84 tok/s in 19 GB RAM, no GPU
3stars0forksPython
AGPL-3.0
cpu-inference
edge-ai
llama-cpp
llm

Sponsored

Ad space
300 × 250 (IAB)
SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)