Anai-Guo

A self-hosted AI inference engine for running large language models locally

Unsloth is a local UI for training and running Gemma 4, Qwen3.6, DeepSeek, Kimi, GLM and other models.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Distribute and run LLMs with a single file.