reidliu41

A high-throughput and memory-efficient inference and serving engine for LLMs

Open-source coding agent for your terminal, built in Rust and on a journey of continuous community improvement. Issues and PRs welcome.