inference

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

Open-source inference server and production cluster for all the models your agent needs.

Remory: Learning Residual Memory for Context Compaction