ollamaMQ
High-performance Ollama & LM Studio proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.
About
High-performance Ollama & LM Studio proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.
Languages
Contributors2
No features listed.
Comments Theme
Platforms
Hosting
Self-hosted
Install
Docker
Docker Compose
Cargo
