mlx-serve

mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

1.8k 180
NOASSERTION
last commit 2026-09-01
Website Source
Share:

About

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

mlx-serve website preview

Languages

Contributors30

No features listed.

Comments Theme
slug: mlx-serve