Fossy
fossy
Back jundot/omlx
omlx

omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

19k 1.6k4 HN points
Apache-2.0
 last commit 2026-08-18
apple-siliconinference-serverllmmacosmlxopenai-api
Website Source
Share:

About

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

omlx website preview

Languages

Python76.5%Swift8.6%HTML7.3%JavaScript3.1%C++2.8%Metal0.7%Objective-C++0.4%CSS0.2%Shell0.2%Ruby0.1%CMake0.1%

Contributors30

jundot1569cfbraun85JimStenstrom36github-actions[bot]24ethannortharc19richgoodson19faisal18popfido15latent-variable14ashhart14ivaniguarans13lyonsno12blightbow12fparrav11+16

No features listed.

Comments Theme
Platforms
macOS
Install
pip
Keywords
apple-silicon
inference-server
llm
macos
mlx
openai-api
slug: omlx

Sponsored

Ad space
300 × 250 (IAB)
SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)