Fossy
fossy
Back youssofal/MTPLX
MTPLX

MTPLX

2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

1.1k 844 HN points
Apache-2.0
 last commit 2026-06-27
anthropic-compatibleapple-siliconinference-enginelocal-aimetalmlxmtpmtplxnative-mtpopenai-compatible
Website Source
Share:

About

3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

MTPLX website preview

Languages

Python73.2%Swift22.3%Metal1.8%TypeScript1.1%Shell0.8%C++0.7%Jinja0.2%CSS0%HTML0%CMake0%

Contributors18

youssofal271dependabot[bot]13daniel-farina9mmmugh8PhilipJohnBasile4claude3titan5502SuperMarioYL2shiftedx1lBroth1ashalliants1hasegaw1Osamaali3131shiningliang1+4

No features listed.

Comments Theme
Install
pip
Keywords
anthropic-compatible
apple-silicon
inference-engine
local-ai
metal
mlx
mtp
mtplx
native-mtp
openai-compatible
qwen
qwen3-next
speculative-decoding
speculative-sampling
slug: mtplx

Sponsored

Ad space
300 × 250 (IAB)
SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)