Fossy
fossy
Back andreaborio/ds4
ds4

ds4

DeepSeek 4 Flash local inference engine for Metal and CUDA

65 824 HN points
MIT
 last commit 2026-07-17
apple-siliconcdeepseekggufglminference-enginellm-inferencelocal-ailocal-llmmacos
Source
Share:

About

Metal-first MoE inference for Apple Silicon with bounded SSD expert streaming and local OpenAI Chat, Responses, and Anthropic Messages endpoints.

ds4 website preview

Languages

C48.5%Objective-C21%C++11.8%Metal10.1%Python6.6%Shell1.3%Makefile0.5%Jinja0.2%

Contributors30

antirez236andreaborio15mitsuhiko7jackygurui4cv3Chida823rinaldofesta3gmontana2unsaltedbutter-ai2ivanfioravanti2beamivalice2VadimDu2cghart2fry692+16

No features listed.

Comments Theme
Install
Build from source
Keywords
apple-silicon
c
deepseek
gguf
glm
inference-engine
llm-inference
local-ai
local-llm
macos
metal
mixture-of-experts
moe
on-device-ai
openai-compatible
qwen
ssd-streaming
slug: andreaborio-ds4

Sponsored

Ad space
300 × 250 (IAB)
SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)