Fossy
fossy
Back ai-dynamo/dynamo
dynamo

dynamo

A Datacenter Scale Distributed Inference Serving Framework

8.0k 1.6k150 HN points
NOASSERTION
 last commit 2026-08-30
diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglangtensorrt-llmvllm
Website Source
Share:

About

A Datacenter Scale Distributed Inference Serving Framework

Languages

Rust52.7%Python34.5%Go10.6%Shell0.9%Dockerfile0.6%HTML0.2%C++0.1%Cuda0.1%Jinja0.1%Makefile0.1%Go Template0.1%C0%Starlark0%Standard ML0%

Contributors30

PeaBrane502keivenchang287grahamking270tedzhouhk270ishandhanani242julienmancuso240dagil-nvidia227nv-anants223biswapanda198rmccorm4179jthomson04167hhzhang16159alec-flowers159dmitry-tokarev-nv155+16

No features listed.

Comments Theme
Platforms
Kubernetes
Install
pip
Cargo
Keywords
diffusion
disaggregated-serving
kubernetes
llm-inference
omni
routing-engine
rust
sglang
tensorrt-llm
vllm
slug: dynamo

Sponsored

Ad space
300 × 250 (IAB)
SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)