Fossy
fossy
Back ai-dynamo/dynamo
dynamo

dynamo

A Datacenter Scale Distributed Inference Serving Framework

7.9k 1.5k150 HN points
NOASSERTION
 last commit 2026-08-30
diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglangtensorrt-llmvllm
Website Source
Share:

About

A Datacenter Scale Distributed Inference Serving Framework

Languages

Rust52.1%Python34.4%Go11.4%Shell0.8%Dockerfile0.6%HTML0.3%C++0.1%Cuda0.1%Jinja0.1%Makefile0.1%Go Template0.1%C0%Starlark0%Standard ML0%

Contributors30

PeaBrane499keivenchang284grahamking270tedzhouhk261julienmancuso238ishandhanani236nv-anants222dagil-nvidia221biswapanda194rmccorm4177jthomson04159hhzhang16157alec-flowers153dmitry-tokarev-nv152+16

No features listed.

Comments Theme
Platforms
Kubernetes
Install
pip
Cargo
Keywords
diffusion
disaggregated-serving
kubernetes
llm-inference
omni
routing-engine
rust
sglang
tensorrt-llm
vllm
slug: dynamo

Sponsored

Ad space
300 × 250 (IAB)
SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)