dynamo

Alternative to AWS SageMaker

A Datacenter Scale Distributed Inference Serving Framework

8.2k 1.6k

NOASSERTION

last commit 2026-08-30

diffusion disaggregated-serving kubernetes llm-inference omni routing-engine rust sglang tensorrt-llm vllm

Website Source

About

A Datacenter Scale Distributed Inference Serving Framework

Languages

Rust53%Python34.9%Go10%Shell0.8%Dockerfile0.6%HTML0.2%C++0.1%Cuda0.1%Jinja0.1%Makefile0.1%Go Template0.1%C0%CMake0%Starlark0%Standard ML0%

Contributors30

516

289

275

270

253

248

241

227

209

191

181

165

160

156+16

Free alternative to AWS SageMaker

dynamo is a free, open-source alternative to AWS SageMaker. Here's why:

🚀 Datacenter scale LLMs
🧠 Distributed inference serving
☁️ Kubernetes native
⚡️ High-speed routing engine
✨ Diffusion model support

See all open-source alternatives to AWS SageMaker

Comments Theme

Platforms

Kubernetes

Install

pip

Cargo

Keywords

diffusion

disaggregated-serving

slug: dynamo