goetheServe your models fast on your own infra in 3 steps. 49 3Apache-2.0 last commit 2026-11-06gpuinferencellmnvfp4nvidiaopenai-apiself-hostedsglang Website SourceAdd to my stackDiscuss Share:AboutServe your models fast on your own infra in 3 steps.LanguagesRust55.4%Python35.3%Shell4.8%Cuda4.2%Go Template0.2%Dockerfile0.1%C0%C++0%Contributors226169FeaturesDiscussNo features listed.Comments ThemeGitHub LightGitHub Light High ContrastGitHub Light Protanopia & DeuteranopiaGitHub Light TritanopiaGitHub DarkGitHub Dark High ContrastGitHub Dark Protanopia & DeuteranopiaGitHub Dark TritanopiaGitHub Dark DimmedPreferred color schemeTransparent DarkNoBorder LightNoBorder DarkNoBorder GrayRStudio CobaltPurple DarkGruvboxGruvbox DarkGruvbox LightCatppuccin LatteCatppuccin FrappéCatppuccin MacchiatoCatppuccin MochaFroCustom (experimental)PlatformsDockerHostingSelf-hostedInstallDockerKeywordsgpuinferencellmnvfp4nvidiaopenai-apiself-hostedsglang