ninfer

ninfer

High-performance single-GPU inference for selected model checkpoints and GPUs.

2.6k 517
Apache-2.0
last commit 2026-08-30
Source
Share:

About

High-performance single-GPU inference for selected model checkpoints and GPUs.

Languages

Contributors6

No features listed.

Comments Theme
Platforms
Hosting
Self-hosted
Install
Docker
Build from source
slug: ninfer