ninfer

ninfer

High-performance single-GPU inference for selected model checkpoints and GPUs.

1.2k 2193 HN points
Apache-2.0
last commit 2026-08-30
Source
Share:

About

High-performance single-GPU inference for selected model checkpoints and GPUs.

Languages

Contributors3

No features listed.

Comments Theme
Platforms
Hosting
Self-hosted
Install
Docker
Build from source
slug: ninfer