trnrt

trnrt

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

1.6k 20
Apache-2.0
last commit 2026-11-11
Website Source
Share:

About

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

trnrt website preview

Languages

Contributors3

No features listed.

Comments Theme
slug: trnrt