Fossy
fossy
Back kvcache-ai/ktransformers
ktransformers

ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

18k 1.4k20 HN points
Apache-2.0
 last commit 2026-07-19
Website Source
Share:

About

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Languages

Python57.1%C++34.1%Cuda4.9%Shell1%CMake0.8%Vue0.7%HTML0.4%TypeScript0.3%CSS0.2%Dockerfile0.2%C0.1%Stylus0.1%JavaScript0.1%Makefile0%Batchfile0%

Contributors30

Atream245KMSorSMS155Azure-Tang116qiyuxinlin100ovowei95SkqLiao73UnicornChan58RICHARDNAN38JimmyPeilinLi37WithHades29ouqingliang27cen12121225yyj666666721ErvinXie20+16

No features listed.

Comments Theme
Install
pip
slug: ktransformers

Sponsored

SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)