Curated FOSS Directory for Community and Discussion

Back to home·All projects

Keyword Tag

inference

Curated open-source repositories matching the tag/keyword "inference".

1 project found

tiny-vllm

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

927stars66forks C++

Sponsored

300 × 250 (IAB)

Sponsor

Sponsor

Sponsor

Sponsor

300 × 250 (IAB)

300 × 250 (IAB)