Curated FOSS Directory for Community and Discussion

Back to home·All projects

Keyword Tag

llm-inference

Curated open-source repositories matching the tag/keyword "llm-inference".

1 project found

tiny-vllm

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

808stars51forks C++

Sponsored

Sponsor

Sponsor

Sponsor

Sponsor

300 × 250 (IAB)

300 × 250 (IAB)