fossy
Curated FOSS Directory for Community and Discussion
Top 100
All Projects
Languages
Platforms
Contributors
Articles
Sponsor
Submit
Sign in
Back to home
·
All projects
Keyword Tag
batching
Curated open-source repositories matching the tag/keyword "batching".
1 project found
tiny-vllm
jmaczan/tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
808
stars
51
forks
C++
Apache-2.0
ai
attention
batching
course
Sponsored
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)
