fossy
Curated FOSS Directory for Community and Discussion
Top 100
All Projects
Languages
Platforms
Contributors
Articles
Sponsor
Submit
Sign in
Back to home
·
All projects
Keyword Tag
inference-engine
Curated open-source repositories matching the tag/keyword "inference-engine".
1 project found
tessera
zengxiao-he/tessera
From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.
165
stars
1
forks
Python
NOASSERTION
cuda
flash-attention
fsdp
inference-engine
Sponsored
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)
