fossy
Curated FOSS Directory for Community and Discussion
Browse
Submit
Sign in
Back to home
·
All projects
Keyword Tag
quantization
Curated open-source repositories matching the tag/keyword "quantization".
1 project found
qwen38-27b-rtx3090
syv-ai/qwen38-27b-rtx3090
Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state), ~114 tok/s single-user at default sampling / ~124 greedy (MTP drafts, own-output draft vocab, calibrated int4 lm_head, split-KV verify attention), 150k-262k context; patches, requant scripts, benchmarks
2.1k
stars
288
forks
Python
Apache-2.0
consumer-gpu
cuda
inference-optimization
kv-cache
Docker
Sponsored
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)