llama-cpp

Arabic-first generative speech recognition — Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic ASR Leaderboard. Model cards, benchmarks & inference.

Fully offline meeting notetaker for macOS — records, transcribes, and summarizes on-device with Whisper and a local LLM. Meeting detection, system-audio capture, ask-your-notes with timestamp citations. No cloud, no accounts.

HotPin: routing-guided expert pinning for lossless low-RAM MoE inference on consumer CPU+NVMe - 120B model at 3.84 tok/s in 19 GB RAM, no GPU