deepseek-v3-jax

deepseek-v3-jax

DeepSeek V3 (MLA, DeepSeekMoE, aux-loss-free balancing, MTP) in 190 lines of pure JAX, trained on a MacBook Air. Write-up: vaibhaav.in/writing/deepseek-v3-jax

182 16
MIT
last commit 2026-11-15
Website Source
Share:

About

DeepSeek V3 (MLA, DeepSeekMoE, aux-loss-free balancing, MTP) in 190 lines of pure JAX, trained on a MacBook Air. Write-up: vaibhaav.in/writing/deepseek-v3-jax

deepseek-v3-jax website preview

Languages

Contributors2

No features listed.

Comments Theme
Install
pip
slug: deepseek-v3-jax