news
17

A developer has implemented DeepSeek V3—including MLA, DeepSeekMoE, aux-loss-free balancing, and MTP—in about 190 lines of pure JAX, training it on a MacBook Air. The project includes a write-up and GitHub repository detailing the approach.

Only full members can comment

Log in to express your opinion.

No comments yet.