news
17
A developer has implemented DeepSeek V3—including MLA, DeepSeekMoE, aux-loss-free balancing, and MTP—in about 190 lines of pure JAX, training it on a MacBook Air. The project includes a write-up and GitHub repository detailing the approach.
A developer has implemented DeepSeek V3—including MLA, DeepSeekMoE, aux-loss-free balancing, and MTP—in about 190 lines of pure JAX, training it on a MacBook Air. The project includes a write-up and GitHub repository detailing the approach.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.