news
328
A developer successfully ran Google's Gemma 4 26B AI model on a 13-year-old Xeon CPU without using a GPU. By working around the legacy hardware's lack of AVX2 instruction sets, the system achieved a text generation speed of five tokens per second, demonstrating that modern Mixture of Experts models can operate on highly constrained infrastructure.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.