news
274
A recent demonstration shows that a dual-GPU setup combining the RTX 5080 and RTX 3090 can run the Qwen 3.6 27B model at Q8 quantization. Utilizing 39GB of combined VRAM, this configuration delivers impressive local AI inference speeds of over 80 tokens per second.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.