news
274

A recent demonstration shows that a dual-GPU setup combining the RTX 5080 and RTX 3090 can run the Qwen 3.6 27B model at Q8 quantization. Utilizing 39GB of combined VRAM, this configuration delivers impressive local AI inference speeds of over 80 tokens per second.

Only full members can comment

Log in to express your opinion.

No comments yet.