news
133

A new open-source tool called slotstream enables users to run the massive 104GB Qwen3.8-Flash-Next language model on Apple Macs with significantly less RAM. The project achieves this by streaming model experts directly from the SSD, reaching speeds of around 12 tokens per second on a 48GB machine. Built with MLX and Swift, it also provides an Ollama-compatible API for seamless integration.

Only full members can comment

Log in to express your opinion.

No comments yet.