news
370
The new Strata inference engine enables users to run the 125-billion parameter Qwen 3.8 Flash Next model on consumer hardware like the RTX 4090 at speeds reaching 100 tokens per second. Available for Windows and Linux with a one-click installation, the tool provides a local API compatible with OpenAI and Anthropic formats alongside optional multimodal image input.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.