news
349
A new open-source project called Swiftlet enables users to run massive large language models on Apple devices with remarkably low memory requirements. The tool successfully demonstrates running an 80-billion parameter Qwen model using just 4.3 GB of RAM on a Mac, alongside a 35-billion parameter model on an iPhone. This advancement significantly lowers the hardware barrier for running powerful local AI inference on everyday consumer devices.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.