news
356
Cactus Compute has released Needle, a lightweight foundation model that distills Google Gemini's tool-calling capabilities into just 26 million parameters. Weighing only 14MB, the model can process up to 6,000 tokens per second on resource-constrained hardware. This enables advanced, local AI functionalities on tiny devices like mobile phones, wearables, smart home systems, and robots.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.