news
356

Cactus Compute has released Needle, a lightweight foundation model that distills Google Gemini's tool-calling capabilities into just 26 million parameters. Weighing only 14MB, the model can process up to 6,000 tokens per second on resource-constrained hardware. This enables advanced, local AI functionalities on tiny devices like mobile phones, wearables, smart home systems, and robots.

Only full members can comment

Log in to express your opinion.

No comments yet.