news
195
Inkling-2-Mini in 5.4 GB Memory
2026-11-21A new quantization compiler, lookatmyquant, enables Inkling-2-Mini to run in 5.4 GB of memory. It reportedly achieves 12× lower KL divergence than Q4_K_M at the same file size.
A new quantization compiler, lookatmyquant, enables Inkling-2-Mini to run in 5.4 GB of memory. It reportedly achieves 12× lower KL divergence than Q4_K_M at the same file size.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.