news
195

A new quantization compiler, lookatmyquant, enables Inkling-2-Mini to run in 5.4 GB of memory. It reportedly achieves 12× lower KL divergence than Q4_K_M at the same file size.

Only full members can comment

Log in to express your opinion.

No comments yet.