news
331

Researchers have developed a novel technique to compress large language models to just 1.58 bits per weight using ternary quantization, overcoming previous performance limitations at this extreme compression level. This breakthrough enables the creation of significantly smaller and more efficient AI models without sacrificing accuracy, paving the way for deployment on resource-constrained devices.

Only full members can comment

Log in to express your opinion.

No comments yet.