news
331

Researchers have developed a novel technique to compress large language models to just 1.58 bits per weight using ternary quantization, overcoming previous performance limitations at this extreme compression level. This breakthrough enables the creation of significantly smaller and more efficient AI models without sacrificing accuracy, paving the way for deployment on resource-constrained devices.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.