news
40

Huawei has released MACaQ, an internally developed, model-agnostic quantizer aimed at local inference and beyond. It supports GGUF and can quantize and run text, image, video, and audio models across llama.cpp, vLLM, Diffusers, and PyTorch.

Only full members can comment

Log in to express your opinion.

No comments yet.