Nunchaku Lite: 4-bit Inference of Diffusion Models in Diffusers

Nunchaku is a quantization method SVDQuant (W4A4) for diffusion transformers. The new Nunchaku Lite integration allows loading quantized checkpoints directly via from_pretrained() in Diffusers, without a separate engine. Generation speed increases up to 1.8x, peak VRAM consumption drops up to 50%.

Hugging Face Baidu

Alibaba Open-Sources AI Stack SAIL: 260+ Frameworks Out of the Box

Alibaba's chip development division, Ping Tou Ge, has announced the open-sourcing of its proprietary AI software platform, T-Head SAIL. This stack, used on 560,000 chips in the Zhenwu series, covers layers from drivers to development tools and is compatible with over 260 popular frameworks, including PyTorch and TensorFlow. The solution aims to lower the entry barrier for developers and accelerate migration from CUDA.

Alibaba/Qwen