mit-han-lab/svdquant-datasets
Preview • Updated • 255 • 6
How to use nunchaku-ai/nunchaku-z-image-turbo with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("nunchaku-ai/nunchaku-z-image-turbo", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]
This repository contains Nunchaku-quantized versions of Z-Image-Turbo, a high-performance image generation model. It is optimized for efficient inference while maintaining minimal loss in performance.
No recent news. Stay tuned for updates!
Data Type: INT4 for non-Blackwell GPUs (pre-50-series), NVFP4 for Blackwell GPUs (50-series).
Rank:
r32 for faster inference,r128 for better quality but slower inference,r256 for highest quality (slowest inference).Standard inference speed models for general use
| Data Type | Rank | Model Name | Comment |
|---|---|---|---|
| INT4 | r32 | svdq-int4_r32-z-image-turbo.safetensors |
|
| r128 | svdq-int4_r128-z-image-turbo.safetensors |
||
| r256 | svdq-int4_r256-z-image-turbo.safetensors |
||
| NVFP4 | r32 | svdq-fp4_r32-z-image-turbo.safetensors |
|
| r128 | svdq-fp4_r128-z-image-turbo.safetensors |
@inproceedings{
li2024svdquant,
title={SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models},
author={Li*, Muyang and Lin*, Yujun and Zhang*, Zhekai and Cai, Tianle and Li, Xiuyu and Guo, Junxian and Xie, Enze and Meng, Chenlin and Zhu, Jun-Yan and Han, Song},
booktitle={The Thirteenth International Conference on Learning Representations},
year={2025}
}
Base model
Tongyi-MAI/Z-Image-Turbo