4 bit (UINT4 with SVD rank 32) quantization of Tongyi MAI/Z Image Turbo using SDNQ. Usage: Original BF16 vs SDNQ quantization comparison: Quantization Model Size Visualization Original BF16 12.3 GB SDNQ UINT4 3.5 GB
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy