Can support google/byt5 model quantization? #2
Description
Now I use NF4, I want to quantize ByT5-xxl models to LeanQuant 4bit, please help me to check it can support this?
{{ message }}
Now I use NF4, I want to quantize ByT5-xxl models to LeanQuant 4bit, please help me to check it can support this?