AWQ Quantization?

#7
by hoemwmt - opened

Can someone produce an AWQ quantization for this model?

@cpatonn ,
I hope you can help. It is quite expected.

Sign up or log in to comment