auto round version plz
#1
by
twhitworth
- opened
could we get this in autoround
Could we get AutoRound q2ks gguf of GLM Air REAP?
GLM-4.5-Air-REAP-82B-A12B
https://huggingface.co/cerebras/GLM-4.5-Air-REAP-82B-A12B
Thank you!
Thank you @twhitworth @MartinPatterson for your interests. You may try using AutoRound (https://github.com/intel/auto-round) or submit a Github issue, which can help us better track the issue/request and also benefit others potentially. You may also star/monitor AutoRound project to receive the early notification when there is a new release/update. Thanks for your support and understanding.